См. также: с возложением судебных расходов на сторону, проигравшую дело, с выделением, с высоким отличием, с высшим отличием
With your permission, I'd like to say a few words. (Oxford Learner's Dictionaries)
‘with your leave, I will send him your address’ (Oxford English and Spanish Dictionary)
“by your leave” is rarely heard and likely to be found in written works from maybe a century ago.
'By your leave' is a phrase that is today probably confined to the households of Dukes and Earls and military contexts, if it's heard at all. (WordReference.com)
Into the 20th century it was common to say "by your leave" (= "with your permission") as a mild apology for pushing through a crowd, or for introducing a possibly awkward fact or topic into a discussion. (StackExchange)
