take French leave
To leave quietly and unnoticed, without asking for permission or informing anyone; to slip out.
As for Ditton, after all his courting, and his compliment, he ſtole avvay an Iriſhman's bride, and took a French leave of me and his maſter; […]