Slip out

To go away, to leave quietly or secretly.

I slipped out for a few minutes to buy some milk.