On the sly

Secretly.

We went to the restaurant on the sly so that nobody would know where we were.