On horseback

On the back of a horse.

We went to the campground on horseback.