Double back

To turn back from where you are going or where you have been.

We decided to double back from the arena and return home.