Sit back

To be located a distance away from a street.

The large mansion sits back three hundred meters from the street.