In the wrong place at the wrong time

Something bad happens in a place or time where you happen to be.

The man was in the wrong place at the wrong time when the car hit him.