Come to a bad end

To end in disaster.

The man and his family came to a bad end when they moved to a small town.