Throw in the towel

To quit, to surrender, to give up.

The boxer threw in the towel about halfway through the match.