Try (someone’s) patience

To do something annoying that may cause someone to lose patience.

The constant complaints of the customers are beginning to try the clerk’s patience.