Yoke around someone’s neck

A burden for someone.

The complaints from the apartment manager were a yoke around our neck.