Have a chip on one’s shoulder

To seem to want to start a conflict or quarrel.

Our neighbor has a chip on his shoulder and is always trying to start a fight.