Take (someone’s) part

To take a side in an argument.

My friend always takes my part when I am having an argument with someone.