Stand by (someone)

To follow or keep one`s promise to someone, to be loyal to or support someone.

The woman always stands by her husband when he has a problem.