In good conscience

Having good motives.

I wrote the letter and complained to the woman in good conscience.