At the expense of (someone or something)

To be to the harm of (someone or something).

The man was very successful but it was at the expense of his family and health.