Part company (with someone)

To leave someone, to depart from someone.

The two business partners decided to part company and begin their own businesses.