Shack up with (someone)

To live with someone without marrying him or her.

When my sister was younger she shacked up with her boyfriend for two years.