Go to seed

To become worn-out or uncared for.

The area around the post office is going to seed.