Drop by the wayside

To give up or fail before the finish of something.

Many runners dropped by the wayside during the marathon.