Left at the gate

To be abandoned (a horse that does not leave the starting gate during a race is said to be left at the gate).

Everyone at my office went to lunch without me. I was left at the gate.