Sit idly by

To sit and watch something while others work, to ignore a situation that calls for help.

The man sat idly by while the others worked hard.