Sit idly by To sit and watch something while others work, to ignore a situation that calls for help. The man sat idly by while the others worked hard.