Burst out crying/laughing/singing

To begin to cry/laugh/sing suddenly.

We burst out laughing when the man screamed after seeing the mouse.

The little boy burst out crying in the restaurant.