This couplet was composed by Charles H. Spurgeon, the famous Baptist minister and orator.
The leading performer in an orchestra is the first violin. By extension, to play first violin is to take the leading part in any enterprise. A familiar or contemptuous name for a violin is a fiddle, so to play second fiddle is to take a subordinate part. To play the second fiddle well is to give loyal support to your immediate superior.