The Palmetto State Quartet was founded in 1946 or 1947 in Greenville, South Carolina. They performed a thirty minute program on WFBC Radio in Greenville, and it is said that the group was named through an on-air contest. Jack Bagwell joined the group in 1952, and Jack Pittman joined in 1954. The two Jacks would anchor the quartet for decades, though the mid-1990s. Several noted Southern Gospel legends were part of the group at one time or another, including Hovie Lister (who joined in 1989), Ken Turner (who joined in 1960, and later sang with the Dixie Echoes and Blackwood Brothers), and Harold Gilley.

In 1997, Jack Bagwell, Jack Pittman, and Harold Gilley all retired, and the group went through a major restructuring. Keyboardist Woody Beatty and tenor Brion Carter carried on the name. Woody brought his eldest son, Kerry Beatty, on board to sing lead. Former Wilburns and future Kingsmen baritone Tony Peace came on board to sing baritone, and Jeff Pearles sang bass. Carter developed vocal trouble in late 2002; John Rulapaugh came on board to fill on, and became an official member in January 2003. Jeff Pearles left the group in mid-2003, and was replaced by Aaron "Tex" McCune. After the release of When it Pours God Reigns (2006), the group had another transition; Rulapaugh came off the road and McCune left for Gold City. Tenor Wesley Smith and bass Burman Porter came on board for the group's final Crossroads release, Thank God for a Song (2007).