Jay Stone founded the Jay Stone Singers in 1976. At the time, he was choir director at Mount Carmel Pentecostal Holiness Church in Fayetteville, North Carolina. He had previously been part of several local Southern Gospel groups. Original group members also included his wife (Mary) and their two children, Jeff and Sharona, who were 13 and 11 at the time.

Bobby Carter joined the group in 1984, singing and playing bass guitar. He married Sharona in November 1987. Today, their children Stone (age 14) and Emma (age 11) have also joined the group. In thirty-eight years on the road, the group has performed in nineteen states, as well as Canada and Mexico.