The Oak Ridge Boys, the country and gospel vocal quartet, first sang for former President George H.W. Bush on the lawn of the White House in 1983.

They sang “Amazing Grace” at the 41st president’s funeral at St. Martin’s Episcopal Church in Houston, Texas. They were old friends of George H.W. Bush and joked that he said he was a good bass singer, which they said he was not.

Singer and songwriter Reba McEntire also sang the “Lord’s Prayer”: