Last night at the 46th annual Songwriter Hall Of Fame awards dinner, several current stars covered classic songs to honor this year’s inductees. Carly Rae Jepsen covered Cyndi Lauper’s iconic ’80s love song “Time After Time.” Lady Gaga has been covering 4 Non Blondes’ “What’s Up” for a while now, so she performed a rendition to honor Linda Perry’s induction. Gaga was also honored herself with the first-ever Contemporary Icon Award.

But all good award shows have a bit of humor in them, and that came in the form of Stephen Colbert. He did a spot-on rendition of Toby Keith’s “As Good As I Once Was” to honor the country singer, who claimed that this induction is “the only thing I ever wanted.” High praise! Also, who knew Colbert could sing like that? Watch clips of all three covers below.

Carly Rae Jepsen covering Cyndi Lauper’s “Time After Time”:

Lady Gaga covering 4 Non Blondes’ “What’s Up”:

Stephen Colbert covering Toby Keith’s “Not As Good As I Once Was”: