It’s rough out there, and ’90s alt-rock icons have to stick together. Maybe that’s why the Smashing Pumpkins and Marilyn Manson, two acts who never had much in common besides the Lost Highway soundtrack, are touring together this summer. And on their Sunday night show in Nashville, they also shared a stage — or, rather, a fake pulpit. Manson introduced his song “Antichrist Superstar” with a whole satanic-preacher schtick, complete with burning Bible. And midway through the song, Corgan, in nun drag, came onstage to duet with Manson on the song. They sounded pretty great together, too! As it ended, they segued into a brief and whimper-moaned cover of Cyndi Lauper’s “Girls Just Wanna Have Fun.” (They were singing it as “Nuns Just Wanna Have Fun,” naturally.) Watch a fan-made video below.

This show honestly looks fun as hell.