Jack White and Conan O’Brien have a long history together. During the peak of their meteoric rise, the White Stripes played a week-long residency at Late Night With Conan O’Brien. Then, Conan showed up in the Stripes’ video for “The Denial Twist,” in which Michel Gondry recreated a fantastical version of that residency. (I’m also in that video: Squished tall masked Conan, attempting to lumber across the stage in shoe lifts at 0:48.) Before Conan took over The Tonight Show, the White Stripes were the final musical guests on Conan’s version of Late Night; it also turned out to be their final performance. And Conan recently recorded a live single at Jack White’s Third Man command center. So it’s a bit weird that White waited until this late in the Blunderbuss promotional cycle to show up on Conan, but he finally dropped by last night, bringing his all-female backing band and ripping through his cover of Little Willie John’s “I’m Shakin’.” White pretty much kicked ass in the performance, which you can watch below.

Blunderbuss is out now on Third Man/Columbia.