Stephen Colbert has been doing music-related stuff on his show all week long, which included him recording a single, “Charlene II (I’m Over You),” with the help of Jack White. Earlier today, the duo showed up at the High Line with the very goth-y looking Black Belles and the fake newsman held a brief concert.

And by brief, I mean that Colbert sang one song, two if you count the national anthem:

Then, with beers in hand, they went on to sign autographs. Here’s a photograph of Stephen Colbert stealing* a fan’s $50 bill while Jack White signs the other $50 that was dropped on the table.

*A few minutes later, a Comedy Central staffer emerged and gave the guy his $50 back… unsigned.