Residents of Williamsburg got a fun surprise on Tuesday evening, when Jon Batiste, the new band leader for The Late Show with Stephen Colbert, performed a surprise concert.

Gothamist, which snapped some photos of the parade, estimates that ” At times, as many as 50 people were caught up in the moment, clapping, singing, and (of course) shooting video and taking selfies.”

Batiste strolled through the streets with his band, Stay Human, performing a mix of jazz classics and his own original music. Watch the performance in the video above.