Miley Cyrus. Photo by Joe Papeo/REX/Shutterstock (8856995k)

When New Yorkers commuted on the subway this past Wednesday, they could not have expected an impromptu secret-celebrity concert.

However, that is exactly what happened. Donning wigs and cowboy hats, Cyrus and Fallon took to the subways and made entirely new identities: Charlene and Bart. “No one knows that this is going to happen,” Fallon said to his viewers before singing with Cyrus. “Let’s do this.”

With Cyrus singing and Fallon on the tambourine, the duo performed Dolly Parton’s “Jolene.” And, as the crowd grew in size, they began to recognize the pop singer’s distinctive voice.

After their song ended, Cyrus and Fallon knew they had been discovered. They removed their disguises – and got a very strange reaction.

“It was crazy,” Cyrus said of the incident. “I didn’t know how recognizable we really would be. I mean, you [Fallon] were getting called Billy Ray Cyrus. Right on! You were in disguise—they knew it was me! They thought it was me and my dad. I thought it was me and my dad! And then you took [the wig] off and I was like, ‘Holy s–t! My dad is Jimmy Fallon!'”

The whole scenario was “crazy,” Fallon said. What made it even more crazy was that it was the first time Cyrus had ever been on a New York subway.

“This is my first time at the subway station,” she said. “This is exciting s–t for me! I will always remember it. I don’t think it’s like anyone else’s first time.”

“I don’t get a lot of first times anymore. I’ve been every kind of crazy mascot. I’ve done a lot of crazy things, as everyone knows. That wasn’t the craziest thing I’ve ever done—even a little bit—but it was definitely memorable!”

You can watch the hilarious sketch below!