updated 04/14/2014 AT 9:00 AM ET
•originally published 04/14/2014 AT 10:25 AM ET
Justin Bieber surprised Coachella-goers with a performance to support his friend and Chicago MC, Chance The Rapper, on Sunday. But the bigger surprise was the presence of Bieber’s on-again-off-again squeeze, Selena Gomez, who stood on the side of the stage to watch him sing.
“Right after his performance Bieber walked off stage and watched the rest of Chance’s set with Selena Gomez,” a source tells PEOPLE. “They were there for around 15 minutes until Bieber touched Gomez on her mid back as if to say, ‘Let’s go,’ and the two left together.”
According to an onlooker who posted on Twitter, the couple certainly had a cozy look about them.
Wrote Ryan Marker: “Just saw @justinbieber and @selenagomez holding hands back stage at coachella….looks like they are back together.”
While on stage the 20-year-old pop star performed his song “Confident” that features Chance. “She’s confident and I’m down with it,” he sang. Gomez, 21, recently expressed her own self-confidence when she opened up about issues she’s been struggling with – some of which may have led her to seek rehab in January.
“I’d be lying if I said I’ve never tried to make myself better by giving in because I have,” the actress said at a We Day conference in March this year. “But I’ve learned from my actions and for all of the things I’ve done, I’m proudest of that. I’ve learned from my mistakes.”
Ryan Marker (@marker_ryan) April 13, 2014