updated 05/07/2014 AT 6:30 PM ET
•originally published 05/07/2014 AT 4:30 PM ET
For their fifth annual We’re All for the Hall benefit concert in Nashville on Tuesday, Keith Urban and Vince Gill decided to have a little fun with their fellow artists.
Instead of just having them perform their hits, they asked that each of the country stars singing in the show recount the stories behind their songs. “Fans love to hear the story behind the song, and country music is all about stories,” Gill told PEOPLE Country. “I love the theme this year.”
However, Carrie Underwood wasn’t so sure.
“Talking on stage is a weak point for me,” she told the Bridgestone Arena crowd. “But this song has a fun story so I’ll try. Before I met my beautiful, wonderful, perfect hockey husband I had met this guy. I got together with Hillary Lindsey and Luke Laird to write and we were goofing around like we always do. I was telling them about this guy I met. They asked who he was and I said ‘Y’all! I don’t even know his last name!’ We hadn’t even dated or anything and it didn’t turn out the way this song did, but I said, ‘We need to turn this mess into a song!’ And this is it.”
The all-star concert – which also included performances by Darius Rucker, Reba McEntire, Ronnie Milsap, Kacey Musgraves, Brett Eldredge, Kip Moore and Lee Ann Womack – was expected to raise at least $600,000 for the Country Music Hall of Fame and Museum.
The show ended with all the performers joining Rucker on stage for a group sing of his hit “Wagon Wheel.” His backstory? “A couple years ago I was at my daughter’s high school talent show and the faculty band played this song,” he told the crowd. “I was nearly finished with my album but I texted my producer right there and said ‘I want to cut ‘Wagon Wheel.””
After that feel-good moment, Urban closed the night with a fond goodbye to fans: “Thank you. Goodnight, see you next year and God bless the Hall!”