updated 06/27/2014 AT 11:05 AM ET
•originally published 06/27/2014 AT 10:20 AM ET
The 46-year-old actor was asked by a viewer if he still kept in touch with 13 Going on 30 pal Jennifer Garner, and Ruffalo had a surprising answer.
“We have a great time together,” he said of filming the movie. “But then Ben came on the scene.”
Thinking Ruffalo’s remark about Garner’s hubby, Ben Affleck, was a comedic quip, host Andy Cohen responded, “I heard he doesn’t allow her to have male friends?”
Instead of laughing it off, Ruffalo just shrugged, and said he couldn’t confirm or deny the statement.
He and Garner played love interests in the 2004 rom-com, which came out around the same time that the Alias star and Affleck started dating.