02/26/2014 AT 12:45 PM ET
The Masters of Sex actor and comedian were first linked when she attended Sheen’s 45th birthday bash with other pals in West Hollywood on Feb 6. They were later seen partying at Soho House.
Though they’ve remained mum about romance, a source recently confirmed to PEOPLE that they are dating.
On Saturday, Sheen and Silverman, 43, joined a group of friends for lunch then the next day spotted strolling around L.A. in casual clothing.