updated 04/10/2013 AT 7:00 AM ET
•originally published 04/10/2013 AT 8:30 AM ET
It’s officially duty-swap time in the Affleck-Garner household. As mom Jennifer Garner gets back into filmmaking this summer with a full plate of work, her Oscar-winning husband will hold down the fort at home as Mr. Mom.
“Jennifer is going to work,” a chuckling Affleck, 40, told PEOPLE Monday night. “And she told me to go to the gym.”
That reference is aimed directly at Affleck’s post-Oscar ice-cream diet that he has enjoyed in his down time after awards season. Affleck will now need his stamina to supervise his brood, including daughters Violet, 7, and Seraphina, 4, and infant son, Samuel, 1.
“I’m preparing myself to take on some more of the burden [at home],” Affleck said at the Los Angeles premiere of To The Wonder, hosted by Fiji Water and Disaronno. “[Jennifer’s] got a couple of movies coming up, so it’s going to be a little Mr. Mom action, and I’m going to get back in the ring and we’re going to see if I still have it.”
Garner, who turns 41 April 17, stars next in the film Dallas Buyers Club with Matthew McConaughey, and will also begin work alongside Kevin Costner in the new film Draft Day about NFL football.