One of the rumors and floating around Hollywood is that Ben Affleck might have committed infidelity with his children’s nanny while being with Jennifer Garner. They completely deny it and so it is still just another rumor.