BBC insiders hit out at ITV this week after the two reality shows were pitched against one another on Saturday nights.
One source claimed: “This is getting absolutely ridiculous. It doesn’t serve the viewers."
But Simon hit back yesterday at the launch of the new series of BGT.
Chatting to us on the red carpet, he said: "They're the ones who brought this show to the UK to compete with us.
"We were there always on Saturday night, they're the ones who wanted a competition, we never asked of it, they did"
And Simon added: "It's their problem, not my problem."
The two clashes will only clash this weekend, with the Beeb having already moved The Voice to a much later time slot next Saturday.
A spokesperson for the channel said: "We are trying to do what’s best for the viewer with two talent shows on at the same time. We have rescheduled to avoid a clash.”
Tomorrow night sees The Voice air from 6:45PM on BBC One while BGT starts on ITV at 7PM.