According to The Sun, 40-year-old David was keen to get audience tickets for the live stages of the brand new BBC One talent contest, so he could take his mum Kathleen to see coach Tom Jones in action.
The Little Britain comedian frequently invites her to showbiz events, and even sought advice from her during a recent BGT audition.
However, he is now said to have abandoned the plan as he doesn't want to antagonise Simon or appear a 'traitor'.
An insider told the newspaper: "Simon is gunning for The Voice. He wants to destroy it and is really unhappy that it's going up against BGT.
"He doesn't want anyone associated with his show being linked with The Voice - and that includes being seen sitting in the audience.
"If David turned up, the BBC would use loads of shots of him in the audience and viewers would think he preferred The Voice.
"It's a battlefield mentality - you're either with Simon or against him. There are no half measures."
The BBC and ITV are at loggerheads over the two shows, which will clash for twenty minutes when their first episodes air on Saturday after a scheduling battle. Reports claim ITV was set to launch Got Talent next week, on March 31st, but later opted to bring it forward.