Since the singing contest begun its sharp decline in the ratings in 2012, Got Talent has trumped it in the ratings, averaging 9.86million against X Factor's 9.45 million last year.
This hasn't escaped Holden, who thinks ITV should now switch the two shows in the schedules in an attempt to boost BGT's chances of winning awards.
Speaking to Digital Spy on the red carpet at BGT's London auditions yesterday, the 42-year-old said: "I'd like to see Boot Camp on Britain's Got Talent. I'd like us to stretch out, take over the X Factor slot and we'll have Boot Camp.
"I love the controversial seat swapping on X Factor, I thought it was amazing, a really cool idea."
She added: "We never get remembered when it comes to any [awards ceremonies]. It's a good show."
Holden is the only person to have been a full-time judge on all eight series of Got Talent, which is set to return for its eighth series in April.