Rita left The Voice after just one year and joined the ITV series although not everyone has been convinced by her new role.
Some have claimed that Rita only jumped ship for the cash with a deal reportedly worth £1.5 million, although that's something that Rita insists isn't true.
The new judge also blasted critics - including former X Factor winner Sam Bailey - who have said she was too inexperienced to be a judge having only released the one album.
Rita told Glamour magazine this month: “It’s not about thinking, 'Oh my God, I want to be on TV every Saturday night!' I’m a musician, I’ve built this bond with my team, with the music industry.
"I’ve worked hard to be involved with everything you see my name associated with.
"It doesn’t happen overnight, and I feel I have as much right to be on that panel as everyone does.”
Rita's pal Will.i.am has now jumped to her defence, telling Hello magazine: "Rita is great – I love her.
"The British public were a little harsh on her for jumping ship. I mean, it’s not that serious."
Rita will take her spot on The X Factor this year alongside fellow newbie Nick Grimshaw together with Simon Cowell and Cheryl Fernandez-Versini.
As for Will, he didn't say anything about his future on The Voice although it's expected he will be back alongside Sir Tom Jones, Ricky Wilson and possibly Kylie Minogue in the new year on BBC One.