The singer has reportedly been approached to join the panel this year after appearing as a guest judge on last year's series.
We're a tad surprised as Rita's stint as guest judge wasn't exactly the best, with more people talking about her tan disaster than anything else.
Speaking to the Daily Mirror however, Rita said: “There were talks.
“But if I were to take on that role it would have to be at a point when I could give it my full attention.
“I have so much to accomplish first and it’s kind of a full-time job being on X Factor.
"It’s not like a nine to five. It’s constant, for months.”
But Rita did say she would not say "never" to a role on The X Factor in future.
“Not that I have anything against it,” she added. “I love it but if I was to take on a full-time role it would be at a point when I’m loads of albums in.
“Being a guest is easier – you can say, ‘Yes’, to people and not have to mentor them.”
The X Factor 2013 returns in the summer and it's widely speculated that both Gary Barlow and Tulisa will be gone.
As well as Rita, Sharon Osbourne and Cheryl Cole have both been touted as possible replacements.