It was reported recently that Estelle was amongst the stars rumoured to be in talks for this year's series of the show.
But sources close to Kelly claimed last week that she wanted back on the panel!
A source told The Sun: “She loved all the drama, even when it was pretty harsh against her. Kelly is a tough cookie and a few barbs from viewers or whoever is water off a duck’s back to her."
According to Star magazine, Kelly has been dropping hints to Estelle not to accept an offer to join the series.
"Estellle's name is high on Simon Cowell's list and enquiries have been made as to her availability for auditions in May," an insider told the publication.
The source added: "[Kelly] told her in no uncertain terms not to consider signing up."
Fortunately for Kelly, Simon Cowell yesterday gave her his backing, saying he wanted the show's panel to remain the same.
"My gut feeling is all four should come back," the music mogul told The Sun.
A spokesperson for The X Factor said recently: "No decisions have been made on this year’s judging panel.”
Auditions for The X Factor 2012 kicked off in Liverpool at the weekend, and will continue throughout this month. The show returns to TV in August.