X Factor boss Simon Cowell is planning crisis talks for the show next month, to decide just how to get viewers back.
The music mogul will first have to figure just which stars stay on the panel and who goes.
Apparently no one is safe, with even Louis Walsh potentially getting axed from the show.
Speaking at the NTAs this week, Tulisa said she wanted to be back but was being left in the dark.
“I always like to be back because I love the show," the singer admitted. “But nobody knows within the X Factor scene which judges are going to be on the panel each year until two months before the show starts."
But it's widely claimed that neither Tulisa nor Gary Barlow will be back, with Simon still after Cheryl Cole to make a return.
Changes could also see a return to the old 'hotel room' style auditions, with the live audience only becoming part of the show from the bootcamp stages.
“There are a series of meetings taking place. All the Brits are coming in, all the Americans, and we’re gonna make some decisions then. We’re going to mix it up,” Simon said.
Speaking at the launch of Britain's Got Talent in London last weekend, he added: “You’ve just got to try to make a better show than you did the year before. And if you do that, there’s a good chance you can get the numbers up.”
One thing for sure is that Simon won't be back.
He told us at BGT: “It’s all to do with timing, it would be impossible to do the English show and American show together.
“If the schedule was different then of course I would come back and do the English show, I miss it.”
And we miss you too, Simon!