X Factor bosses may replace Dermot O'Leary with Xtra Factor's Olly Murs and Caroline Flack next year.
The current contract between ITV1 and Simon Cowell's Syco ends after next summer's 2013 run, and declining ratings could spell the end of the show.
Next year will apparently see a big shake up of the series in a last ditch attempt to win back viewers.
Last Saturday's live show set a record for the lowest rated performance show this series, with less than eight million viewers tuning in.
A supposed "senior show source" told the Daily Mail today: "We’re battling to save The X Factor right now. If it keeps going like this, ITV might not even want to renew the show after next year."
The newspaper reports that next year's shake up will likely see another refresh of the panel, and maybe even new hosts.
Xtra Factor hosts Olly Murs and Caroline Flack could be promoted to the main show, replacing Dermot O'Leary, who has been fronting the series since 2007.
This year saw The X Factor USA completly axe its host from the audition stages, bringing in a female and male duo to front the live stages which started last week.
The X Factor continues with its live shows this weekend with a Best Of British theme.
Sunday's results show will feature performances from One Direction and Little Mix, as well as one more act being given the boot.