After ratings for the most recent series, which ended on Sunday, fell by almost 1.7 million viewers, bosses are keen to revamp the show once again.
This year saw two new judges in the form of German Olympic skater Katarina Witt and choreographer Louie Spence, but after the ratings decline they could be axed.
Speaking to the Daily Mail, a source warned: "Most viewers hadn’t heard of [Katarina], despite her being a brilliant skater. The panel needs celebrity back. Dannii would deliver that."
But Dannii - who left The X Factor last year - recently ruled out returning to the UK for any length of time after settling in Australia with her family.
The newspaper reports that former Strictly judge Arlene Phillips is also on the cards, as long as she doesn't rejoin the BBC One show this autumn!