ITV confirmed earlier this month that alongside Simon Cowell, three new judges will join this year's series while Sharon Osbourne will act as a fifth judge for the live shows.
Both Nicole Scherzinger and Louis Walsh have quit the series, the channel confirmed.
Show bosses have described the change as 'the start of a new era' for the show, which will air its 15th series this year.
As yet, the names of the new judges have not been officially confirmed but rumour has it Robbie Williams could be one of them.
He's said to have been involved in "secret negotiations" and producers are hopeful he'll sign up.
Appearing on ITV's This Morning today, Robbie certainly didn't deny the rumours.
Although he also insisted that (at least as yet) he hadn't signed any contracts.
Robbie told hosts Holly Willoughby and Phillip Schofield: "If there is an X Factor in my future whether it be this year or next year or never, I am scared for my own safety and health."
He explained: "Not because of the people out there or the public or Twitter or Instagram, but my wife.
"She's a sort of Grade A+ student from Beverly Hills, incredibly square and is like, 'Why would you do that?'"
Robbie went on: "There's a lot of me that would love to do it too but there's nothing there.
"Me and Simon and Lauren and the kids and little Eric hang out an awful lot and talk about a lot of things.
"Nothing's signed but watch this space and I guarantee you will be the first people I speak to about it."
As for who else could join the show, former judge Dannii Minogue, plus current Britain's Got Talent Alesha Dixon and One Direction's Louis Tomlinson, have been rumoured.
Craig David, Kylie Minogue and Mariah Carey are also touted as potential new faces to the ITV show.
The X Factor 2018 will air on ITV later this year.