Former X Factor finalist Christopher Maloney reckons that Caroline Flack and Olly Murs cost the show its credibility.
Christopher, who made the final of the 2012 series, suggested that the pair ruined the show when they took over as presenters.
And he also accused them of 'taking the piss' out of acts when they were fronting the Xtra Factor on his year as well.
"I think when Olly and Caroline did it, it lost credibility - it was more jokey, it was more of a piss take out of the acts," Chris told Digital Spy.
He explained: "They took the piss out of everyone - Rylan, James Arthur - it got to the point it lost credibility and it reflected on the main show.
"In my opinion, that's why it lost a lot of viewers. Now they've brought it back to basics, and the spin-off show has Rylan and Matt Edmondson - I think it's much better."
And it's not just Caroline and Olly that Christopher has complaints about.
He went on: "When I was on the show, Nicole [Scherzinger] looked after Jahmene [Douglas] and James really, really well.
"And Gary [Barlow] had my back all the way through it. They were involved with us, but I don't think the previous judges were that much."
Earlier this year Christopher got into a bit of a feud with current X Factor judge Louis Walsh.
It started when Christopher took aim at Louis' return, saying: "I'm looking forward to [The X Factor] but I'm a bit miffed that Louis has come back. He's a non-entity on the show but they've brought him back."
Rylan decided to try and stir up a bit of trouble by repeating Christopher's comments to Louis on the Xtra Factor.
"I dont' know who he is? Who is he?!" replied Louis initially.
After Rylan reminded Louis of just who Christopher was, the Irishman quipped: "Oh, the karaoke singer with all the make up!"