The current Voice judge has taken a few swipes at the rival ITV series in the past but in a new interview confesses to "really liking" the Simon Cowell show.
It comes after rumours circulated that he could be set to dramatically follow in the footsteps of Rita Ora and swap one show for the other later this year.
“Maybe I shouldn’t say this but I really like The X Factor," said Ricky. "I watch all the shows on TV. I really enjoy X Factor, I used to go and sit in the audience to see it.
“And I really enjoyed myself. People expect me to say, ‘I don’t like it and I don’t think it’s any good’ but it’s a bit of fun isn’t it?"
Chatting to the Daily Star on Sunday, he added: “I don’t see a rivalry. I just enjoy myself like a normal person.”
Drawn on which of the two singing contests was the better one, Ricky replied: “[The X Factor] different. But it is hard to say it is better.
“It’s like saying do you want a car or a boat.”
Ricky's set to leave The Voice UK when it moves to ITV next year but there's been suggestions that he may end up on The X Factor.
Confirming this will be his final series in the famous spinning red chairs, Ricky said previously: “I have been very happy at the BBC, so it’s not a snub to ITV or the show.
"It feels like a good time to move on. I’ve done everything I thought I could do.”
But while he may be leaving The Voice UK, Ricky has said he really wants to do more work on TV.
He told BANG! Showbiz recently: "I hope I do more TV stuff.
"I did 'The Voice' and 'Bring The Noise' on Sky. I am very humbled by the fact people let me do these things."