The 23-year-old performer from Essex sung a medley of Toxic by Britney Spears, Horny by Mousse T and Poison by mentor Nicole Scherzinger for this evening's Halloween themed show.
Nicole Scherzinger told him: "For me, that was my favourite performance so far, you did a beautiful job you had fun and you let go."
Gary Barlow commented: "Rylan, I've realised that I've not given you an honest critique yet. It wasn't any worse than last week. The music was so loud, I couldn't hear you sing, that was a good thing. I liked the dancers."
Speaking on the Xtra Factor, Rylan reckons that he's slowly winning over the Take That star.
"I'm loving life, Gary's had a lot to drink tonight, he's been quite alright to me tonight," he said.
But when Rylan opened a special birthday present from Gary on the ITV2 spin-off show, it seemed that his hopes were dashed as he unwrapped a Singing for Dummies book.
But an optimistic Rylan quipped: "If I get through to next week, this might help me right out!"
Vote for your X Factor favourite below...
The latest results show airs on Sunday night, which will feature performances from Fun. and Robbie Williams, as well as one more act being given the boot.