Sunday evening it was the turn of the Boys at the Six Chair Challenge and Anthony Russell's performance won over mentor Louis Walsh.
Singing at Wembley Arena in pre-recorded scenes last night, Anthony performed Joe Cocker's You Are So Beautiful.
Louis gave Anthony a seat and said: "You're a rough diamond and we have to polish that."
However it was previously revealed that Anthony had subsequently withdrawn from the competition for "personal reasons".
A spokesperson for the X Factor revealed in a statement: "Earlier this month, due to personal reasons, Anthony withdrew from the show.
"We are sad to see him go and wish him all the best for the future."
It's now been confirmed that Sam Black is back to replace Anthony - despite not even making the six chair challenge.
Sam had been eliminated from the show at bootcamp, after which he proposed to his girlfriend on stage.
Boy's mentor Louis Walsh said: "Anthony has been fantastic across the series, a great singer and performer who we are really sad to see go.
"I had to think for a long time who could take the place.
"Sam had a great reaction from the British public when his audition aired. So I re-watched it and realised we missed a trick not putting him through at Boot Camp.
"He has that retro 60s style viewers will love. He's really likeable and talented and I can’t wait to hear more."
Sam will join the rest of the Boys in Louis' top six at judges' houses next weekend.
The X Factor airs Saturday and Sunday nights on ITV.