The hunky performer was working as a topless model for Abercrombie & Fitch, but his busy schedule for The X Factor meant he kept missing his shifts.
In a Q&A with fans on Twitter, one follower asked Scott if he was still working at the store.
He replied: “No, they fired me the other week. I was always too busy to go in.”
The 26-year-old added: “I wasn’t a fan of it anyway. All a bit too fake for me. Lovely people working
His fan replied: "You should have made it into a massive drama like, ‘Oh no you don’t, I quit,’ then stormed out. That sounds more like it.”
To which Scott joked: “I shall get them to re-hire me just so I can do that. Haa.”
Times Red will be seen singing for a spot in the live shows this weekend as they jet out to Las Vegas as part of the final seven groups.
The X Factor 2012 judges' houses air this weekend on Saturday and Sunday on ITV1.
Browse pictures of the X Factor groups at judges' houses below...