Evicted CBB housemate Gillian Taylforth let slip on Monday that Rylan had been leaving the house for practice.
Blabbing on The Wright Stuff, the soap star claimed that the X Factor singer had left “every Sunday” to practice.
She revealed: “Rylan went out to do X Factor rehearsals… obviously he wasn’t allowed to talk about it, but when he came back he’d just ask somebody the time very quickly like [his] driver, and we said to him when he’d get in, ‘What’s the time?’”
In a statement read out on Monday night’s spin off show Bit On The Side, Channel 5 said: “It was agreed before Rylan entered the Big Brother house that he would be allowed to rehearse for his tour twice on-site with a choreographer.
“This was agreed on the strict understanding that he was not allowed to discuss events in the Big Brother house with anyone during such rehearsal periods.
“Rylan was escorted by a Big Brother producer at all times during rehearsal to ensure full compliance.”
And today Brian played down the viewer anger over the news, with many fans claiming it went against the whole idea of Big Brother.
"Contractually, before he entered the show he was told he could leave on two occasions with a chaperone and a choreographer to rehearse for the tour," Brian explained.
"As far as I'm aware he obviously didn't speak about anything BB. It's not really affected the reality - the housemates don't mind.
"Big Brother don't mind. It's not really affected Rylan's time in the house. I just don't really see it as a big deal. The show is not what it was on Channel 4."
The Celebrity Big Brother 2013 final airs tomorrow night on Channel 5.