American porn actress Stormy is currently at the centre of controversy surrounding president Donald Trump.
She had been booked to appear on the show but pulled out hours before the series launched last week.
Speaking at the Edinburgh TV Festival, Channel 5's chief Ben Frow revealed his fury at what happened.
"We built a whole week around Stormy. I flew someone out to accompany her here. She disappeared on us," he said. "I was bloody furious actually, we built the White House and the whole God damn thing around her.
There was plenty of speculation over why Stormy didn't enter the house, and on Monday she gave her side of events.
During an interview on ITV's Loose Women, Stormy said her decision to back out was down to an ongoing custody battle involving her daughter.
"Being a mum comes first," Stormy said, "and I wanted to be able to talk to her with everything going on."
She explained how she had wanted to make a brief appearance in the house - for one day - to explain the decision.
"I thought it was a great way to salvage some of the show," she said. "I didn't want to let down the British fans."
Last Friday, appearing on Bit On The Side, Rylan gave Big Brother's version of what went down.
He said: "Big Brother was thrilled and excited for Stormy's potential for the house.
"But 5 hours before the live shows, Stormy informed us she wished to simply appear on launch night and leave. Big Brother tried to work out a fair compromise with her but for Big Brother, launch night is about moving into the house and not celebrities moving out."
Rylan denied claims that Stormy had asked for more money and also denied the suggestion that Big Brother had sort to "control" her.
"We had her, she changed her mind and she went.
"It wasn't how we wanted it to go but always remember no housemate is bigger than Big Brother," Rylan added.
Celebrity Big Brother continues nightly at 9PM on Channel 5.