Ray J departed this year's January series a week into his stay, with no apparent explanation ever provided.
"There's not much I can say, and we might never know the ins and outs," Bit On The Side's Rylan Clark-Neal said at the time of Ray J's unexpected exit.
It's understood that Ray J had originally left the house for medical reasons concerning tooth pain but was unable to return.
"I don't even care about my tooth, put me back in the house and let me work," Ray J said at the time. “This isn't right. It's wrong bro, it's wrong.
"I'm going to drive myself to the dentist and get my tooth fixed and then pull back up to the house and try to get back in.”
Since then the rapper has been involved in a legal battle over his fee having originally signed a rumoured $1 million deal.
Ray J's rep David Weintraub told The Sun newspaper: “We are in a continued legal battle with them over the remaining payments that are owed to him. They owe him 250 thousand US dollars."
He added: “Our lawyers and their lawyers are trying to work out a settlement agreement.
“Without settling the case and an apology from the producers, he doesn’t want anything else to do with the show.”
A spokesperson for Channel 5 gave "no comment" to reports.
Celebrity Big Brother 2017 currently continues its summer series nightly on Channel 5.