The rapper hadn't featured in updates from the house yesterday (Tuesday) and the official Big Brother website revealed in the evening that he had "left".
A spokesperson for Channel 5 confirmed that Ray J departed the series but did not revealed why he had gone, saying that details about Ray's exit would be revealed in Bit On The Side.
However host Rylan Clark-Neal only said on the spn-off show: "Ray J has left the Celebrity Big Brother house. I know, it’s sad, it’s sad.”
Since then, a story by website TMZ has claimed that Ray J was taken from the house to hospital because of "extreme tooth pain".
Why did Ray J leave Celebrity Big Brother?
The article reported: "[...] a dentist came to the set, gave Ray 8 painkillers, 4 of which he was to take immediately and the remaining 4 the next morning.
"Ray woke up Tuesday in unbearable pain, took the remaining 4 pills and then pleaded for help. We're told producers agreed to take him to the hospital but on the way out of the house he blacked out."
Later, Ray J spoke up himself, accusing show bosses of 'ignoring' his pain.
"I’ve been complaining about my tooth for 3 and half a days," he said, "It got to the point where me and some of the housemates felt Like was I being ignored...
"We took petitions to say we wouldn’t do any more tasks until Ray J gets his tooth fixed."
Ray J says he eventually blacked out and was taken to hospital, where a quick treatment saw him bounce right back.
"I end up in the hospital, 45 minutes and I’m cool, I'm feeling fine and ready to go back in the house and they won let me back in," he alleges in a chat with TMZ. "I'm really hurt by it because it sucks because I was having such a good time."
Ray J said it was "really sad" to not be allowed back and branded the decision "unfair".
Rylan appeared on ITV's This Morning today but didn't have a lot more to say.
He responded to Ray's claims by saying: "I'm sure that's not the full case..."
But couldn't give more details about why Ray J left Celebrity Big Brother
"There's not much I can say, and we might never know the ins and outs," he added.
In tonight's show, Ray J is seen leaving but no explanation is given as to why.
Celebrity Big Brother 2017 continues nightly on Channel 5.