In the latest highlights show - this evening at 9PM on Channel 5 - Gary first clashes with David McIntosh before James later brands him a "prick".
The latest row starts after Gary confronts David and James about them constantly interrupting him when he tries to speak.
James explains that he and David also find it challenging when he tells them to 'Shh' and points in their face.
The Strictly dancer puts this down to cultural differences but tells Gary: "Just because you're 70 does not mean you cannot be educated by someone younger."
Later on, Dee, Kellie and Lauren talk to Gary about the problems he is having with the ‘alpha-males’ of the house and Kellie tells him: "You’ve seen more of life than they have.'
The former boxing promoter goes on to predict that the alpha-males will eventually turn on each other.
Meanwhile, James tells the Housemates that although he finds Gary ‘fascinating’ he still thinks he’s a pr**k.’
Stephanie says that she thinks that Gary hears more than he lets on.
George adds: "He’s in here as himself and he’s playing five characters."
Celebrity Big Brother 2014 airs tonight from 9PM on Channel 5.
Browse pictures of tonight's show below...