This year's live shows saw Gary move between the girls, amid rumours that the two girls weren't getting on.
And whether it's due to Gary being in the way or the rumours are true, from what we've seen Nicole and Tulisa really don't seem to be best friends on the panel.
A spokesperson for the show told heat magazine: "It was Gary's decision to change seats. He enjoys the banter between Nicole and Tulisa."
But a source claimed that the move was actually a "production decision" due to the lightning requirements both the girls have!
Another supposed X Factor insider added to heat magazine: "Producers welcome the drama on the panel and are always looking at ways to switch things up. Moving Gary off the head judge's seat was definitely part of that."
A show insider recently told the Mail on Sunday that Tulisa ‘can’t stand’ Nicole and that the pair are ‘already rubbing each other up the wrong way’.
A supposed source added: “Tulisa thinks Nicole hogs the limelight, singing and getting to her feet during auditions. It really aggravates Tulisa. And Nicole fawns over Gary Barlow, getting really touchy feely with him at every opportunity.”
Nicole previously denied any such arguments, but did confess they did have an ‘awkward’ start.
“I think it took her a second to warm to me, because we didn’t know each other,” Nicole told The Sun. “When we got to sit down and share some wine together [we began to] talk and see each other as humans. [We told] each other about our backgrounds and stories and own lives [and then] we really related to one another.
“We’re both fighters and survivors. We’re tough cookies underneath it all. We just show it in different ways.”
One audience member in the studio during the earlier live shows told us previously: “The girls rarely spoke all night, it was clear that it was Team Nicole and Gary against Team Tulisa and Louis.”
[cat c="the x factor"]The X Factor 2012[/cat] live shows start at 8:20PM tonight on ITV1.
The third elimination will take place on Sunday night's live show, which will also feature performances from JLS and Labrinth.