This evening saw Brendan and celeb partner Charlotte Hawkins dancing the Tango to Danger Zone from Top Gun.
In the comments, Shirley complained about the rise and fall in the routine but Brendan claimed she was "wrong".
Bruno Tonioli also got involved, telling Brendan: "I think Shirley is right and I feel you should be more respectful."
But Brendan stood firm on his view and vowed to watch the performance back to check.
When it came to the scores, Craig Revel Horwood gave a 4, Darcey Busell a 5, Shirley a 4 and Bruno a 4 for a total of 17.
It was a low score but up 5 marks on last weekend's 'dance disaster'.
In last Saturday evening's second live show, the couple danced the Cha Cha to Sugar by Maroon 5.
The judges didn't hold back with their criticisms and the pair ended with just 12 marks, but managed to avoid the dance off thanks to the viewer vote.
Speaking on It Takes Two in the week, Brendan had his say as Zoe Ball quizzed him on the judges' comments.
Last weekend, Shirley had suggested Brendan could have made the routine easier but he hit back: "I think she could keep those opinions to herself.
"That was a very simple routine, it was a classic, cha cha. It was basic choreography, I put in two difficult steps..."
Brendan, a judge on the New Zealand version of the show Dancing with the Stars, remarked: "If Shirley wants to swap places with me I'm quite happy to judge her, I know how to do that."
He went on to tell host Zoe: "It disappoints me because as the pros you almost can't do the right thing. If you give too much, it's too much, if you give too little, it's not enough. She did say in the opening show, 'I want to be excited, I've seen everything, show me something I haven't seen before', now it's 'you made it too hard'.
"It's frustrating, but I don't worry about them, I'm focused on us."
Strictly Come Dancing 2017 airs Saturday and Sunday nights on BBC One.