The X Factor contestants are said to have left neighbours at their London mansion angry.
As always, this year's finalists in the live shows have been residing together in a home near to the studios.
But with over 30 contestants living there at the start, the noise has led to complaints from upset neighbours.
Locals have apparently made objections about the constant singing - and late night noise.
"There were 36 contestants when the live shows first started this year – you can imagine excitement levels were running high," a source told The Sun newspaper. “But living on the same road as the X Factor house isn’t something any of the neighbours have asked for and they’ve quickly grown sick of the noise from rehearsals that last all day and well into the night."
The insider also claimed acts were causing noise by "having parties, socialising and using the indoor pool until the early hours."
“Complaints have been coming in from those that live closest to the house; residents have not been impressed,” they added.
As well as the acts, The X Factor judges themselves have been getting involved with the fun at the house.
Dalton Harris revealed how mentor Louis Tomlinson would often pop round to have fun with the acts.
He said last week: "I don't see how he could be any more involved than he is. He has been sitting with us for hours and hours and hours, I think he left the house at almost midnight last night.
“Louis is that guy. He is all hands on deck.”
Now just 12 acts are left in the competition.
Those in Robbie Williams' groups category are duo Acacia and Aaliyah, Misunderstood and boy band United Vibe, while Simon Cowell's Girls category remains full - made up of Bella Penfold, Molly Scott, Scarlett Lee, and Shan Ako.
In the Boys category alongside Dalton are Anthony Russell and Brendan Murray while Ayda Williams leads The Overs, now made up of just Danny Tetley and Giovanni Spano.
The X Factor is back on ITV this Saturday night at 8:35PM and continues with the third results show at 8:30PM on Sunday.