Posh Spice turned down Mel B's invite to join her and the other girls at her judges' houses stage later this year.
Mel had planned to fly Victoria, Geri Halliwell, Mel C and Emma Bunton out to Cancun in Mexico next month to whittle down the acts in her category for the live shows.
The Sun reports that Victoria has already said no but we're not sure why only she is getting the flack as it's not clear yet whether the other girls can even take part either.
“All the Spice Girls have been approached to join Mel, as she thinks it would be great to have a reunion on the show," a show source told the newspaper this morning.
They added: “But Mel is realistic that it’s a long way to travel and the other girls have commitments.
“Victoria has already indicated she won’t be able to do it but Mel hopes at least one of the others will help her out.”
Louis Walsh will kick off filming for the next stage later this week as he's joined by former X Factor judge Tulisa in Bermuda.
Simon Cowell will head to Las Vegas - reportedly with both Paula Abdul and Sinitta - while Cheryl will be in the south of France, with Will.i.am and Sia tipped to be her guest mentors.
The X Factor starts on ITV at the end of the month.