Since 2012, Simon and fellow BGT original Amanda Holden have appeared alongside Alesha Dixon and David Walliams.
The quartet are so popular with viewers that they're still together eight series on - making them one of the longest-running judging panels on a modern TV talent contest.
David's involvement has even won him three National Television Awards for Best TV Judge.
Now they're so well-established that Simon no longer thinks it's worth questioning whether they'll return in the future.
"I actually think we’ve gone past that stage of even having those conversations, where they all think I make the decisions on who stays and goes," he commented. "I just think we’re all kind of stuck with each other now!
"They are all so easy to work with, everyone has different tastes. I think that’s good for a show like this because we’re all looking for something different."
Meanwhile, Amanda has vowed that she will "never voluntarily" quit BGT.
The actress is the only judge that's lasted throughout the ITV show's entire history (Simon sat out of the series five auditions).
"Simon’s already discussing next year and has said he wants us all back but you never know!" she said.
"I’d like to be back, I can’t ever imagine not doing it. When I do leave I want it to be on my terms.
"I’ll be like, ‘If you’re sacking me then give me a heads up and I’ll do a speech about giving up my chair for someone else!’.
"I’ll never voluntarily go, I love this show too much. I just think that for as long as it’s going I want to be a part of it."
All that said, it's not yet confirmed whether Britain's Got Talent will even be back on our screens next year.
ITV's current contract for the show expires in the coming months. While a renewal is highly likely, bosses are yet to make an official announcement.
Before then, there's a brand new series for fans to enjoy, kicking off this Saturday at 7.15pm on ITV.