The model, who appeared on the original celebrity series of the ITV show back in 2005 and 2006, made a cameo in the revamped ITV2 show last year.
But it doesn't sound as though we can expect him to return this summer.
Speaking to Digital Spy about making another comeback, Calum said: "Ten years later people still associate me with Love Island, but with all due respect, I think times have changed."
He explained: "When I did that show it was glamorous, we were in Fiji, we were going on beautiful dates, and now it's like who can hop into bed the quickest to stay on the show."
Calum, who is about to appear in new US reality show Famously Single, added: "It's changed its tone a bit.
"But it's an experience they will never forget."
Love Island continues nightly on ITV2 at 9PM.