The former X Factor finalist took over from Dermot O'Leary on last year's show alongside Caroline Flack.
However they didn't exactly have an easy ride.
From fluffed lines to THAT mess up involving Monica Michael, the pair were replaced by Dermot this year.
Speaking to this week's Heat, Olly revealed: "Part of me really wanted to go back for a second year, as I felt like me and Caroline has a lot more to offer.
"It was our first year and we were finding our feet.”
Olly went on to tell the magazine that after leaving The X Factor, he decided to focus on his music and put TV work to one side for now.
He said: "I had a great time, but I only ever signed up for a year. Everyone wants to find out what happened, but I just got to the end of my contract and went away to reevaluate what was important.
"And music was more important to me than anything else."
To that end, Olly will release his new studio album 24 Hrs next month.