Former X Factor finalist Olly will join the rival singing competition as a coach from 2018.
He'll sit in the famous spinning red chairs alongside returning judges Jennifer Hudson, Will.i.am and Sir Tom Jones.
Olly, who previously hosted The X Factor in 2015 after finishing as runner up in 2009, says he's not heard from Simon since the news.
Olly told TV Times: "I have no idea if he’s happy or not.
"I’m so proud of what I did on my X Factor journey from the early days up to now."
Insisting there were no hard feelings from his side, Olly added: "He’s been a great part of my life and is still a great friend."
Meanwhile, speaking ahead of the blind auditions, Olly said his X Factor past will help him on The Voice panel.
He explained: "It helps me to be able to give the contestants my advice and they also know I have been through that experience and I can help and guide them with that.
"If they have any questions they want to ask I can help them.
"But when they get to the later stages of the competition it is really about picking the right songs and that is what I want to try and get across to them.
"I hope they have the confidence in me to help them with that but they also need to know themselves and find themselves as an artist.
"I definitely think that the experiences I have had doing reality TV shows will definitely help them and that I have had such a successful career coming from a reality TV show, not many people get that opportunity so I am very lucky that I am part of that group."
The Voice UK 2018 launches on Saturday, January 6 at 8PM on ITV.