The morning series replaced GMTV but has never really taken off, with BBC's rival Breakfast easily winning more than twice as many viewers in the morning.
The series already gone through various presenters, from Christine Bleakley and Adrian Chiles to Dan Lobb and Kate Garraway.
Now the current hosts - Aled Jones and Lorraine Kelly - could be on their way out too.
According to the Daily Mirror, X Factor's Dermot is wanted to replace them, alongside former BBC Breakfast sports host Chris Hollins.
It follows reports that Sky News' Eamonn Holmes turned down a multi-million pound deal to take over.
An insider told the newspaper today: “The mission to hire new blood continues apace. Daybreak is a big problem.
“Chris would be ideal as he has bags of experience. Dermot may have no breakfast experience but he’s a favourite with ITV chiefs.”
A spokesperson for ITV commented: “Aled and Lorraine are fantastic and will be back in January.”