Cheeky chappie Olly Murs has revealed he has been anything but cheerful recently after a "difficult" break up with his long-term girlfriend. The X Factor presenter told the Loose Women panel that he had had a "couple of difficult weeks" following his break-up and spoke of his frustration over rumours that his boss Simon Cowell has been trying to set him up with his co-host Caroline Flack.

Olly MursOlly Murs admitted that it had been a "difficult" time in the wake of his break up

The 31-year-old singer said: "I’m so cross with him. It’s so silly. I’ve obviously gone through a break up with my girlfriend which has been quite sad and it’s been quite a difficult couple of weeks.

"So I’ll be having words with Simon about that."

MORE: An Already Seasoned Girlband And Record Low Ratings: The X Factor Is Back

Olly continued: "Me and Caroline have always said in interview we’ve never been together, we’re just really good mates.

"Simon is always trying to stir it up, but we’re just great friends."

Olly Murs and Caroline FlackSimon Cowell has been trying to set up his X Factor co-presenters

Olly has recently spilt up from his three-year relationship with property manager Francesca Thomas.

Unfortunately, things aren’t going too much better at work as The X Factor suffered a ratings beating in its first head-to-head with BBC One’s Strictly Come Dancing on Saturday night.

MORE: Olly Murs Gives Rita Ora His Vote For The X Factor

Despite the show’s new judges, Nick Grimshaw and Rita Ora, it has still struggled to pull in the viewers and rumours have been circulating that ex-panellist Louis Walsh has been drafted in to try to boost numbers.