The 40-year-old television presenter took her own life in February this year, and Olly - who was close friends with Caroline - has now said her passing still ''hurts every day''.
He confessed: ''For Caz not to be here anymore is hard, it's difficult.
''I am still struggling.
''It hurts every day thinking about what she must have gone through.''
Olly, 36, said there's now a ''massive hole'' in his life without Caroline, and admitted he ''looks forward'' to the day when he'll ''see her again''.
Speaking on Vicky Pattison's 'The Lighter Side of Life' podcast, he said: ''It's mad losing someone you care about.
''There is a massive hole in my life without Caz in it. I think about her most days.
''I miss those moments of crazy stories - we would have the most random conversations about the most random things.
''I am going to miss that forever.
''It breaks my heart what happened. I love her.
''I know I will see her again at some point so I look forward to that day.''
The 'Troublemaker' singer has previously opened up on Caroline's passing, as back in March he said he was trying to make ''sense'' of the tragic news.
After 'Loose Women' presenter Andrea McLean shared her condolences, a visibly emotional Olly said on the ITV show: ''It's been tough, even you saying them words it doesn't really make sense to me yet - I'm still really coming to terms with it. It was a massive shock, I was on holiday at the time.
''The last couple of weeks has been ... it's so hard to even talk about it, to be honest.''
Olly said he hasn't turned to counselling in order to cope with the tragedy, but he has looked towards his close friends and family since Caroline's death was announced.
He confessed: ''It's been tough. I never thought I'd never see her again. I love her to bits and I'm going to miss her.''
Live music returned to Dreamland in Margate in spectacular fashion as Sports Team brought their 'Bus Trip All-Dayer' back to the seaside town for the...
Wolf Alice are nominated for the third time and Arlo Parks is an unsurprising first-time nominee.
Well before they enjoyed meteoric success with 'The Black Parade', My Chemical Romance started their musical journey with another concept album, 'I...
Willow Smith and more rocked a buzzcut for so many reasons.
Normani and Cardi B dispense with the need to maintain any resemblance of social distancing as they get up-close and personal in the video their...
'Diamond Life', released on the 16th July 1984, is not only a significant album in it's own right, it's a cultural touchstone and a near perfect...
The resurrection of punk presents an exciting year for music.