The 'Boardwalk Empire' star was seen with the singer - who split from husband Pete Wentz in February after almost three years of marriage - three times in a week, and admitted at the Emmy Awards on Sunday (18.09.11) that their burgeoning romance is going well.
Asked if he is enjoying his free time away from the drama series with Ashlee, he said: "Yeah, having a great time. Just wrapped season two, so I'm starting to enjoy the hiatus."
The actor also admitted he doesn't mind the public scrutiny of his relationship, describing the interest as an "occupational hazard".
Quizzed on the interest their relationship, he told Hollyscoop: "It's been ... whatever, I guess it's an occupational hazard."
As well enjoying his romance with Ashlee - who has three-year-old son Bronx Mowgli with Pete - Vincent is loving his work as criminal mastermind Lucky Luciano in 'Boardwalk Empire'.
He said: "I think it's a great metaphor for what we are coming out of. It's a real period of prosperity ...also there is such great sense of humour, a lot of times I see a period piece and it's hard to assess it.
"The writers deal with such wit and find levity in these situations, that I think it makes it fun."