The Always on Time star served 24 months behind bars on attempted criminal possession of a weapon and failure to file taxes charges, and his wife never missed a Sunday visit.

Promoting their new reality TV series Follow The Rules on Access Hollywood Live on Tuesday (27Oct15), Aisha admitted it was tough not to have her husband around at first, but the weekly trips to prison soon became routine.

She said, "I literally went to visit him almost every weekend and drove there and back, four-and-a-half hours (there) and four-and-a-half hours back every Sunday, holidays. It was football games on Saturday... and we'd go and visit dad on Sunday. That's what we did for two years."

Calling his wife his "rock", Ja Rule, real name Jeffrey Atkins said, "She held it down. When I went to the feds (federal prison), I just said, 'Listen, I'm good, I don't need you to drive all the way out here. I'm right next to Canada... You don't need to come up here'."

Aisha eventually agreed to stay away, leaving her man to finish his sentence away from her and his family.

"I did that whole four months and I didn't see my wife or family at all."

The rapper insists now he's served his time, he never wants to go back to prison, adding, "Prison is a terrible place. It's not the place you want to be in."

His jail time, which began in 2011, included a few days at New York's notorious Riker's Island.

"They got me in and out of there quick because they didn't want me to cause problems there," he said. "I knew a lot of people there and a lot of people knew me there and they didn't want to have any jail issues."