Given Marvel's recent success with Guardians of the Galaxy, a string of release date announcements and Robert Downey Jr's recent publicity jaunt, it probably comes as a both a surprise and disappointment that - according to Tony Stark himself - the studio has no plans for Iron Man 4.

Iron Man 3Robert Downey Jr shooting 'Iron Man 4'

In a new interview with Variety, the actor shot down speculation of a fourth outing for Marvel's most bankable character. 

"There isn't one in the pipe," Downey said. "No, there's no plan for a fourth 'Iron Man.'"

More: Robert Downey Jr calls for 'Black Widow' movie with Scarlett Johansson

More: 'Avengers: Age of Ultron' wraps up filming - what does Joss Whedon do now?

Downey Jr has been on the publicity trail for his new comedy-drama The Judge and he seems to becoming comfortable working outside of the superhero bubble. Despite signing on for two Avengers sequel, Downey Jr has been reluctant to commit to superhero fare after that. 

Robert Downey JrRobert Downey Jr [L] and Robert Duvall [R] in 'The Judge'

When asked if he would be prepared to pass on the baton to another actor, Downey laughed off the idea. 

"I like that the idea is that it would be up to me, like I'm casting director for Marvel," he said.

More: 'The Judge' opens Toronto Film Festival

Sitting in on the same interview his Judge co-star Robert Duvall advised, "Don't give it to anybody else," before Downey Jr joked about the possibility of The Judge becoming a trilogy. Alluding to his co-star's involvement in the first two Godfather movies, the actor said, "Maybe it'll be trilogy, like that other series he was in.I heard two of those were good."

Marvel's first Avengers sequel Age of Ultron opens on May 1, 2015. It features the original cast and director, Joss Whedon. 

Watch 'The Judge' trailer: