The device was installed to repair a defective aortic valve in 1997. Thursday’s operation lasted several hours, TMZ website reports.
Schwarzenegger is said to be recovering well and reportedly commented after waking from surgery: “I’m back.”
His spokesman, Daniel Ketchell, said that Schwarzenegger was “in good spirits”.
Responding to the news, Austria’s Chancellor Sebastian Kurz wished his “friend” well in a tweet, adding: “I look forward to seeing you again.”
Schwarzenegger is best known as the hardman of cult movies such as the Terminator and Conan the Barbarian.
He served two terms as California governor from 2003 to 2011 before returning to acting in The Expendables.
In May last year, Schwarzenegger was honoured in France with the Chevalier de la Legion d’Honneur, the country’s most prestigious medal, for his environmental work.