The others are former internationals Seidath Tchomogo (Benin) and Hellings Mwakasungula (Malawi).
While the four were handed life bans, a former Kenyan international George Owino Audi was handed a 10-year-ban for attempting to manipulate an international match.
FIFA did not however give details of the matches in question.
“This large-scale investigation was conducted by FIFA over several years through its Integrity Department and in cooperation with the relevant stakeholders and authorities,” a statement from the organization said.
“The decisions were notified to the individuals concerned today (Wednesday 24 April), the date on which the relevant bans come into force.”
Kargbo, who represented Sierra Leone from 2000-2013, has previously been accused of match-fixing by the football associations of Sierra Leone and the Netherlands, where he played for Willem II in 2009. He however denied the charges on both occasions.
It is unclear if his case is linked to a long-standing investigation into potential match-fixing involving Sierra Leone during a World Cup qualifier in 2008.