Prior to his NBA honors he was member of the 1984 Olympic Basketball team coached by Bobby Knight. Klein, along with University of Arkansas teammate Alvin Robertson, lead the team to a gold medal. Prior to that he won a silver medal playing for the U.S. national team in the 1982 FIBA World Championship.