Simmons returned to the Giants in 1976 as second announcer behind Michaels, then was the lead announcer again in 1977 and 1978, teaming with San Francisco native Joe Angel. When KSFO lost the Giants radio rights to rival KNBR in 1979, Simmons and Angel were replaced by Lindsey Nelson and Hank Greenwald. Three years later in 1981, KSFO acquired the Oakland Athletics' radio rights. Simmons then became an A's announcer, along with longtime Oakland Raiders and San Francisco/Golden State Warriors voice Bill King and youngster Wayne Hagin. Simmons remained part of the A's radio team through the 1995 season. From 1996 to 2002, he called Giants games part-time on KNBR. With the 49ers, he remained as play-by-play announcer through the 1980 season. In 1981, KSFO lost the 49ers radio rights to KCBS, who replaced him with its own sports director, longtime Stanford University play-by-play announcer Don Klein.
