Mel Allen was impressed enough with Desmond that he asked him to come to New York City as his sidekick on the home games of the Yankees and Giants in 1942. After one year, he left and joined Red Barber on the Dodgers broadcasts, replacing Al Helfer. During the 1943 season, Barber and Desmond were the only voices of baseball in New York; the Giants and Yankees suspended broadcasts that year for unknown reasons. Desmond remained with the Dodgers until he resigned in August 1956, teaming with Barber (1943–1953), Ernie Harwell (1948–1949), and Vin Scully (1950–1956). In the 1940s Desmond also teamed with Barber to call college football and New York Giants football, and with Marty Glickman to call college basketball and New York Knicks basketball.
