As a rookie, Brown appeared in all 12 games for a Giants team that compiled a 3–9 record during the 1953 season. In October 1953, sports writer Earl Wright wrote of Brown: "He is built like a museum statue – slender hips and broad shoulders. But he is no statue on the field. He surprised the Giants by outrunning Arnie Weinmeister, New York's fleet defensive tackle, in windsprints." Brown also gained attention as a rookie for his style, wearing "fancy street clothing" and regularly sporting a mustache, derby hat and umbrella.
