Converse Hall is located on the east side of the UVM campus, in an area that was somewhat isolated when the hall was built, but is now dominated by the University of Vermont Medical Center to the north. The hall is a U-shaped structure stories in height, with the opening of the U facing west toward the central campus area. Its exterior is finished in Vermont marble, with sash windows set singly and in pairs in plain rectangular openings. Each wing of the U has projecting sections near the center, which give their roof lines a cruciform appearance. The gable ends are decorated with finials and turrets, and the roofs are dotted with attic and wall dormers that have similarly styled gables.
