The Emery House is sited on a rise north of Main Street, on the western fringe of the town's central business district. It is a two-story wood-frame structure, with a cross-gable roof, clapboard siding, and a granite foundation. Its main facade is divided into three major sections. The leftmost section has a front-gable roof, with broad pilasters and a polygonal projecting bay on the first floor, topped by a balustrade, with a Gothic arched window in the gable above. The center section consists of a large square tower, its upper portion finished in diamond-cut shingles. Its corners are pilastered similarly to the left section, and the tower is topped by a turned balustrade. The right section of the house has a side-gable roof, with an engaged porch supported by Greek Revival columns. A tall dormer projects to the front, with a Gothic arched window. The house has two tall brick chimneys, each of which has a projecting course, and a crenellated top.
