Ely was platted in June 1872 by T.M. Johnson. The town is named after John F. Ely, who was one of the pioneers of Linn county, a prominent railroad builder in the early days and one of the officers and stockholders of the Burlington, Cedar Rapids and Northern Railway.
