In the park are three medieval arches moved from elsewhere in the city, both of which are listed at Grade II. St Mary's Arch with its wing walls dates from around the 13th century and formerly stood in St Mary's Benedictine Nunnery. The Old Shipgate Arch formerly stood to the west of the Bridgegate and was taken down in 1831. The third archway was removed from St Michael's Church. Also in the park and listed at Grade II is Jacob's Well Drinking Fountain consisting of a small stone arch with a drinking fountain for people and a dish for their pets, which is now dry. During the laying out of the park a long line of Roman earthenware water pipes was discovered close to the lodge which used to bring fresh water from Boughton to the Roman fortress. In the 1950s a rockery was constructed on the southern edge of the park with waterfalls, streams and fountains. The main gates of the park, together with other gate piers and sections of the park walls, all designed by John Douglas, are listed at Grade II.
