The area was formerly known as Bluff Point. A property owned by a medical practitioner became known as “Doctors Rocks”, and this is believed to be the source of the name. Doctors Rocks was gazetted as a locality in 1966.
