Story had been appointed in 1886 as Chaplain in Ordinary to Queen Victoria, and was also Chaplain-in-Ordinary in Scotland to King Edward VII following Victoria's death. Story was appointed Honorary Chaplain to the Clyde Brigade of the Royal Naval Artillery Volunteers in 1896., and to the Royal Naval Volunteer Reserve in 1904.
