Wrottesley was the only son of Hon Walter Bennet Wrottesley, 2nd son of Arthur Wrottesley, 3rd Baron Wrottesley, and his wife Kate May Harris, only daughter of Douglas Howard Harris, of Craddock, Cape Colony, South Africa. He was educated at Harrow.
