Gipps was the second son of John Gipps (c.1620–1707) of Great Whelnetham, Suffolk, by his wife Mary Davidson (d. 1665), daughter of David Davidson, alderman of London, and was baptised at Great Whelnetham on 15 September 1659.
