The house remained within the Greynville or Grenville family for several generations. According to surviving documents, it was occupied by several members of the family including William de Grenville and his wife Lucy in 1322, Nicholas de Grenville in 1332, and latterly John de Grenville and his wife Margaret from 1338. In 1341, John de Grenville's daughter Alice married the first Sir Humphrey Stafford, later sheriff of Dorset and Somerset under Henry IV. Upon John's death in around 1349, Sir Humphrey acquired the house and land, and he and his wife lived at Southwick Court for the next several years.
