However, Thomas's elder brother's lifestyle and academic pursuits had exhausted the family's fortunes and they had fallen into debt. In 1888, to rescue the reputation of the family and the home where he had grown up, Thomas paid off his brother's debts and took over Carlowrie Castle. Isobel Wylie Hutchison was the first of his children to be born there on 30 May 1889. Two further children were born at the castle, and Carlowrie remained with this branch of the Hutchison family until Isobel's death and subsequent sale of the property in 1982.
