In the 13th century the Braose family were Lords of Gower and held the castle as part of their extensive land holdings and titles, including other castles on Gower and in the Welsh Marches. The de Braose dynasty could afford to rebuild Oystermouth castle in stone. A high curtain wall was built, internal buildings added, a chapel, basements, three storey residential buildings with fireplaces and garderobes on each floor. The castle had every residential feature necessary for living in some comfort and was also refortified cleverly. Towards the end of the century Oystermouth rather than Swansea Castle became their principal residence. Edward I paid a brief visit here in December 1284.
