A fortified town that withstood many sieges in the Middle Ages , Uzerche later became a favorite of proserous families who built manor houses on the steep slopes .
Many wealthy families built mansions on the cliffs at Uzerche .