Walker was known to be a fierce competitor in sport, business and life. He played golf off a handicap of four, was captain of West End Golf Club, Halifax and also made an honorary member of The Royal Perth Golf Club. He skied virtually every year in Kitzbühel from 1948 until he was 80 years old. He was known in Kitzbühel as "Halifax", some locals even assuming he was the Earl of Halifax.
