Fricker was born in Ealing, London, England and studied composition with R. O. Morris, organ with Ernest Bullock and piano with Henry Wilson at the Royal College of Music. After serving in the Royal Air Force during World War II, Fricker undertook a period of study with Mátyás Seiber at Morley College. During the war he served in the Royal Air Force as a radio operator and in 1943 he married (Audrey) Helen Clench, a Czech pianist who had been with him at the RCM. After the war Fricker became a professor of composition at the RCM, and in 1952 he became director of music at Morley College, where he succeeded Michael Tippett.
