Dufour was born in Kingston, Jamaica, to Charles Sr and Mavis; he grew up in Rollington Town, Greater Kingston, and received primary education at Holy Rosary Preparatory before advancing to St Mary's College in Above Rocks, St Catherine. His studies for the Priesthood took place at the then-Seminary of St Michael, Kingston, as well as in England at the now-closed St Joseph's College, Upholland, Lancashire.
