Klein was born in Strasbourg, France, in 1827. He later studied at the Basel Mission Institute and then attended the Church Missionary Society College,Islington. He later received Anglican holy orders.
