Gaur was born in the village Chitta near Bulandshahr in present Uttar Pradesh. His father was an agricultural inspector in the British government and worked as a serviceman in Beej Godam, Pakki sarai at Anupshahr. He completed his secondary education from LDAV Inter college Anupshahr. After graduating as a civil engineer from the University of Roorkee, he worked as junior engineer in the Uttar Pradesh state irrigation department, but was suspended from the department on charges of corruption.
