Baillet-Latour was born in the Belgian branch of the family and was the son of Alfred, Count de Baillet-Latour (1823–1889). He had two sons: Henri de Baillet-Latour and Louis, Count de Baillet-Latour (1878–1953).
