His father was Charles-André de La Jaille (1796–1882), son of the marquis François Charles de La Jaille (1774–1801) and a cavalry lieutenant in the king's bodyguard of the company of the Duke of Wagram.
