Scheffer was the younger brother of painter Ary Scheffer, son of Johann Baptist and Cornelia Scheffer and grandson of Arie Lamme. When his father died in 1809, his mother first moved to Brussels and in 1811 to Paris.
