Duffield's grandfather, George Duffield II, had been Chaplain of the Continental Congress. Born July 4, 1794, in Strasburg, Pennsylvania, to a second George Duffield and his wife Faithful Slaymaker (a younger sister of Amos Slaymaker). He was the father of William Ward Duffield, Henry M. Duffield, and George Duffield V.
