Goldberg had a wife and two children. He was a member of the Elks, the freemasons, the Tammany Society, the Royal Arcanum, the Improved Order of Heptasophs, the Hebrew Sanitarium, the Bohemian-American Congregation, the Independent Order Brith Abraham, and the New York County Lawyers' Association. He was a grand marshal of the children's parade for the Hudson-Fulton Celebration.
