Neumann's family moved to Kreutzburg (then in Russian Empire) during Wilhelm's childhood. When he was 15 years old, he worked as an apprentice at Paul Max Bertschy's engineering office during the construction of the Riga–Dünaburg Railway. After this he studied at the Riga Polytechnicum, and beginning 1875 at the Imperial Academy of Arts in Saint Petersburg.
