Hauge was also a hymn writer. He published Psalmer til Brug ved Missions-Sammenkomster in 1846 and 100 Missions-Psalmer in 1852. In 1863 he published Psalmebog til Kirke- og Huus-Andagt. This became a competitor of sorts of Magnus Brostrup Landstad's hymnals, and was officially released in 1874 as Psalmebog for Kirke og Hus. It was used by congregations until 1941, but Landstad's work prevailed in the long run.
