He was born in St-Cuthbert, Canada East, and educated at the college in L'Assomption. In 1879, he married Marie Noémi Bernier. He served as a major in the militia. Coulombe was an unsuccessful candidate for a seat in the House of Commons in 1884. His attempts at reelection in 1891 and 1896 were unsuccessful.
