The end of his life was marked by difficulties with the Conservative party, which placed pressure on bishop Édouard-Charles Fabre, since Labelle had become too liberal for the party's taste and had fought the ultramontanes. He wanted to go to Rome before he died, but he died on January 4, 1891, at 57 years of age.
