After completing his Islamic education in 1967, Ali began his career as a teacher at the Barishkhali High School and Pardakhalpur K. B. Academy in Harinakunda, Jhenaidah for two and a half years. He then joined the Abudharr Ghifari College in Malibagh serving under Dewan Mohammad Azraf for 10 months. After that, he returned to his former school, the Qabilnagar Madrasa, where he served as principal for a short while.
