A native of Awana, a place near Baghdad, Ibn Baqiyya belonged to a low-class family. Because of this, he would later get suspected by his opponents in helping low-class statesman to prominent posts. He first appears during conquest of Abbasid Iraq by Buyid ruler Mu'izz al-Dawla. He soon rapidly rose to higher posts, and by 973 managed to become the vizier of Mu'izz al-Dawla's son and successor, Izz al-Dawla (r. 967–978). However, hostiles slowly arose between Izz al-Dawla and his cousin Adud al-Dawla, who ruled in Fars and Kerman. Ibn Baqiyya, who knew of the strong power which Adud al-Dawla possessed, sought to gain his favor.
