Hieronymus was brought up in a strict religious household, and since his health did not allow him to pursue a military career, he was educated at the Theresianum Academy in Vienna, and studied philosophy at the University of Vienna and theology at the Collegium Germanicum et Hungaricum in Rome. One of his brothers was the Austrian general Wenzel Joseph von Colloredo.
