Breitenbeck was born in Detroit, Michigan, one of seven children of Matthew Joseph and Mary Agnes (née Quinlan) Breitenbeck; the father lost his job during the Great Depression. Two of Joseph's brothers also entered the priesthood. After graduating from Holy Redeemer High School, he began studying pre-law at the University of Detroit in 1932. However, he abandoned his ambitions for a legal career after a priest suggested he consider the priesthood.
