  We develop a theory of anomalies of fermionic topological phases of matter in
(2+1)D with a general fermionic symmetry group $G_f$. In general, $G_f$ can be
a non-trivial central extension of the bosonic symmetry group $G_b$ by fermion
parity $(-1)^F$. We encounter four layers of obstructions to gauging the $G_f$
symmetry, which we dub the anomaly cascade: (i) An
$\mathcal{H}^1(G_b,\mathbb{Z}_{\bf T})$ obstruction to extending the symmetry
permutations on the anyons to the fermion parity gauged theory, (ii) An
$\mathcal{H}^2(G_b, \ker r)$ obstruction to extending the $G_b$ group structure
of the symmetry permutations to the fermion parity gauged theory, where $r$ is
a map that restricts symmetries of the fermion parity gauged theory to the
anyon theory, (iii) An $\mathcal{H}^3(G_b, \mathbb{Z}_2)$ obstruction to
extending the symmetry fractionalization class to the fermion parity gauged
theory, and (iv) the well-known $\mathcal{H}^4(G_b, U(1))$ obstruction to
developing a consistent theory of $G_b$ symmetry defects for the fermion parity
gauged theory. We describe how the $\mathcal{H}^2$ obstruction can be canceled
by anomaly inflow from a bulk (3+1)D symmetry-protected topological state (SPT)
and also its relation to the Arf invariant of spin structures on a torus. If
any anomaly in the above sequence is non-trivial, the subsequent ones become
relative anomalies. A number of conjectures regarding symmetry actions on
super-modular categories, guided by general expectations of anomalies in
physics, are also presented.
