  Gaussian mixture models with eigen-decomposed covariance structures make up
the most popular family of mixture models for clustering and classification,
i.e., the Gaussian parsimonious clustering models (GPCM). Although the GPCM
family has been used for almost 20 years, selecting the best member of the
family in a given situation remains a troublesome problem. Likelihood ratio
tests are developed to tackle this problems. These likelihood ratio tests use
the heteroscedastic model under the alternative hypothesis but provide much
more flexibility and real-world applicability than previous approaches that
compare the homoscedastic Gaussian mixture versus the heteroscedastic one.
Along the way, a novel maximum likelihood estimation procedure is developed for
two members of the GPCM family. Simulations show that the $\chi^2$ reference
distribution gives reasonable approximation for the LR statistics only when the
sample size is considerable and when the mixture components are well separated;
accordingly, following Lo (2008), a parametric bootstrap is adopted.
Furthermore, by generalizing the idea of Greselin and Punzo (2013) to the
clustering context, a closed testing procedure, having the defined likelihood
ratio tests as local tests, is introduced to assess a unique model in the
general family. The advantages of this likelihood ratio testing procedure are
illustrated via an application to the well-known Iris data set.
