  Standard evaluation metrics such as the Inception score and Fr\'echet Audio
Distance provide a general audio quality distance metric between the
synthesized audio and reference clean audio. However, the sensitivity of these
metrics to variations in the statistical parameters that define an audio
texture is not well studied. In this work, we provide a systematic study of the
sensitivity of some of the existing audio quality evaluation metrics to
parameter variations in audio textures. Furthermore, we also study three more
potentially parameter-sensitive metrics for audio texture synthesis, (a) a Gram
matrix based distance, (b) an Accumulated Gram metric using a summarized
version of the Gram matrices, and (c) a cochlear-model based statistical
features metric. These metrics use deep features that summarize the statistics
of any given audio texture, thus being inherently sensitive to variations in
the statistical parameters that define an audio texture. We study and evaluate
the sensitivity of existing standard metrics as well as Gram matrix and
cochlear-model based metrics to control-parameter variations in audio textures
across a wide range of texture and parameter types, and validate with
subjective evaluation. We find that each of the metrics is sensitive to
different sets of texture-parameter types. This is the first step towards
investigating objective metrics for assessing parameter sensitivity in audio
textures.
