  Vision-language (VL) pretrained models have achieved impressive performance
on multimodal reasoning and zero-shot recognition tasks. Many of these VL
models are pretrained on unlabeled image and caption pairs from the internet.
In this paper, we study whether representations of primitive concepts--such as
colors, shapes, or the attributes of object parts--emerge automatically within
these pretrained VL models. We propose a two-step framework, Compositional
Concept Mapping (CompMap), to investigate this. CompMap first asks a VL model
to generate primitive concept activations with text prompts, and then learns to
construct a composition model that maps the primitive concept activations (e.g.
the likelihood of black tail or red wing) to composite concepts (e.g. a
red-winged blackbird). We show that a composition model can be reliably learn
from ground truth primitive concepts. We thus hypothesize that if primitive
concepts indeed emerge in a VL pretrained model, its primitive concept
activations can be used to learn a composition model similar to the one
designed by experts. We propose a quantitative metric to measure the degree of
similarity, and refer to the metric as the interpretability metric. We also
measure the classification accuracy when using the primitive concept
activations and the learned composition model to predict the composite
concepts, and refer to it as the usefulness metric. Our study reveals that
state-of-the-art VL pretrained models learn primitive concepts that are highly
useful for fine-grained visual recognition on the CUB dataset, and
compositional generalization tasks on the MIT-States dataset. However, we
observe that the learned composition models have low interpretability in our
qualitative analyses. Our results reveal the limitations of existing VL models,
and the necessity of pretraining objectives that encourage the acquisition of
primitive concepts.
