Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Look and Listen: A Multi-modality Late Fusion Approach to Scene
  Classification for Autonomous Machines   The novelty of this study consists in a multi-modality approach to scene
classification, where image and audio complement each other in a process of
deep late fusion. The approach is demonstrated on a difficult classification
problem, consisting of two synchronised and balanced datasets of 16,000 data
objects, encompassing 4.4 hours of video of 8 environments with varying degrees
of similarity. We first extract video frames and accompanying audio at one
second intervals. The image and the audio datasets are first classified
independently, using a fine-tuned VGG16 and an evolutionary optimised deep
neural network, with accuracies of 89.27% and 93.72%, respectively. This is
followed by late fusion of the two neural networks to enable a higher order
function, leading to accuracy of 96.81% in this multi-modality classifier with
synchronised video frames and audio clips. The tertiary neural network
implemented for late fusion outperforms classical state-of-the-art classifiers
by around 3% when the two primary networks are considered as feature
generators. We show that situations where a single-modality may be confused by
anomalous data points are now corrected through an emerging higher order
integration. Prominent examples include a water feature in a city misclassified
as a river by the audio classifier alone and a densely crowded street
misclassified as a forest by the image classifier alone. Both are examples
which are correctly classified by our multi-modality approach.

12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th