Instruct: Identify the main category of Biorxiv papers based on the titles and abstracts
Query: The Geometry of Representational Drift in Natural and Artificial Neural Networks Neurons in sensory areas encode/represent stimuli. Surprisingly, recent studies have suggested that, even during persistent performance, these representations are not stable and change over the course of days and weeks. We examine stimulus representations from fluorescence recordings across hundreds of neurons in the visual cortex using in vivo two-photon calcium imaging and we corroborate previous studies finding that such representations change as experimental trials are repeated across days. This phenomenon has been termed "representational drift". In this study we geometrically characterize the properties of representational drift in the primary visual cortex of mice in two open datasets from the Allen Institute and propose a potential mechanism behind such drift. We observe representational drift both for passively presented stimuli, as well as for stimuli which are behaviorally relevant. Across experiments, the drift most often occurs along directions that have the most variance, leading to a significant turnover in the neurons used for a given representation. Interestingly, despite this significant change due to drift, linear classifiers trained to distinguish neuronal representations show little to no degradation in performance across days. The features we observe in the neural data are similar to properties of artificial neural networks where representations are updated by continual learning in the presence of dropout, i.e. a random masking of nodes/weights, but not other types of noise. Therefore, we conclude that a potential reason for the representational drift in biological networks is driven by an underlying dropout-like noise while continuously learning and that such a mechanism may be computational advantageous for the brain in the same way it is for artificial neural networks, e.g. preventing overfitting.
28
The categories of this paper are: communication
25
The categories of this paper are: bioengineering
3
The categories of this paper are: evolutionary
31
The categories of this paper are: paleontology
18
The categories of this paper are: systems
23
The categories of this paper are: immunology
16
The categories of this paper are: microbiology
1
The categories of this paper are: bioinformatics
8
The categories of this paper are: genomics
14
The categories of this paper are: biophysics
32
The categories of this paper are: zoology
17
The categories of this paper are: molecular
22
The categories of this paper are: physiology
21
The categories of this paper are: toxicology
24
The categories of this paper are: cancer
27
The categories of this paper are: pathology