Instruct: Identify the main category of Biorxiv papers based on the titles and abstracts
Query: Encoding innate ability through a genomic bottleneck AO_SCPLOWBSTRACTC_SCPLOWAnimals are born with extensive innate behavioral capabilities, which arise from neural circuits encoded in the genome. However, the information capacity of the genome is orders of magnitude smaller than that needed to specify the connectivity of an arbitrary brain circuit, indicating that the rules encoding circuit formation must fit through a "genomic bottleneck" as they pass from one generation to the next. Here we formulate the problem of innate behavioral capacity in the context of artificial neural networks in terms of lossy compression of the weight matrix. We find that several standard network architectures can be compressed by several orders of magnitude, yielding pre-training performance that can approach that of the fully-trained network. Interestingly, for complex but not for simple test problems, the genomic bottleneck algorithm also captures essential features of the circuit, leading to enhanced transfer learning to novel data sets. Our results suggest that compressing a neural circuit through the genomic bottleneck serves as a regularizer, enabling evolution to select simple circuits that can be readily adapted to important real-world tasks. The genomic bottleneck also suggests how innate priors can complement conventional approaches to learning in designing algorithms for artificial intelligence.
29
The categories of this paper are: education
11
The categories of this paper are: cognition
21
The categories of this paper are: toxicology
16
The categories of this paper are: microbiology
5
The categories of this paper are: cell
3
The categories of this paper are: evolutionary
27
The categories of this paper are: pathology
30
The categories of this paper are: scientific
12
The categories of this paper are: behavior
23
The categories of this paper are: immunology
6
The categories of this paper are: plant
24
The categories of this paper are: cancer
10
The categories of this paper are: and
19
The categories of this paper are: epidemiology
18
The categories of this paper are: systems
20
The categories of this paper are: pharmacology