Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evolution Is All You Need: Phylogenetic Augmentation for Contrastive
  Learning   Self-supervised representation learning of biological sequence embeddings
alleviates computational resource constraints on downstream tasks while
circumventing expensive experimental label acquisition. However, existing
methods mostly borrow directly from large language models designed for NLP,
rather than with bioinformatics philosophies in mind. Recently, contrastive
mutual information maximization methods have achieved state-of-the-art
representations for ImageNet. In this perspective piece, we discuss how viewing
evolution as natural sequence augmentation and maximizing information across
phylogenetic "noisy channels" is a biologically and theoretically desirable
objective for pretraining encoders. We first provide a review of current
contrastive learning literature, then provide an illustrative example where we
show that contrastive learning using evolutionary augmentation can be used as a
representation learning objective which maximizes the mutual information
between biological sequences and their conserved function, and finally outline
rationale for this approach.

15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc