Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,8 @@ license: other
|
|
| 5 |
---
|
| 6 |
# AIDO.Protein-16B
|
| 7 |
|
|
|
|
|
|
|
| 8 |
AIDO.Protein-16B is a protein language model, trained on 1.2 trillion amino acids sourced from UniRef90 and ColabFoldDB.
|
| 9 |
|
| 10 |
By leveraging MoE layers, AIDO.Protein efficiently scales to 16 billion parameters, delivering exceptional performance across a vast variety of tasks in protein sequence understanding and sequence generation. Remarkably, AIDO.Protein demonstrates exceptional capability despite being trained solely on single protein sequences. Across over 280 DMS protein fitness prediction tasks, our model outperforms previous state-of-the-art protein sequence models without MSA and achieves 99% of the performance of models that utilize MSA, highlighting the strength of its learned representations.
|
|
|
|
| 5 |
---
|
| 6 |
# AIDO.Protein-16B
|
| 7 |
|
| 8 |
+
[](https://github.com/genbio-ai/ModelGenerator/blob/main/LICENSE)
|
| 9 |
+
|
| 10 |
AIDO.Protein-16B is a protein language model, trained on 1.2 trillion amino acids sourced from UniRef90 and ColabFoldDB.
|
| 11 |
|
| 12 |
By leveraging MoE layers, AIDO.Protein efficiently scales to 16 billion parameters, delivering exceptional performance across a vast variety of tasks in protein sequence understanding and sequence generation. Remarkably, AIDO.Protein demonstrates exceptional capability despite being trained solely on single protein sequences. Across over 280 DMS protein fitness prediction tasks, our model outperforms previous state-of-the-art protein sequence models without MSA and achieves 99% of the performance of models that utilize MSA, highlighting the strength of its learned representations.
|