Improve model card with paper link and pipeline tag

README.md

@@ -1,7 +1,9 @@
 ---
-license: mit
 library_name: transformers
+license: mit
+pipeline_tag: text-generation
 ---
+
 # DeepSeek-V3-0324
 <!-- markdownlint-disable first-line-h1 -->
 <!-- markdownlint-disable html -->
@@ -197,5 +199,15 @@ This repository and the model weights are licensed under the [MIT License](LICEN
 }
 ```
 
+## Paper title and link
+
+The model was presented in the paper [Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures](https://huggingface.co/papers/2505.09343).
+
+## Paper abstract
+
+The abstract of the paper is the following:
+
+The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained on 2,048 NVIDIA H800 GPUs, demonstrates how hardware-aware model co-design can effectively address these challenges, enabling cost-efficient training and inference at scale. This paper presents an in-depth analysis of the DeepSeek-V3/R1 model architecture and its AI infrastructure, highlighting key innovations such as Multi-head Latent Attention (MLA) for enhanced memory efficiency, Mixture of Experts (MoE) architectures for optimized computation-communication trade-offs, FP8 mixed-precision training to unlock the full potential of hardware capabilities, and a Multi-Plane Network Topology to minimize cluster-level network overhead. Building on the hardware bottlenecks encountered during DeepSeek-V3's development, we engage in a broader discussion with academic and industry peers on potential future hardware directions, including precise low-precision computation units, scale-up and scale-out convergence, and innovations in low-latency communication fabrics. These insights underscore the critical role of hardware and model co-design in meeting the escalating demands of AI workloads, offering a practical blueprint for innovation in next-generation AI systems.
+
 ## Contact
-If you have any questions, please raise an issue or contact us at [[email protected]]([email protected]).
+If you have any questions, please raise an issue or contact us at [[email protected]]([email protected]).