Hugging Face's logo

devmanpreet
/
Medical-GPT2-Classifier

medical
biology
research
pubmed
Model card Files
xet
Community
Medical-GPT2-Classifier / README.md
devmanpreet's picture
devmanpreet
Update README.md
c301d41 verified
preview code
|
raw
history blame contribute delete
995 Bytes
metadata
license: apache-2.0
datasets:
  - pietrolesci/pubmed-200k-rct
metrics:
  - accuracy
base_model:
  - openai-community/gpt2
tags:
  - medical
  - biology
  - research
  - pubmed
model-index:
  - name: MedGPT
    results: []
    demo:
      - name: Try in Space
        url: https://huggingface.co/spaces/devmanpreet/Medical-GPT2-Classifier

MedGPT — GPT-2 Fine-Tuned on PubMed RCT

MedGPT is a GPT-2 model fine-tuned on the pubmed-200k-rct dataset. It classifies individual sentences from biomedical abstracts into one of five standard sections:

  • Background
  • Objective
  • Methods
  • Results
  • Conclusion

This model is useful for tasks requiring structured understanding or summarization of scientific literature.

Training Details

  • Base Model: gpt2 (124M parameters)
  • Dataset: pietrolesci/pubmed-200k-rct
  • Task: Sentence classification
  • Labels: Background, Objective, Methods, Results, Conclusion
  • Epochs: 1 (partial training)
  • Loss Function: CrossEntropy
  • Optimizer: AdamW