Hugging Face's logo

piboo
/
PiBoo

Text Generation
Safetensors
Korean
ingredient
chatbot
review
usage
Model card Files
xet
Community
PiBoo / README.md
mmmsss11's picture
mmmsss11
README update
57cefee verified
preview code
|
raw
history blame contribute delete
991 Bytes
metadata
language:
  - ko
base_model:
  - EleutherAI/polyglot-ko-1.3b
pipeline_tag: text-generation
tags:
  - ingredient
  - chatbot
  - review
  - usage
license: apache-2.0

🐥 Base Model

EleutherAI/polyglot-ko-1.3b

This model is based on the Korean version of Polyglot-1.3B, an open-source language model released by EleutherAI.
It is pre-trained on a large-scale Korean corpus and designed for general-purpose Korean language understanding and generation tasks.

Training Procedure

Training Hyperparameters

The following hyperparameters were used during training:

  • output_dir: ./qlora_model_eleutherai
  • per_device_train_batch_size: 2
  • gradient_accumulation_steps: 4
  • total_batch_size: 8 (2 x 4)
  • learning_rate: 2e-5
  • num_train_epochs: 2
  • fp16: True
  • logging_dir: ./logs
  • logging_steps: 5
  • save_steps: 100
  • save_total_limit: 1
  • load_best_model_at_end: True
  • metric_for_best_model: loss