demo-ossbert-50k

This model is a fine-tuned version of google-bert/bert-base-multilingual-cased on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4372

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss
No log	0.0762	200	2.2789
No log	0.1524	400	2.0486
No log	0.2287	600	1.9096
No log	0.3049	800	1.8096
No log	0.3811	1000	1.7513
No log	0.4573	1200	1.6634
No log	0.5335	1400	1.5938
No log	0.6098	1600	1.5390
No log	0.6860	1800	1.5192
No log	0.7622	2000	1.4866
No log	0.8384	2200	1.4687
No log	0.9146	2400	1.4471
No log	0.9909	2600	1.4372

Framework versions

• Transformers 4.57.2
• Pytorch 2.9.0+cu126
• Datasets 4.0.0
• Tokenizers 0.22.1