DPO Alpaca Setpember/Alpaca_GPT2M_DPSGD_epi_01 Updated Mar 31 Setpember/Alpaca_GPT2M_DPSGD_epi_05 Updated Mar 30 Setpember/Alpaca_GPT2M_DPSGD_epi_1 Updated Mar 30 Setpember/Alpaca_GPT2M_DPSGD_epi_2 Updated Mar 30
PPO Jon Setpember/Jon_reward_stage1_epi_2 0.1B • Updated Nov 20, 2024 • 3 Setpember/Jon_ppo_stage1_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 3 Setpember/Jon_reward_stage2_epi_2 0.1B • Updated Nov 20, 2024 • 3 Setpember/Jon_ppo_stage2_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 3
MIMIC MIMIC Bert and Llama Setpember/bert-small_lora_r128_epsilon10 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon5 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon2 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon1 Updated Mar 24 • 3
DPO HH Setpember/pythia-1b-helpful-sft Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_point1 Text Generation • 1B • Updated Nov 26, 2024 • 3 Setpember/HH_pythia_DPO_props_epi_point5 Text Generation • 1B • Updated Nov 26, 2024 • 2 Setpember/HH_pythia_DPO_props_epi_1 Text Generation • 1B • Updated Nov 26, 2024 • 4
DPO Alpaca Setpember/Alpaca_GPT2M_DPSGD_epi_01 Updated Mar 31 Setpember/Alpaca_GPT2M_DPSGD_epi_05 Updated Mar 30 Setpember/Alpaca_GPT2M_DPSGD_epi_1 Updated Mar 30 Setpember/Alpaca_GPT2M_DPSGD_epi_2 Updated Mar 30
DPO HH Setpember/pythia-1b-helpful-sft Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_point1 Text Generation • 1B • Updated Nov 26, 2024 • 3 Setpember/HH_pythia_DPO_props_epi_point5 Text Generation • 1B • Updated Nov 26, 2024 • 2 Setpember/HH_pythia_DPO_props_epi_1 Text Generation • 1B • Updated Nov 26, 2024 • 4
PPO Jon Setpember/Jon_reward_stage1_epi_2 0.1B • Updated Nov 20, 2024 • 3 Setpember/Jon_ppo_stage1_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 3 Setpember/Jon_reward_stage2_epi_2 0.1B • Updated Nov 20, 2024 • 3 Setpember/Jon_ppo_stage2_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 3
MIMIC MIMIC Bert and Llama Setpember/bert-small_lora_r128_epsilon10 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon5 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon2 Updated Mar 25 • 2 Setpember/bert-small_lora_r128_epsilon1 Updated Mar 24 • 3
