Question: at the end of section 5.2 right above "Summary of this section", should the equation of the optimal reward function be
?
i.e I think there's an extra Z(x) in the first log term.
Steven Ma
mabobbi
AI & ML interests
None yet
Recent Activity
commented on
an
article
about 1 month ago
Navigating the RLHF Landscape: From Policy Gradients to PPO, GAE, and DPO for LLM Alignment
Organizations
None yet
commented on
Navigating the RLHF Landscape: From Policy Gradients to PPO, GAE, and DPO for LLM Alignment
about 1 month ago