In progress ...
In the meantime, see
- LLM Training: RLHF and Its Alternatives, https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives
- Tips for LLM Pretraining and Evaluating Reward Models, https://sebastianraschka.com/blog/2024/research-papers-in-march-2024.html