← Research ReadingRL methods for language models: what the RLxx names refer to and which results hold up
RL methods for language models: what the RLxx names refer to and which results hold up
Do a survey of the state of the art in various RL methods being experimented to improve language models. RLHF and RLVR are known, but Jev uses RLCD and in the process I started seeing a variety of RLxx algorithms. They seem to describe the shape of the data that the reward is being derived off. What are people up to and what has been working?