FIELD NOTES TOPIC
contrastive synthetic document finetuning
1 note, newest first.
Measuring Reward-Seeking via Contrastive Belief Updates
Researchers have developed a method to measure 'reward-seeking' in language models trained with reinforcement learning. This behavior occurs when the model optimizes for the grader's judgment instead of the intended…
