sycophancy
3 notes, newest first.
Beyond Sycophancy: Structured Resistance and Compliance in LLM Moral Reasoning
Researchers Wang and Koch propose a framework to improve large language models' ability to make independent moral judgments instead of just following others. They identify three dimensions that structure how models…
MemSyco-Bench: Benchmarking Sycophancy in Agent Memory
The authors propose MemSyco-Bench, a new benchmark to evaluate how memory affects decision-making in language models (LLMs) used in AI agents. The benchmark aims to assess if the agents can handle issues of sycophancy…
MemSyco-Bench: Benchmarking Sycophancy in Agent Memory
Researchers have proposed a new benchmark called MemSyco-Bench to evaluate how memory in large language models (LLMs) can lead to sycophancy, where agents over-align with the user at the cost of factual accuracy or…
