FIELD NOTES TOPIC
conversational agent benchmarking
1 note, newest first.
Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents
The authors present a new framework to evaluate the quality of benchmarks used to test conversational agents. The framework uses language models (LLMs) as judges to assess the consistency, complexity, and policy…
