FIELD NOTES TOPIC
modality comparison
1 note, newest first.
What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)
The study examines the limitations of current AI benchmarks by focusing on factors such as modality (chat UI vs API), search capabilities, consistency of responses, citation grounding, and abstention behavior using…
