FIELD NOTES TOPIC
error analysis
3 notes, newest first.
Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy
Researchers evaluate the ability of six multimodal large language models to understand scientific visualizations (SciVis) using a standardized test with 49 items based on various visualization techniques and tasks. The…
Reasoning effort, not tool access, buys first-try reliability in agentic code generation: an observational study
A study compared different agentic coding assistants and their abilities in building a real-time retrospective board. The results showed that the level of reasoning effort, rather than access to additional tools or…
When Does Combining Language Models Help? A Co-Failure Ceiling on Routing, Voting, and Mixture-of-Agents Across 67 Frontier Models
The text discusses multi-model language model systems and their potential to outperform single-models in terms of accuracy. The study shows that the gain is limited by a quantity called 'beta', which represents the…
