FIELD NOTES TOPIC
ai performance
3 notes, newest first.
A corpus-specific clinical RAG system matches or outperforms newer frontier LLMs on HealthBench
A research study compared the performance of VITA, a specialized clinical AI tool for low- and middle-income settings, with various frontier large language models (LLMs) on the HealthBench benchmark. The study found…
Do LLM-Generated Skills Make Better AI Data Scientists? A Component Ablation Across Data-Science Workflows
A study investigates if LLM (Language Model) generated skills improve the performance of AI data scientists in various tasks across four lifecycle stages: data preparation, data extraction, statistical analysis, and…
Reasoning effort, not tool access, buys first-try reliability in agentic code generation: an observational study
A study compared different agentic coding assistants and their abilities in building a real-time retrospective board. The results showed that the level of reasoning effort, rather than access to additional tools or…
