Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
5 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on dataset
5 notes
Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training
The preprint introduces 50,228 error-diagnosis pairs from 9,961 tasks across 33 environments, 19 harness families, and 23 policy models. Its Agentic Error-to-Training pipeline preserves traces and execution metadata…
OmniaBench: Benchmarking General AI Agents Across Diverse Scenarios
A research paper titled 'OmniaBench' introduces a new benchmark for evaluating the capabilities of general AI agents across various scenarios, using diverse tasks drawn from app stores, product documents, industry…
A Multimodal Dataset for Large Language Model Applications in the Energy Domain
This paper introduces a new open-access dataset called mAIEnergy, which is designed to support the development of Large Language Models (LLMs) in the energy sector. The dataset contains various types of data including…
JL1-CC&QA: Extending the JL1-CD Benchmark with Change Captioning and Question Answering
Researchers introduce JL1-CC&QA, a new benchmark for remote sensing that extends the JL1-CD dataset with two annotation layers: change captioning (CC) and change question answering (QA). The benchmark includes 5,000…
Reliable Evaluation of MRI Motion Correction: Dataset and Insights
The paper discusses the difficulty in evaluating methods for correcting motion artifacts in medical imaging due to the lack of ground-truth data. To address this issue, they introduce PMoC3D, a dataset of real-world…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
