Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on data preprocessing
2 notes
DataOrchestra: Learning to Orchestrate Per-Example Curation of Pretraining Data
Researchers propose a framework called DataOrchestra that adapts data processing strategies for each example in Large Language Models (LLMs) pretraining, improving performance across 11 benchmarks.
Data Selection Through Iterative Self-Filtering for Vision-Language Settings
Researchers propose a new method to select data for training neural networks in large scale, noisy datasets. The Self-Filtering method iteratively trains a CLIP model on an evolving dataset, balancing clean samples and…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
