Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
3 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on computational efficiency
3 notes
Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
The researchers present a study to make knowledge distillation training efficient for small language models deployed under tight constraints. They propose two methods: offline knowledge distillation (caching teacher's…
Fast Multi-dimensional Refusal Subspaces via RFM-AGOP
A new method called Fast Multi-dimensional Refusal Subspaces via RFM-AGOP is proposed for extracting complex behaviors, such as the refusal to answer harmful queries, from Large Language Models (LLMs). This method…
Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC
Researchers compare Simulation-Based Inference (SBI) with Markov chain Monte Carlo (MCMC) methods for Bayesian calibration of a mechanistic epidemiological model using COVID-19 ICU occupancy data from Germany in 2020…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
