Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on plasticity loss
2 notes
Can Scale Save Us From Plasticity Loss in Large Language Models?
Researchers studied plasticity loss, a challenge in creating neural networks capable of continuous learning, in modern transformer-based language models (LLMs). They found evidence of plasticity loss across various…
Can Scale Save Us From Plasticity Loss in Large Language Models?
Researchers study plasticity loss in GPT-style transformer models trained on a multilingual continual learning problem. They find evidence of plasticity loss across different sizes of models and under stationary…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
