Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on transformer models
2 notes
RETRIEVALFORMER: TRANSFORMER-QUALITY RECOMMENDATIONS WITH EFFICIENT ANN RETRIEVAL AND COLD-START RESILIENCE
The researchers propose RetrievalFormer, a transformer-based recommendation system that combines high accuracy with efficient Approximate Nearest Neighbor (ANN) retrieval. This system can recommend unseen items during…
Can Scale Save Us From Plasticity Loss in Large Language Models?
Researchers study plasticity loss in GPT-style transformer models trained on a multilingual continual learning problem. They find evidence of plasticity loss across different sizes of models and under stationary…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
