Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on model compression
2 notes
CoCaRS: Correlation Calibration-Based Redundancy Suppression for Heterogeneous Knowledge Distillation
The research introduces Correlation Calibration-based Redundancy Suppression (CoCaRS), a method for knowledge distillation in heterogeneous settings where teacher and student models have different architectures. The…
SLORR: Simple and Efficient In-Training Low-Rank Regularization
The paper introduces SLORR, a simple and efficient in-training low-rank regularization framework for neural networks. It aims to improve compressibility without significant accuracy loss, while avoiding the limitations…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
