FIELD NOTES TOPIC
sparse autoencoders
2 notes, newest first.
Multimodal Model Diffing for Feature Discovery and Control
Researchers introduce a framework called MMDiff to help identify, control, and audit the internal features of Multimodal Large Language Models (MLLMs). The framework is designed to isolate which features are altered by…
C$^{2}$R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders
The paper introduces C$^2$R, a method to improve Sparse Autoencoders (SAEs) used for interpreting large language models. The main challenge with SAEs is scaling to large dictionaries, which leads to issues like feature…
