FIELD NOTES TOPIC
cross-sample consistency regularization
1 note, newest first.
C$^{2}$R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders
The paper introduces C$^2$R, a method to improve Sparse Autoencoders (SAEs) used for interpreting large language models. The main challenge with SAEs is scaling to large dictionaries, which leads to issues like feature…
