FIELD NOTES TOPIC
bidirectional optimization
1 note, newest first.
Scaling Linear Mode Connectivity and Merging to Billion Parameter Pretrained Transformers
The authors propose a method for scaling Linear Mode Connectivity (LMC) to allow the merging of billion-parameter pretrained transformers, improving interpolation performance. The approach involves optimizing weight…
