FIELD NOTES TOPIC
interpretation
1 note, newest first.
The Transformer Revolution, Part 1: Dynamic Processing through Output- Weight Interconnections
The paper proposes a new interpretation of Transformers during inference, suggesting they construct prompt-dependent transformations whose parameters are generated during inference. This form of computation is named…
