FIELD NOTES TOPIC
attention models
1 note, newest first.
Invariant Learning Dynamics of Transformers in Inductive Reasoning Tasks
The authors present a theoretical framework explaining the development of inductive reasoning abilities in Transformer language models. This framework applies to a wide range of inductive tasks and provides insights…
