FIELD NOTES TOPIC
state-prediction separation
1 note, newest first.
The State-Prediction Separation Hypothesis
Researchers propose a new model for language modeling called 'state-prediction separation' which aims to improve efficiency by separating the prediction of the next token and the storage of useful state for future…
