FIELD NOTES TOPIC
transformer models
2 notes, newest first.
RETRIEVALFORMER: TRANSFORMER-QUALITY RECOMMENDATIONS WITH EFFICIENT ANN RETRIEVAL AND COLD-START RESILIENCE
The researchers propose RetrievalFormer, a transformer-based recommendation system that combines high accuracy with efficient Approximate Nearest Neighbor (ANN) retrieval. This system can recommend unseen items during…
Can Scale Save Us From Plasticity Loss in Large Language Models?
Researchers study plasticity loss in GPT-style transformer models trained on a multilingual continual learning problem. They find evidence of plasticity loss across different sizes of models and under stationary…
