FIELD NOTES TOPIC
web-scale content injection
1 note, newest first.
Pretraining Data Can Be Poisoned through Computational Propaganda
The research discusses the potential for malicious content to be injected into large-scale pretraining datasets used for training language models (LMs). The authors propose a novel analysis method, HalfLife, to…
