FIELD NOTES TOPIC
llm performance
2 notes, newest first.
MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use
Researchers introduce a new benchmark, MemTrapBench, to evaluate how the use of memory in large language models affects their reasoning and task performance. They identify two types of cognitive traps: Reasoning…
AI Assistants Overassist
Researchers introduce Int-Bench, a benchmark to evaluate AI language models (LLMs) as tutors or thought partners during problem-solving. The study reveals that LLMs intervene more frequently and earlier than humans…
