FIELD NOTES TOPIC
large language models evaluation
2 notes, newest first.
Evaluating Investment Logic in Large Language Models: A Real-World Benchmark Towards Personalzied Financial Agents
The paper introduces InvestLogicBench, a new benchmark to evaluate the investment logic of large language models (LLMs). The benchmark focuses on personalized financial decision-making and uses real-world data from 151…
Automated grading of Linux/bash examinations using large language models: a four-level cognitive taxonomy approach
The paper evaluates if four large language models can accurately grade Linux/bash command responses in a way that approximates expert judgment. The authors use a four-level cognitive taxonomy to test the models on real…
