FIELD NOTES TOPIC

academic

3 notes, newest first.

  1. Benchmarking LLM Judges for Mobile Agent Evaluation

    Source note ·

    A benchmark study of LLM judges used to evaluate mobile-agent trajectories.

  2. MBA: Multimodal Benchmark and Agents for Real-World Business Ideation

    Source note ·

    A multimodal benchmark and training setup for agents that generate and evaluate business ideas using visual evidence.

  3. Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation

    Source note ·

    An evaluation study examining how token budgets affect model accuracy and comparative rankings.