FIELD NOTES TOPIC

evaluation of ai models

2 notes, newest first.

  1. StructureClaw: Traceable LLM Agents and an Executable Benchmark for Structural Engineering Workflows

    Source note ·

    Researchers have developed StructureClaw, a workbench that allows large language model (LLM) agents to operate within a structured engineering environment through governed skills, typed tools, shared artifact state…

  2. NuclearQAv2: A Structured Benchmark for Evaluating Domain-Science Competence in Large Language Models

    Source note ·

    Researchers have created a new benchmark called NuclearQAv2 to evaluate the performance of large language models (LLMs) in the domain of nuclear engineering. The benchmark consists of approximately 1,240…