FIELD NOTES TOPIC
evaluation methodology
2 notes, newest first.
StructureClaw: Traceable LLM Agents and an Executable Benchmark for Structural Engineering Workflows
Researchers have developed StructureClaw, an artifact-centered workbench that uses LLM (Language Model) agents to operate through governed engineering skills and checks for completion, consistency, and execution of…
Institutional Red-Teaming: Deployment Rules, Not Just Models, Causally Shape Multi-Agent AI Safety
The paper introduces institutional red-teaming, a method for evaluating deployment rules in multi-agent AI. The study uses IABench-CA, a consequence-allocation benchmark, to test five canonical rules across seven model…
