FIELD NOTES TOPIC
code-driven
1 note, newest first.
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
The paper presents Litmus, a system that creates evaluation metrics for AI pipelines by understanding the purpose of the code and asking questions about it. It was tested on three real AI pipelines and outperformed…
