FIELD NOTES TOPIC
ai metrics
1 note, newest first.
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
The paper introduces Litmus, a system that generates evaluation metrics for AI pipelines by understanding the intent from source code and targeted questions. The system was tested on three real-world AI pipelines and…
