FIELD NOTES TOPIC
rubric-based evaluators
1 note, newest first.
Graph-Structured Rubrics: Compiling Rubrics into Typed Evaluation Graphs for LLM Judges
The paper introduces Graph-Structured Rubrics (GSR), a method that converts rubrics into response-independent typed evaluation graphs before observing responses. This allows for more efficient and accurate scoring of…
