FIELD NOTES TOPIC
oncall rca
1 note, newest first.
ORCA-bench: How Ready Are Language Model Agents for Oncall?
The paper introduces ORCA-bench, a benchmark for testing the performance of large language models in oncall root cause analysis (RCA). The benchmark includes a live microservice system with six days of metrics, logs…
