FIELD NOTES TOPIC
key-value stores
1 note, newest first.
SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling
The paper 'SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling' presents a new approach to scheduling Language Model (LLM) requests for AI agents, rather than humans. The…
