FIELD NOTES TOPIC
gpu optimization
1 note, newest first.
Ready Cohorts: Bounding GPU Opportunity and Avoiding Host Round Trips in LLM-Agent Control
The research focuses on optimizing the use of GPUs in LLM-agent services by identifying a boundary for concurrent work (ready cohort) and investigating the impact of keeping GPU-computed decisions on device instead of…
