FIELD NOTES TOPIC
pipeline parallelism
1 note, newest first.
Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets
The authors present a method to distribute Large Language Model (LLM) inference across multiple Intel AI PCs using pre-compiled pipeline shards. This allows for efficient use of idle AI PCs with integrated GPUs and…
