Pipeline parallelism (PP) is rarely picked for prefill because of its pipeline bubbles.
We think agentic serving changes that. On @MiniMax_AI MiniMax-M3.1-Flash with @vllm_project on two NVIDIA B300s, PP2 sustained 23% more requests per GPU than DEP2 and 17% more than TP2 at a 2 s p50 TTFT target.
1/5
Building the future of inference through @vllm_project


