sebae banner ad-300x250
sebae intro coupon 30 off
sebae banner 728x900
sebae banner 300x250

[vLLM Office Hours #32] Intelligent Inference Scheduling with vLLM and llm-d – September 11, 2025

0 views
0%

[vLLM Office Hours #32] Intelligent Inference Scheduling with vLLM and llm-d - September 11, 2025

Join us for our next vLLM Office Hours on September 11, 2025, at 2:00pm EST! These bi-weekly sessions are your chance to stay up to date on the latest in the vLLM ecosystem, ask questions, and hear directly from contributors and power users.

This week’s special topic: Intelligent Inference Scheduling with vLLM and llm-d

We’ll start with our bi-weekly vLLM project update by Michael Goin. After that, join Abdullah Gharaibeh from Google and Nili Guy from IBM as they dig into:

1. Why we need llm-optimized scheduling
2. IGW architecture and characteristics
3. Benchmarks and SLO-aware scheduling results

Want to join our discussion live on Google Meet? Get a calendar invite by filling out this form: https://red.ht/office-hours

Date: September 9, 2025