sebae banner ad-300x250
sebae intro coupon 30 off
sebae banner 728x900
sebae banner 300x250

Supercharge LiteLLMs and vLLMs with Dynamic Routing Models

0 views
0%

Supercharge LiteLLMs and vLLMs with Dynamic Routing Models

In this demo, Alex Sin, Senior Solutions Software Engineer at Intel, shows how to use Intel® Xeon® CPUs and Intel® Gaudi® AI accelerators within OpenShift AI to deploy and run models with LiteLLM and vLLM.

Discover how dynamic model routing can improve performance, scalability, and cost-efficiency for your AI workloads.

Date: October 13, 2025