vLLM Semantic Router

vLLM Semantic Router develops an open, programmable decision layer for models and compute. Its Decision 2.0 models answer structured questions with probabilities.

Visit vLLM Semantic Router

Explore the models on Hugging Face