Inference Engineering is now available. Get your copy here
changelog / post

Deploy vLLM models with our OpenAI Bridge

Go back

Our OpenAI Bridge is now compatible with vLLM models out of the box!

Deploy your vLLM model with Truss and let the docs guide you to an easy integration using the OpenAI completions SDK.