Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

Deploy your own model

All LLM Transcription Text to speech Image generation Embedding

42 large language models

Model API

LLM

DeepSeek-V3

V3 - SGLang - B200

LLM

Qwen 3 4B

V3 - TRT-LLM - H100

LLM

Qwen 3 32B

V3 - TRT-LLM - H100

LLM

Qwen 3 235B

V3 - SGLang - H100

LLM

DeepSeek-R1

R1 - SGLang - B200

LLM

Llama 4 Scout

V4.0 - Instruct - vLLM - H100

LLM

Llama 4 Maverick

V4.0 - Instruct - vLLM - B200

LLM

Llama 3.3 Nemotron 49B Super - NVIDIA NIM

3.3 - Nemotron - H100

LLM

Mistral Small 3.1

3.1 - vLLM - H100

LLM

Gemma 3 27B IT

3 - Instruct - vLLM - H100

LLM

DeepSeek-R1 Llama 70B

R1 - Llama - TRT-LLM - H100

LLM

Llama 3.3 70B Instruct

3.3 - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 32B

R1 - Qwen - TRT-LLM - H100

LLM

Qwen 2.5 14B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 32B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 7B Math Instruct

2.5 - Math - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 8B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 32B QwQ

2.5 - QwQ - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 7B

R1 - Qwen - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 Nemotron 70B

3.1 - Nemotron - A100

LLM

Llama 3.1 405B Instruct

3.1 - Instruct - H100

LLM

Ultravox v0.4

0.4 - vLLM - H100 MIG 40GB

LLM

Llama 3.2 11B Vision Instruct

3.2 - Vision - A100

LLM

Llama 3.1 Nemotron Ultra 253B

3.1 - Nemotron - TRT-LLM - H100

LLM

Pixtral 12B

Pixtral - vLLM - H100

LLM

Qwen 2.5 72B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 72B Math Instruct

2.5 - Math - TRT-LLM - H100

LLM

Qwen 2.5 14B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 32B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 7B Coder Instruct

2.5 - Coder - TRT-LLM - H100 MIG 40GB

LLM

Qwen 2.5 7B Instruct

2.5 - TRT-LLM - H100 MIG 40GB

LLM

Mistral 7B Instruct

v3 - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 70B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 3B Instruct

2.5 - TRT-LLM - A10G

LLM

DeepSeek-R1 Zero

R1 - Zero - SGLang - H200

LLM

Llama 3.2 90B Vision Instruct

3.2 - Vision - H100

LLM

Phi 3.5 Mini Instruct

3.5 - 128k - vLLM - A10G

LLM

Phi 3 Mini 128K Instruct

3 - 128k - T4

LLM

Phi 3 Mini 4K Instruct

3 - 4k - T4

LLM

DeepSeek Prover V2 671B

V2 - Prover - SGLang

LLM

Mixtral 8x7B Instruct

v1 - TRT-LLM - H100

LLM

Mixtral 8x22B

H100

🔥 Trending models

LLM

Qwen 3 235B

V3 - SGLang - H100

Text to speech

Orpheus TTS

vLLM - H100 MIG 40GB

LLM

DeepSeek-R1

R1 - SGLang - B200

LLM

Llama 4 Maverick

V4.0 - Instruct - vLLM - B200

Explore Baseten today

Start deploying

Talk to an engineer