Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

large language models

Fixie LogoUltravox v0.4

LLM
0.4vLLMH100 MIG 40GB

Meta logoLlama 3.1 8B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 70B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 405B Instruct

LLM
3.1InstructH100

audio transcription models

OpenAI logoWhisper V3 Turbo

Audio transcription
V3TurboA10G

OpenAI logoFaster Whisper Small

Audio transcription
FasterT4

OpenAI logoFaster Whisper V2

Audio transcription
v2FasterT4

OpenAI logoWhisper V3

Audio transcription
v3T4

OpenAI logoWhisper V2

Audio transcription
v2A10G

image generation models

ByteDance logoSDXL Lightning

Image generation
1.0LightningA100

Stability AI logoStable Diffusion 3 Medium

Image generation
3A100

Stability AI logoStable Diffusion XL

Image generation
XL 1.0A10G

black forest labs logoflux-dev

Image generation
devbloat16H100 MIG 40GB

black forest labs logoflux-schnell

Image generation
schnellbfloat16H100 MIG 40GB

Stability AI logoComfy UI

Image generation
A10G

text embeddings models

Nomic AI logoNomic Embed v1.5

Text embeddings
v1.5T4

Microsoft LogoAll MPNet Base V2

Text embeddings
v2CPU

Microsoft LogoAll MiniLM L6 v2

Text embeddings
v2CPU

Jina AI logoJina Embeddings V2 Base EN

Text embeddings
V2ENCPU

audio generation models

Meta logoAudioGen Medium

Audio generation
A10G

Meta logoMusicGen Melody

Audio generation
MelodyA10G

Meta logoMusicGen Large

Audio generation
MusicA10G

Meta models

Meta logoLlama 3.1 8B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 70B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 405B Instruct

LLM
3.1InstructH100

Meta logoLlama 3 8B Instruct

LLM
3InstructA100

Stability AI models

Stability AI logoStable Diffusion 3 Medium

Image generation
3A100

Stability AI logoStable Diffusion XL

Image generation
XL 1.0A10G

Stability AI logoComfy UI

Image generation
A10G

Stability AI logoStable Video Diffusion

Image to video
Video 1.0A10G

Stability AI logoSDXL ControlNet Canny

Image generation
XL 1.0ControlNet - CannyA10G

Stability AI logoSDXL ControlNet Depth

Image generation
XL 1.0ControlNet - DepthA10G

Mistral AI models

Mistral AI logoPixtral 12B

LLM
PixtralvLLMA100

Mistral AI logoMistral 7B Chat TRT-LLM

LLM
v1ChatTRT-LLMA100

Mistral AI logoMixtral 8x7B

LLM
v1ChatTRT-LLMA100

Mistral AI logoMistral 7B Instruct

LLM
v2ChatA10G

Mistral AI logoMistral 7B Chat

LLM
v1ChatA10G

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G