6 Mistral models

Mistral AI logoMixtral 8x22B

text generation
A100

Mistral AI logoMistral 7B Chat TRT-LLM

text generation
v1ChatTRT-LLMA100

Mistral AI logoMixtral 8x7B

text generation
v1ChatTRT-LLMA100

Mistral AI logoMistral 7B Instruct

text generation
v2ChatA10G

Hugging Face logoZephyr 7B Alpha

text generation
AlphaA10G

Mistral AI logoMistral 7B Chat

text generation
v1ChatA10G

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten πŸ‘‹ πŸ‘½

INFO

πŸš€ Uploading model to Baseten πŸš€

Upload progress: 0% | | 0.00G/2.39G