16 text generation models

Meta logoLlama 3 70B Instruct

text generation
3InstructH100

Meta logoLlama 3 8B Instruct

text generation
3InstructA100

Mistral AI logoMixtral 8x22B

text generation
A100

Meta logoLlama 3 8B Instruct TRT-LLM

text generation
3InstructTRT-LLMA100

Mistral AI logoMistral 7B Chat TRT-LLM

text generation
v1ChatTRT-LLMA100

Mistral AI logoMixtral 8x7B

text generation
v1ChatTRT-LLMA100

Mistral AI logoMistral 7B Instruct

text generation
v2ChatA10G

Meta logoLlama 2 7B Chat TRT-LLM

text generation
v2ChatTRT-LLMA100

Hugging Face logoZephyr 7B Alpha

text generation
AlphaA10G

Mistral AI logoMistral 7B Chat

text generation
v1ChatA10G

Meta logoLlama 2 7B Chat

text generation
v2ChatA10G

Stability AI logoStableLM

text generation
Alpha v2A10G

Numbers Station AI logoNSQL 350M

text generation
A10G

Meta logoCode Llama 7B Instruct

text generation
v2CodeA10G

Writer logoCamel 5B

text generation
ChatA10G

WizardLMWizardLM

text generation
A10G

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G