10 Llama models

NVIDIA logoLlama 3.1 Nemotron 70B

LLM
3.1NemotronA100

Meta logoLlama 3.1 405B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 8B Instruct

LLM
3.1InstructH100

Meta logoLlama 3.1 70B Instruct

LLM
3.1InstructH100

Meta logoLlama 3 8B Instruct

LLM
3InstructA100

Meta logoLlama 3 70B Instruct

LLM
3InstructH100

Meta logoLlama 3 8B Instruct TRT-LLM

LLM
3InstructTRT-LLMA100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G