"Inference Engineering" is now available. Get your copy here

Philip Kiely

Head of AI Education

Model performance

How we run GPT OSS 120B at 500+ tokens per second on NVIDIA GPUs

Amir Haghighat
4 others
GPT OSS 120B
Community

Canopy Labs selects Baseten as preferred inference provider for Orpheus TTS models

Philip Kiely
Canopy Labs + Baseten
Model performance

Day zero benchmarks for Qwen 3 with SGLang on Baseten

Yineng Zhang
2 others
Qwen + SGLang
Infrastructure

Accelerating inference with NVIDIA B200 GPUs

Philip Kiely
B200 GPUs
Community

Building performant embedding workflows with Chroma and Baseten

Philip Kiely
Chroma Baseten
AI engineering

The best open-source embedding models

Philip Kiely
Best embedding models
Model performance

How we built BEI: high-throughput embedding, reranker, and classifier inference

Michael Feil
1 other
TensorRT-LLM for embeddings
Model performance

How multi-node inference works for massive LLMs like DeepSeek-R1

Phil Howes
1 other
Multi-node inference
Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Testing GH200 GPUs
123...8

Explore Baseten today

Start deployingTalk to an engineer
Philip Kiely - Head of AI Education