"Inference Engineering" is now available. Get your copy here
Blog

Blog

Expert guides and engineering deep dives to help you ship faster, scale easier, and learn along the way.

AllResearchModel performanceAI engineeringInfrastructureNewsCommunityAI modelsProductFoundations
Model performance

Benchmarking fast Mistral 7B inference

Abu Qader
3 others
Mistral 7B
Model performance

33% faster LLM inference with FP8 quantization

Pankaj Gupta
1 other
Faster inference with FP8
Model performance

High performance ML inference with NVIDIA TensorRT

Justin Yi
1 other
NVIDIA TensorRT
Model performance

FP8: Efficient model inference with 8-bit floating point numbers

Pankaj Gupta
1 other
8-bit floating point numbers
News

Announcing our Series B

Tuhin Srivastava
Baseten co-founders Amir, Tuhin, Phil, and Pankaj
Infrastructure

The benefits of globally distributed infrastructure for model serving

Phil Howes
1 other
Benefits of global infra
Model performance

40% faster Stable Diffusion XL inference with NVIDIA TensorRT

Pankaj Gupta
2 others
40% faster SDXL
Model performance

Why GPU utilization matters for model inference

Marius Killinger
1 other
Why GPU utilization matters
AI engineering

The best open source large language model

Philip Kiely
Best open source large language models
1...151617...21