Blaxel is joining Baseten. Read more
Blog

Inference engineering

AllResearchModel performanceAI engineeringInfrastructureNewsCommunityAI modelsProductFoundations
Infrastructure

How Baseten multi-cloud capacity management (MCM) unifies deployments

Rachel Rapp
1 other
Infrastructure

Accelerating inference with NVIDIA B200 GPUs

Philip Kiely
Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta
1 other
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
Infrastructure

The benefits of globally distributed infrastructure for model serving

Phil Howes
1 other
Infrastructure

NVIDIA A10 vs A10G for ML model inference

Philip Kiely
Infrastructure

Pinning ML model revisions for compatibility and security

Philip Kiely
123