"Inference Engineering" is now available. Get your copy here

Matt Howard

Software Engineer

Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Model performance

Continuous vs dynamic batching for AI inference

Matt Howard
1 other
Continuous vs Dynamic batching
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs

Explore Baseten today

Start deployingTalk to an engineer