Introducing Baseten Loops: A Training SDK for Frontier RL. Learn more here

Matt Howard

Software Engineer

Infrastructure

How we built RBAC that scales for the enterprise

Matt Howard
2 others
How Baseten built RBAC that scales for the enterprise
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Model performance

Continuous vs dynamic batching for AI inference

Matt Howard
1 other
Continuous vs Dynamic batching
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs

Explore Baseten today

Start deployingTalk to an engineer