Announcing our partnership with OpenAI. Read more

Matt Howard

Software Engineer

Matt Howard

Infrastructure

How we built RBAC that scales for the enterprise

Matt Howard

Samiksha Pal

Matt Howard

2 others

How Baseten built RBAC that scales for the enterprise

Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath

Matt Howard

Philip Kiely

Colin McGrath

2 others

Control plane vs workload plane

Model performance

Continuous vs dynamic batching for AI inference

Matt Howard

Philip Kiely

Matt Howard

1 other

Continuous vs Dynamic batching

Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard

Vlad Shulman

Pankaj Gupta

Philip Kiely

Matt Howard

3 others

H100 MIGs

Explore Baseten today

Start deploying Talk to an engineer