Kimi K3 is here. Try it now

Rachel Rapp

Product

News

Baseten Chains is now GA for production compound AI systems

Marius Killinger

Tyron Jung

Marius Killinger

2 others

Baseten Chains

News

New observability features: activity logging, LLM metrics, and metrics dashboard customization

Aaron Relph

Marius Killinger

Sid Shanker

Suren Atoyan

4 others

Observability

News

Introducing our Speculative Decoding Engine Builder integration for ultra-low-latency LLM inference

Abu Qader

Bryce Dubayah

Justin Yi

3 others

Speculative Decoding in Engine Builder

Model performance

Generally Available: The fastest, most accurate and cost-efficient Whisper transcription

William Gao

Derrick Yang

William Gao

3 others

The fastest Whisper

News

Introducing Custom Servers: Deploy production-ready model servers from Docker images

Bola Malek

Tianshu Cheng

2 others

Custom servers

News

Create custom environments for deployments on Baseten

Samiksha Pal

Raymond Cano

Sid Shanker

Samiksha Pal

3 others

Custom environments

News

Introducing canary deployments on Baseten

Sid Shanker

Jonathan Rochette

Raymond Cano

Sid Shanker

3 others

Canary Deployments

News

Baseten partners with Google Cloud to deliver high-performance AI infrastructure to a broader audience

Mike Bilodeau

Mike Bilodeau

1 other

Google Cloud + Baseten

News

Introducing Baseten Hybrid: control and flexibility in your cloud and ours

Phil Howes

Mike Bilodeau

Phil Howes

2 others

A GIF showing Baseten Hybrid: inference is run in your VPC, with optional spillover to Baseten Cloud.

Explore Baseten today

Start deploying Talk to an engineer