Kimi K3 is here. Try it now

Blog

Inference engineering

All Research Model performance AI engineering Infrastructure News Community AI models Product Foundations

News

New observability features: activity logging, LLM metrics, and metrics dashboard customization

Aaron Relph

Marius Killinger

Sid Shanker

Suren Atoyan

4 others

Observability

News

Introducing our Speculative Decoding Engine Builder integration for ultra-low-latency LLM inference

Abu Qader

Bryce Dubayah

Justin Yi

3 others

Speculative Decoding in Engine Builder

News

Introducing Custom Servers: Deploy production-ready model servers from Docker images

Bola Malek

Tianshu Cheng

2 others

Custom servers

News

Create custom environments for deployments on Baseten

Samiksha Pal

Raymond Cano

Sid Shanker

Samiksha Pal

3 others

Custom environments

News

Introducing canary deployments on Baseten

Sid Shanker

Jonathan Rochette

Raymond Cano

Sid Shanker

3 others

Canary Deployments

News

Export your model inference metrics to your favorite observability tool

Helen Yang

Nicolas Gere-lamaysouette

Philip Kiely

Helen Yang

2 others

Export your inference metrics

News

Baseten partners with Google Cloud to deliver high-performance AI infrastructure to a broader audience

Mike Bilodeau

Mike Bilodeau

1 other

Google Cloud + Baseten

News

Introducing Baseten Hybrid: control and flexibility in your cloud and ours

Phil Howes

Mike Bilodeau

Phil Howes

2 others

A GIF showing Baseten Hybrid: inference is run in your VPC, with optional spillover to Baseten Cloud.

News

Introducing function calling and structured output for open-source and fine-tuned LLMs

Bryce Dubayah

Philip Kiely

Bryce Dubayah

1 other

Function calling + JSON Mode