Blaxel is joining Baseten. Read more

Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations

News

Introducing Custom Servers: Deploy production-ready model servers from Docker images

Bola Malek

Tianshu Cheng

2 others

Custom servers

News

Create custom environments for deployments on Baseten

Samiksha Pal

Raymond Cano

Sid Shanker

Samiksha Pal

3 others

Custom environments

News

Introducing canary deployments on Baseten

Sid Shanker

Jonathan Rochette

Raymond Cano

Sid Shanker

3 others

Canary Deployments

Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta

Philip Kiely

Pankaj Gupta

1 other

NVIDIA H200

News

Export your model inference metrics to your favorite observability tool

Helen Yang

Nicolas Gere-lamaysouette

Philip Kiely

Helen Yang

2 others

Export your inference metrics

News

Baseten partners with Google Cloud to deliver high-performance AI infrastructure to a broader audience

Mike Bilodeau

Mike Bilodeau

1 other

Google Cloud + Baseten

News

Introducing Baseten Hybrid: control and flexibility in your cloud and ours

Phil Howes

Mike Bilodeau

Phil Howes

2 others

A GIF showing Baseten Hybrid: inference is run in your VPC, with optional spillover to Baseten Cloud.

Community

Building high-performance compound AI applications with MongoDB Atlas and Baseten

Philip Kiely

Philip Kiely

MongoDB + Baseten

Model performance

How to build function calling and JSON mode for open-source and fine-tuned LLMs

Bryce Dubayah

Philip Kiely

Bryce Dubayah

1 other

JSON Mode

1...17 18 19...27