Models
Customers
Pricing

Base Labs
Docs

Log in Get started

Amit Gambhir

Solutions Architect

Socials

AI engineering

The two AI gateway patterns in production inference

Amit Gambhir

A guide to AI gateways in production

Explore Baseten today

Start deploying Talk to an engineer

Product

Dedicated Inference
Model APIs
Training
Model Labs

Baseten Inference Platform

Model Runtimes
Infrastructure
Multi-cloud

Deployment options

Cloud
Self-hosted
Hybrid

Embedded engineering

Forward deployed engineers

Modalities

Transcription
Image Generation
Text-to-speech
Large language models
Compound AI
Embeddings

Industries

Enterprise
Healthcare

Developer

Model library
Documentation
Changelog

Resources

Base Labs
Customers
Blog
Guides
Events
Partners
Savings calculator
Trust Center
About us
Startups
Careers
Contact us

Legal

Terms and Conditions
Privacy Policy
Service Level Agreement

all systems normal

© 2026 Baseten

SOC 2 Type II Certified

Hipaa Compliant

Product

Dedicated Inference
Model APIs
Training
Model Labs

Baseten Inference Platform

Model Runtimes
Infrastructure
Multi-cloud

Deployment options

Cloud
Self-hosted
Hybrid

Embedded engineering

Forward deployed engineers

Modalities

Transcription
Image Generation
Text-to-speech
Large language models
Compound AI
Embeddings

Industries

Enterprise
Healthcare

Developer

Model library
Documentation
Changelog

Resources

Base Labs
Customers
Blog
Guides
Events
Partners
Savings calculator
Trust Center
About us
Startups
Careers
Contact us

Legal

Terms and Conditions
Privacy Policy
Service Level Agreement

all systems normal

© 2026 Baseten

Popular models

GLM-5.3
GLM-5.3-Flash
DeepSeek V4 Pro 0813
Kimi K3
Whisper Large V3
Qwen3.8-27B
Explore all

Popular models

GLM-5.3
GLM-5.3-Flash
DeepSeek V4 Pro 0813
Kimi K3
Whisper Large V3
Qwen3.8-27B
Explore all