Introducing Baseten Loops: A Training SDK for Frontier RL. Learn more here

Pankaj Gupta

Co-Founder

News

Announcing Baseten's $300M Series E

Tuhin Srivastava
3 others
Baseten Series E
Model performance

Wan 2.2 video generation in less than 60 seconds

Faraz Shahsavan
3 others
Wan 2.2 video generation in less than 60 seconds
Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Testing GH200 GPUs
Model performance

Driving model performance optimization: 2024 highlights

Pankaj Gupta
MP 2024 highlights
Model performance

How we built production-ready speculative decoding with TensorRT-LLM

Pankaj Gupta
2 others
Speculative Decoding with TensorRT-LLM
Model performance

A quick introduction to speculative decoding

Pankaj Gupta
2 others
Intro to Speculative Decoding
Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta
1 other
NVIDIA H200
Model performance

How to serve 10,000 fine-tuned LLMs from a single GPU

Pankaj Gupta
1 other
10,000 LoRAs 1 GPU
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs
12

Explore Baseten today

Start deployingTalk to an engineer