Announcing our Series F. Learn more

Abu Qader

Software Engineer

Model performance

How we built the world’s fastest API for GLM-5.2

Alex Korte
6 others
Model performance

How we built the fastest Kimi K2.5 on Artificial Analysis

Tri Dao
3 others
Model performance

Kimi K2 Thinking at 140+ TPS on NVIDIA Blackwell

Abu Qader
2 others
Model performance

How we made the fastest GPT-OSS on NVIDIA GPUs 60% faster

Tri Dao
2 others
Model performance

2x faster inference with KV cache-aware routing

Abu Qader
2 others
Model performance

How we run GPT OSS 120B at 500+ tokens per second on NVIDIA GPUs

Amir Haghighat
4 others
News

Introducing our Speculative Decoding Engine Builder integration for ultra-low-latency LLM inference

Justin Yi
3 others
Model performance

How to double tokens per second for Llama 3 with Medusa

Abu Qader
1 other
News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader
1 other
12

Explore Baseten today

Start deployingTalk to an engineer