Try the new DeepSeek V4 Pro 0813 today. Frontier intelligence at a fraction of the cost. Here

Abu Qader

Software Engineer

Model performance

How to double tokens per second for Llama 3 with Medusa

Abu Qader
1 other
News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader
1 other
Model performance

Benchmarking fast Mistral 7B inference

Abu Qader
3 others
Model performance

Introduction to quantizing ML models

Abu Qader
1 other
12

Explore Baseten today

Start deployingTalk to an engineer