Blaxel is joining Baseten. Read more

Abu Qader

Software Engineer

Abu Qader

Model performance

How to double tokens per second for Llama 3 with Medusa

Abu Qader

Philip Kiely

Abu Qader

1 other

Double Llama TPS with Medusa

News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader

Philip Kiely

Abu Qader

1 other

TensorRT-LLM Engine Creation

Model performance

Benchmarking fast Mistral 7B inference

Abu Qader

Pankaj Gupta

Philip Kiely

Abu Qader

3 others

Mistral 7B

Model performance

Introduction to quantizing ML models

Abu Qader

Philip Kiely

Abu Qader

1 other

Quantization

Explore Baseten today

Start deploying Talk to an engineer