Model Performance Team

Model performance

Boosting MTP acceptance in TensorRT-LLM: +40% throughput

Mahmoud Hassan
1 other
Boosting MTP acceptance in TensorRT-LLM: +40% throughput

Explore Baseten today

Start deploying
Talk to an engineer