Tri Dao

Model performance

How we run GPT OSS 120B at 500+ tokens per second on NVIDIA GPUs

Amir Haghighat
4 others
GPT OSS 120B

Explore Baseten today

Start deploying
Talk to an engineer