"Inference Engineering" is now available. Get your copy here

Pankaj Gupta

Co-Founder

Model performance

Benchmarking fast Mistral 7B inference

Abu Qader
3 others
Mistral 7B
Model performance

33% faster LLM inference with FP8 quantization

Pankaj Gupta
1 other
Faster inference with FP8
Model performance

FP8: Efficient model inference with 8-bit floating point numbers

Pankaj Gupta
1 other
8-bit floating point numbers
Model performance

40% faster Stable Diffusion XL inference with NVIDIA TensorRT

Pankaj Gupta
2 others
40% faster SDXL
Model performance

Unlocking the full power of NVIDIA H100 GPUs for ML inference with TensorRT

Pankaj Gupta
1 other
H100 w/ TensorRT-LLM
Model performance

Faster Mixtral inference with TensorRT-LLM and quantization

Pankaj Gupta
2 others
Faster Mixtral inference
Infrastructure

Technical deep dive: Truss live reload

Pankaj Gupta
Live reload
12

Explore Baseten today

Start deployingTalk to an engineer