Please enable JavaScript
This website requires JavaScript in order to work properly.
Please rotate your device
To continue exploring this website, please rotate your device to a vertical orientation
Models deployed with the TensorRT-LLM Engine Builder now support function calling (aka tool use) and structured output (aka JSON mode). Learn more:
Launch announcement blog post
Engineering deep dive blog post
Function calling documentation
Structured output documentation