Please rotate your device

To continue exploring this website, please rotate your device to a vertical orientation

Changelog

Structured output and function calling support

Date

Models deployed with the TensorRT-LLM Engine Builder now support function calling (aka tool use) and structured output (aka JSON mode). Learn more: