Changelog
See our latest feature releases, product improvements and bug fixes
Create custom environments for model release management
Today we’re excited to introduce custom environments to help manage your model’s release cycles. Environments provide a way to ensure quality, stability, and scalability before your model reaches end...
Oct 9, 2024New request metrics
We've introduced three new request metrics to enhance model monitoring. You can now view percentiles and averages for the following: -
Oct 2, 2024Export model inference metrics to your favorite observability tools
You can now easily export model inference metrics to your favorite observability platforms, including Prometheus, Datadog, Grafana Cloud, and New Relic!
Sep 26, 2024Introducing Baseten Hybrid
Today we introduced early access to Baseten Hybrid, a multi-cloud solution that enables you to self-host inference with seamless flex capacity on Baseten Cloud.
Sep 16, 2024Deploy vLLM models with our OpenAI Bridge
Our OpenAI Bridge is now compatible with vLLM models out of the box!
Sep 15, 2024Promote Chains to production
As of Truss version 0.9.34, you can now promote Chains to a production environment, bringing the same deployment workflow used for Truss Models to Chains.
Sep 13, 2024Seamless remote development with Truss watch
We improved truss watch for more reliable live reloads, so you can test changes on production hardware in seconds without manually pushing via truss push or creating new deployments each time.
Sep 12, 2024Structured output and function calling support
Models deployed with the TensorRT-LLM Engine Builder now support function calling (aka tool use) and structured output (aka JSON mode). Learn more:
Sep 6, 2024In-app changelog notifications
Stay up to date with all the latest features and updates! New changelog posts will now appear directly in the app. You can view the latest updates through the help menu in the top-right corner. If...
Aug 29, 2024Easier secret management for custom build commands
When using custom build commands in Truss, secrets are often needed; for instance, when installing a pip package from a private GitHub repository.