Introducing traffic ramp up for seamless promotions
We're excited to introduce the "Traffic Ramp-Up" feature, designed to phase in new deployments with minimal impact on production latency and uptime. When enabled for a model, Baseten gradually shifts...