InfrastructureControl plane vs workload plane in model serving infrastructureColin McGrath, Matt Howard, Philip Kiely
InfrastructureUsing fractional H100 GPUs for efficient model servingMatt Howard, Vlad Shulman, Pankaj Gupta, Philip Kiely