InfrastructureUsing fractional H100 GPUs for efficient model servingMatt Howard, Vlad Shulman, Pankaj Gupta, Philip Kiely