Philip Kiely

Lead Developer Advocate

Community

SPC hackathon winners build with Llama 3.1 on Baseten

Philip Kiely
SPC Hackathon winners
News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader
1 other
TensorRT-LLM Engine Creation
Community

Ten reasons to join Baseten

Dustin Michaels
1 other
Join Baseten
Model performance

How to serve 10,000 fine-tuned LLMs from a single GPU

Pankaj Gupta
1 other
10,000 LoRAs 1 GPU
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Model performance

Comparing tokens per second across LLMs

Philip Kiely
Comparing TPS across LLMs
AI engineering

CI/CD for AI model deployments

Vlad Shulman
3 others
CI/CD for AI models
AI engineering

Streaming real-time text to speech with XTTS V2

Het Trivedi
1 other
Streaming TTS
Model performance

Continuous vs dynamic batching for AI inference

Matt Howard
1 other
Continuous vs Dynamic batching
1234...7

Explore Baseten today

Start deploying
Talk to an engineer