GLM-5.2 Fast is now available. Learn more
Blog

Inference engineering

AllResearchModel performanceAI engineeringInfrastructureNewsCommunityAI modelsProductFoundations
Research

Post-Training Science for Supervised Fine-Tuning

Charles O'Neill
2 others
Research

Still: Amortized KV Cache Compaction in a Single Forward Pass

Charles O'Neill
4 others
Research

Post-training frontier legal agents with Baseten Research

Charles O'Neill
5 others
Research

Towards infinite context windows: neural KV cache compaction

Charles O'Neill
2 others
Research

Dense, on-policy, or both?

Max Kirkby
1 other
Research

Repeated KV cache for long-running agents

Charles O'Neill
Position

The Michael Scott Paper Company of AI

Charles O'Neill
Research

Distillation without the dark

Max Kirkby
2 others
Position

Continual learning and the post monolith AI era

Charles O'Neill
1 other
Research

BYO SWE-grep: automatically train blazing fast search sub-agents on your knowledge base (Pt. 1)

Charles O'Neill
1 other
Research

Lumina: building self-improving evaluation through customer-in-the-loop refinement

Charles O'Neill
5 others
Research

Introducing RadixMLP: Intra-batch deduplication for causal transformers

Michael Feil
Research

Upweight the strategy, not the tokens: faster training with explicit reasoning through RGT (Rationale-Guided Training)

Charles O'Neill
2 others
Research

Attention-based attribution: what your model is actually looking at

Charles O'Neill
4 others
Research

Training loss predicts evaluation performance, even for non-verifiable tasks

Charles O'Neill
1 other
Research

Robust, sample efficient SFT with prompt mutations

Harry Partridge
1 other
Research

Iterative SFT (iSFT): dense reward learning

Charles O'Neill
4 others
Research

Write small, learn forever: rank-1 LoRA for continual learning

Charles O'Neill
3 others
Research

Practical LoRA Research

Max Kirkby
1 other
Research

Do transformers notice their own mistakes? Finding a linear hallucination detector inside LLMs

Mudith Jayasekara
4 others
Research

Resurrecting the salmon: seeing clearer inside LLMs with domain-specific SAEs

Charles O'Neill
2 others
Research

Why mechanistic interpretability needs a paradigm inversion

Charles O'Neill
2 others