Blog

Open-source models continue to bridge the gap on results quality versus their closed-source counterparts. Discover new models for text generation and text-to-speech, learn more about the GPUs they run on, and plug in to the community forming around open-source models in this newsletter.

Baseten

June 2, 2023

NVIDIA has dozens of GPUs that can serve ML models of different sizes. But understanding the performance and cost of these different cards, not to mention just keeping the names straight, is a challenge. This guide helps you navigate NVIDIA’s datacenter GPU lineup.

Philip Kiely

May 23, 2023

Advertising for GPUs is designed to drive excitement and demand year after year. But as the industry evolves, certain benchmarks remain consistent from generation to generation. This guide helps you make fair comparisons between graphics cards based on your real-world needs.

Philip Kiely

May 22, 2023

The energy in AI is exhilarating: new open-source large language models are released every week, and community meetups and hackathons are happening every day. This newsletter breaks down the latest in OSS LLMs, AI meetups, and Baseten’s new usage-based pricing, plus free credits!

Baseten

May 1, 2023

This post outlines the key specs to understand when comparing GPUs as well as factors to consider like price, availability, and opportunities for horizontal scaling. Then, we apply these ideas to choose between two common datacenter GPUs—the NVIDIA T4 and A10—for realistic generative AI workloads.

Philip Kiely

April 27, 2023

In March of 2023, we announced that Baseten is SOC 2 Type II certified and HIPAA compliant. Pursuing compliance isn’t a trivial decision, but our existing security posture and development practices made becoming compliant a relatively seamless process.

Baseten

April 25, 2023

Stability AI has released StableLM, a series of models that are ideal for generating both text and code. This post will show you how to quickly and easily deploy these models and make them available behind a REST API endpoint by using Baseten and Truss.

Tuhin Srivastava

April 20, 2023

There's no better time than now to join the AI community, and hosting a meetup is a great way to get started! Julien shares his 10 tips for hosting a successful AI meetup.

Julien Reiman

April 6, 2023

This month: ChatLLaMA, fine-tuning FLAN-T5, an assortment of AI-powered weekend projects, and announcements of SOC 2 type II certification and HIPAA compliance.

Baseten

March 31, 2023

We’re excited to announce that we have satisfied all the necessary criteria to be HIPAA compliant through a requirements analysis and internal audit, driven by Drata.

Baseten

March 28, 2023

You can now fine-tune FLAN-T5, an instruction-tuned text-to-text transformer model developed by Google, on Blueprint!

Abu Qader

March 17, 2023

Baseten has completed a rigorous audit by Sensiba San Filippo LLP, a leading CPA firm, to achieve System and Organization Controls (SOC) 2 Type II certification.

Baseten

March 8, 2023

Today we're launching Blueprint. Blueprint is a fine-tuning and serving infrastructure platform for software developers who are comfortable with backend and frontend engineering but lack expertise in model development and hosting.

Abu Qader

March 1, 2023

We have only started to see is how Stable Diffusion will get incorporated into existing and greenfield creative workflows. And this will be an exciting step in the evolution of AI-powered tools over the next months and years. DreamCanvas is an exploration of this space built with Blueprint.

Michael Feldstein

March 1, 2023

Blueprint works great for building user-facing applications with fine-tuned models. One popular type of app using fine-tuning is AI avatar generation apps. This project implements a simple version of an avatar generation app like Lensa using Blueprint.

Tuhin Srivastava

February 27, 2023