Baseten’s model deployment stack runs on Truss, our open-source library for model serving. Any model framework supported by Truss is also supported in the Baseten CLI. As such, the Baseten Python client now supports three new frameworks:
And of course you can deploy any model to Baseten as a custom model.
To use these newly supported frameworks, upgrade to the latest version of the Baseten Python client with:
pip install --upgrade basetenLet’s take a look at what deploying a model built from Hugging Face Transformers looks like:
import baseten
from transformers import pipeline
model = pipeline('fill-mask', model='bert-base-uncased')
baseten.login("*** INSERT API KEY ***") # https://docs.baseten.co/settings/api-keys
baseten_model = baseten.deploy(
model,
model_name='bert base uncased',
)As we continue developing Truss, more frameworks will be supported out-of-the-box on Baseten. Let us know what framework you’d like to see next by opening an issue.
A handful of small-but-mighty changes to make Baseten more joyful to use:
You can view and edit your workspace name in settings
Code files show when they were last edited
The file upload component checks uploaded files to ensure they are below the maximum size before saving
Bug fixes and performance improvements