changelog / post
elephant-1 and mammoth-1 available on Baseten
elephant-1 and mammoth-1 are now available through Baseten Model APIs. Classify text, route requests, and score content against a rubric. Send one or more questions in a single request to get choices, yes/no probabilities, and scores.
Call the System One endpoint with your Baseten API key:
1curl https://inference.baseten.co/v1/systemone \
2 -H "Authorization: Bearer $BASETEN_API_KEY" \
3 -H "Content-Type: application/json" \
4 -d '{
5 "model": "decision-models/baseten-elephant-9b-latest",
6 "state": "I was charged twice for my subscription. Please refund the duplicate charge.",
7 "questions": {
8 "route": {
9 "type": "choice",
10 "instructions": "Which team should handle this request?",
11 "criteria": {
12 "billing": "Billing, payments, and refunds",
13 "technical_support": "Technical troubleshooting"
14 }
15 }
16 }
17 }'To use mammoth-1, set model to decision-models/baseten-mammoth-27b-latest.
For more information, see our docs.