

Serve models with zero retention of inference inputs and outputs by default, plus encryption in transit and at rest. Protect sensitive customer and proprietary data as models run.
Baseten layers hardened infrastructure, workload isolation, and AI-assisted detection and response to limit the impact of attacks. Agentic red teaming helps us find and patch vulnerabilities sooner.
Baseten applies consistent security controls across 100+ clusters and 20+ clouds. Isolated workloads, cluster-scoped credentials, and continuous monitoring contain threats wherever your workloads run.

Run sensitive inference with encryption, workload isolation, and clear data-retention practices. Align networking and deployment choices with your security requirements.
Control who can deploy, configure, and operate production AI. Use enterprise identity, role-based permissions, and reviewed release workflows to keep access and changes accountable.
Safety extends beyond protecting data. Evaluate models for your use case, define acceptable behavior, and plan how your application should respond to unsafe outputs, sensitive-data exposure, or attempts to redirect it.
A model’s response should not become unrestricted permission to act. Define which tools, data, and systems an agent can reach—and where sensitive actions require validation or human approval.

Protect your inference data with zero data retention by default for Model APIs and synchronous Dedicated Inference. For optional asynchronous inference, inputs are queued for up to 72 hours; outputs aren’t stored.

Centralize authentication with SSO and manage permissions with role-based access controls. Use service accounts to automate workflows without sharing human credentials.


Select a region for your GPU model deployment and keep every replica in that region. Route requests through a regional endpoint to support your data residency and compliance requirements.

Securely connect your data with native cloud IAM integrations. With BYOK encryption, exercise independent control over access to model weights and payloads.

Enforce isolation and segregation through fine-grained network policies. Control how workloads connect to keep production traffic aligned with your security guidelines.

Streamline your security review with SOC 2 Type II attestation, HIPAA support with a BAA, and supporting documentation in the Baseten Trust Center.

Restrict who can change production, keep experimentation separate, and version, promote, and roll back deployments with supported workflows.
Configure autoscaling to match your workload, and scale to zero when a model has no traffic. Baseten’s global compute fleet supports rapid scaling without capacity planning.
Inference traffic routes directly to your workload plane, and Baseten does not store synchronous inference inputs or outputs. For asynchronous requests, inputs are stored until the request runs.
Route inference traffic from your VPC to your dedicated environment using AWS PrivateLink or Google Cloud Private Service Connect.
Work with Baseten to select regions, GPU types, and capacity commitments that meet your needs. Baseten procures and operates the capacity for your dedicated environment.
Pull model weights from a private source you control. Work with the Baseten team to configure a customer-owned weights bucket.
Model inputs and outputs stay inside your infrastructure. Baseten does not store synchronous inference payloads; asynchronous inputs queue in your environment until the request runs.
Talk through your security review with our team, or get a live walkthrough of the controls on this page.
