Data retention - verified
Does Together AI store your API prompts?
Default retention: stored by default; no duration stated. Trains on your API data: No. Zero data retention: self-serve (organization admins turn off prompt storage; off by default). Regional processing: EU.
Read from docs.together.ai. Compare every AI API's data retention
- Trains on data
- No
- ZDR
- Self-serve
- Regions
- EU
- Verified
- 2026-10-18
How long are prompts kept by default?
- Default retention
Stored by default; no duration stated
Prompts and responses stored by default and may be used for product improvements; deletable at any time. No duration stated.
“By default, Together stores the prompts you send and the responses models return, and may use them for product improvements. This data is not shared with third parties, and you can delete it at any time.”
docs.together.ai - Duration
- Not stated
- Purpose
- Not stated
Does it train on your API data?
No
Training on customer data is opt-in and off by default.
“Data sharing for training other models is opt-in and not enabled by default.”
“Training: Use of your data for training models is a separate opt-in and is off by default. Together does not train on your data without your explicit consent, whether or not ZDR is enabled.”
Zero data retention (ZDR)
- Availability
Self-serve: you can switch it on yourself
Organization admins turn off prompt storage; off by default
- Who can get it
Organization admins, by setting 'Store prompts and model responses' to No; not enabled by default; not retroactive.
- Not covered
Turns off passthrough models. Files uploaded for fine-tuning or batch stay stored until deleted. Request metadata and account data still retained.
- From the docs
“ZDR is not enabled by default.”
docs.together.ai “With ZDR enabled, the content you submit to Together’s inference services, including text, images, and prompts, and any outputs returned to you are not stored, retained, or used for model training, product improvements, or any secondary purpose, except as needed to provide the service to you.”
docs.together.ai “Turning off prompt storage also turns off passthrough models automatically, because passthrough requires retained prompts.”
docs.together.ai
Features kept longer
Stateful features hold your content until a job finishes, a window expires or you delete it, often regardless of the default above.
| Feature | Retention | The docs say |
|---|---|---|
| Files for fine-tuning or batch API | Until deleted | “Files you upload for fine-tuning or the batch API are stored so your jobs can run, and remain stored until you delete them through the API, CLI, or web console.”docs.together.ai |
| Passthrough third-party models | Not stated | “Some models are offered as passthrough, meaning that Together forwards your prompts and responses directly to the upstream provider, and data is handled under that provider’s own data policy.”docs.together.ai |
Where is your data stored and processed?
- Regional processing
EU
Dedicated or VPC deployments only; serverless has no region choice
- Stated location
- Not stated
- How to choose
- Not stated
- What it covers
- Not stated
- Summary
Serverless endpoints have no region selection. Dedicated endpoints and private networking/VPC deployments, including EU regions, for residency needs.
- From the docs
“For customers with data-residency, regulatory, or compliance requirements (for example, GDPR-driven EU-region deployments), Together supports private networking and VPC-based deployments, including in EU regions. Serverless endpoints do not offer region selection;”
docs.together.ai “For example, DeepSeek models are hosted in Together’s secure North America data centers.”
docs.together.ai
Regional endpoints
Regional hostnames: Not stated
Certifications
Certifications on the pages checked: Not stated
Research notes
- Passthrough models are allowed by default and send data to third-party providers. The org setting governs requests made with an org API key, not the personal account toggle.
FAQ
Does Together AI store your API prompts?
Stored by default; no duration stated. Prompts and responses stored by default and may be used for product improvements; deletable at any time. No duration stated. The provider says: "By default, Together stores the prompts you send and the responses models return, and may use them for product improvements. This data is not shared with third parties, and you can delete it at any time."
Does Together AI train on your API data?
No. The provider says: "Data sharing for training other models is opt-in and not enabled by default."
Does Together AI offer zero data retention?
Self-serve (organization admins turn off prompt storage; off by default). Organization admins, by setting 'Store prompts and model responses' to No; not enabled by default; not retroactive.
Where does Together AI process your data?
Regional processing options: EU (dedicated or VPC deployments only; serverless has no region choice). Stated processing location: Not stated.
Sources
Last verified from Together AI's own pages below. Quotes are verbatim.
This page summarizes what each provider's own pages say. It is not legal advice; your contract, data processing addendum and the provider's current terms govern what happens to your data.
Newsletter
Know when a provider changes its data terms
One email per week. New model releases, pricing and policy changes, and what they mean for what you build.