Skip to content
Skip to content

Practical LLM operations guide · By Yes AI

Do AI providers train on your business data?

Published 6 min read

The business and API tiers of the major AI platforms say they do not train their models on your prompts by default. Training is only one way your data can be kept or read, though. Retention for abuse monitoring, human review and stored conversation features also matter when staff work with confidential client files.

Quick answer

For business and API use, OpenAI, Microsoft Azure and Amazon Bedrock all state that customer prompts are not used to train their models by default. Retention and review differ. OpenAI may keep API inputs and outputs for up to 30 days to identify abuse unless you obtain zero data retention. Azure may store flagged prompts for human review unless you are approved for modified abuse monitoring. On Bedrock, retention depends on the model and the retention mode you set.

Two lawyers in a Melbourne office reading a printed service agreement beside a laptop with a blurred screen

What do the main providers say about training?

OpenAI states that by default it does not train on data from ChatGPT Business, ChatGPT Enterprise, ChatGPT Edu or the API Platform, unless you explicitly opt in to share data. It also says it uses data from versions of ChatGPT and other services for individuals, which puts a staff member's personal account in a different category from a company workspace. Microsoft states that prompts, completions, embeddings and training data sent to models sold by Azure, including Azure OpenAI models, are not available to OpenAI and are not used to train foundation models without your permission. AWS states that Bedrock content is not used to improve the base models and is not shared with model providers.

Which settings can change the default?

The headline statement describes the default position. Features that staff or developers switch on later can change what is kept and who sees it, and none of them requires a new contract to be signed. Review the product settings as well as the terms, and repeat the review whenever a new feature is enabled in your workspace or application. Ask the person who administers each AI product which of the features below are switched on today.

  • Feedback buttons: OpenAI says data you explicitly opt in to share, for example through its feedback mechanisms, may be used to improve its services.
  • Personal accounts: staff using an individual consumer account fall outside the business-tier commitments.
  • Stored conversation features: on Azure, the Responses API, Assistants threads and stored completions keep content in your resource until you delete it.
  • Fine-tuning: training files you upload are stored by the provider to build your own model.

How long do providers keep prompts for abuse monitoring?

Abuse monitoring is the main reason a provider keeps prompts it does not train on. OpenAI may retain API inputs and outputs for up to 30 days to provide the services and identify abuse, and customers with a qualifying use case can request zero data retention for eligible endpoints. Microsoft runs automated abuse checks on Azure and may store a sample of flagged prompts and completions for review by authorised Microsoft employees, in the geography of your resource. Approved customers can apply for modified abuse monitoring, which turns that storage off, and Microsoft shows it as a ContentLogging value of false. On Bedrock, retention is set by a data retention mode, and each model declares which modes it allows, so two models in one account can behave differently.

Who at the provider can read your data?

Training and human access are separate questions. OpenAI says access to stored business data is limited to authorised employees who need it for engineering support, abuse investigation and legal compliance, plus specialised third-party contractors bound by confidentiality who review for abuse and misuse. Microsoft says its human reviewers see Azure prompts only when the abuse system has flagged them, using secure workstations and just-in-time approval. AWS describes a retention mode called aws_review for models whose provider requires human review, carried out by AWS without sending content to the model provider. For a law firm, health provider or accounting practice, record these access paths in your risk assessment alongside the training position.

What should you check in the contract and settings?

Read the product terms and data processing addendum for the exact product and tier you will use, not a marketing summary. The OAIC suggests businesses find out whether service terms give the developer access to data your organisation inputs or generates, and carry out due diligence that a product suits its intended uses. Ask the provider for written answers to the questions below, and keep a dated copy of every page you relied on, because provider documentation changes often.

  • Is customer content used to train or improve any model, and what opt-in mechanisms exist?
  • How long are prompts, outputs and uploaded files kept, and in which country?
  • Who can access stored content, under what approval, and are contractors involved?
  • Is zero data retention or modified abuse monitoring available for this product, and what does approval require?
  • How will you be told when these terms change?

Does private hosting remove the question?

Running an open-weight model on infrastructure you control takes the model provider out of the data path, so there is no provider training or abuse-monitoring retention to assess. The questions move to your own setup: who can read the application's logs, how long conversation history is kept, which administrators can see prompts, and whether a monitoring or support tool sends data elsewhere. A private deployment with loose logging can expose more than a well-configured enterprise API. Hypothetical example: a firm self-hosts a model but sends full prompt logs to a shared analytics tool that its whole IT contractor team can query. The provider question has gone, and an internal access question has replaced it.

Training, retention and review by platform (October 2026)

PlatformTrains on business prompts by default?Retention for abuse monitoringHow to reduce retention
OpenAI API PlatformNo, unless you opt in to share dataInputs and outputs up to 30 daysRequest zero data retention for eligible endpoints
ChatGPT Business and EnterpriseNo, unless you opt in to share dataWorkspace admins control retention; deleted conversations removed within 30 days unless law requires otherwiseAdmin retention settings
Azure OpenAI and other models sold by AzureNoFlagged samples may be stored for human review in your resource's geographyApply for modified abuse monitoring
Amazon BedrockNo (content not used to improve base models)Depends on the model's allowed retention modesSet the retention mode to none where the model allows it
Self-hosted open-weight modelNo provider involvedWhatever your own logging keepsYour own logging and retention policy
Personal consumer accountsCheck the individual terms; OpenAI uses data from its services for individualsVaries by productMove client work to a business tier

Practical checklist

  • The exact product tier and contract staff will use is named, and personal accounts are blocked for client work.
  • The training position is confirmed from the provider's current documentation, with a dated copy kept.
  • The abuse-monitoring retention period and location are recorded for each model in use.
  • Zero data retention or modified abuse monitoring has been requested where the data warrants it.
  • Feedback buttons and stored-conversation features are configured on purpose and explained to staff.
  • Your own application logs have a set retention period and a named access list.

Common questions

Is ChatGPT Enterprise suitable for confidential client documents?

OpenAI states that ChatGPT Enterprise data is not used for training by default and that workspace admins control retention. Whether that is acceptable for a client file depends on your client agreements, professional obligations and where the data is processed. Check those against the current terms and record the decision. Our private AI vs ChatGPT page compares the options in more detail.

Does zero data retention mean nothing is ever stored?

It depends on the setting and the feature. AWS notes that on Bedrock, setting store to false on its Responses API does not by itself give zero retention, and that some models may still retain data for safety review; the retention mode none is the setting that stops durable storage where a model allows it. Read the endpoint-level notes for each feature you use.

Can a provider change these terms later?

Yes. Provider documentation is updated regularly, and Microsoft's data privacy page for Azure models lists several revisions since 2023 in its change log. Set a review date, ask your provider how it notifies changes, and re-read the terms before enabling a new feature or model. Keep the dated copies you relied on with your risk assessment.

What does the OAIC say about entering personal information into AI tools?

As a matter of best practice, the OAIC recommends that organisations do not enter personal information, and particularly sensitive information, into publicly available generative AI tools. It also expects businesses to understand whether service terms give the developer access to the data they input. This is administrative guidance; for your specific obligations, read the OAIC guidance or speak with a privacy adviser.

Does fine-tuning a hosted model give the provider our data?

Fine-tuning means uploading training examples, so the provider stores those files. Microsoft states that training data uploaded for fine-tuning on Azure is not used to train foundation models without your permission, that fine-tuned models are available only to you, and that you can delete them at any time. Confirm the equivalent terms for any other platform before uploading client material.

Sources and further reading

Continue planning

Plan the checks before your next LLM release

Describe the task, source documents and people who will review the answers. We can discuss evaluation, access boundaries and a staged implementation. Keep confidential documents and access credentials out of this enquiry.