- Social media, livestreaming, and demonstrations policy
- Fictional content co-authored with the OpenAI API policy
- Research policy
Social media, livestreaming, and demonstrations policy
To mitigate the possible risks of AI-generated content, we have set the following policy on permitted sharing.
Posting your own prompts / completions to social media is generally permissible, as is livestreaming your usage or demonstrating our products to groups of people. Please adhere to the following:
- Manually review each generation before sharing or while streaming.
- Attribute the content to your name or your company.
- Indicate that the content is AI-generated in a way no user could reasonably miss or misunderstand.
- Do not share content that violates our Content Policy or that may offend others.
- If taking audience requests for prompts, use good judgment; do not input prompts that might result in violations of our Content Policy.
If you would like to ensure the OpenAI team is aware of a particular completion, you may email us or use the reporting tools within Playground.
- Recall that you are interacting with the raw model, which means we do not filter out biased or negative responses. (Also, you can read more about implementing our free content filter here.)
If you are building an application related to social media, note that you must be approved through an App Review before commencing.
- You may demonstrate your ideas prior to approval in venues such as hackathons, conferences, meetings with investors or coworkers, etc., so long as you indicate that your application has not yet been approved for launch.
Fictional content co-authored with the OpenAI API policy
Creators who wish to publish their first-party written fictional content (e.g., a book, compendium of short stories) created in part with the OpenAI API are permitted to do so under the following conditions:
- The published content is attributed to your name or company.
- The role of AI in formulating the content is clearly disclosed in a way that no reader could possibly miss, and that a typical reader would find sufficiently easy to understand.
- We kindly ask that you refrain from sharing outputs that may offend others.
For instance, one must detail in a Foreword or Introduction (or some place similar) the relative roles of drafting, editing, etc. People should not represent API-generated content as being wholly generated by a human or wholly generated by an AI, and it is a human who must take ultimate responsibility for the content being published.
Here is some stock language you may use to describe your creative process, provided it is accurate:
“The author generated this text in part with GPT-3, OpenAI’s large-scale language-generation model. Upon generating draft language, the author reviewed, edited, and revised the language to their own liking and takes ultimate responsibility for the content of this publication.”
We believe it is important for the broader world to be able to evaluate our research and products, especially to understand and improve potential weaknesses and safety or bias problems in our models.
Accordingly, we welcome research publications related to the OpenAI API, with a few further details:
- We do require that researchers receive prior approval for either 1) publishing datasets of API-generated text or 2) embarking on research that attempts to train models in part from API-generated data, through our App Review process.
- This is because datasets and derivative models of the OpenAI API can potentially be used to enable new AI capabilities by third-parties and may raise IP considerations.
- For other research, we kindly request advance notice about research publications based on API access at email@example.com.
- Note that our approval is not required for publication of most research (except in the cases outlined above).
- In some cases, we may want to highlight your work internally and/or externally.
- In others, such as publications that pertain to security or misuse of the API, we may want to take appropriate actions to protect our users.
- If you notice any safety or security issues with the API in the course of your research, we ask that you please submit these immediately through our Coordinated Vulnerability Disclosure Program.
There are a number of research directions we are excited to explore with the OpenAI API. If you are interested in the opportunity for subsidized access, please provide us with details about your research use case using this form.
In particular, we consider the following to be especially important directions, though you are free to craft your own direction:
- Alignment: How can we understand what objective, if any, a model is best understood as pursuing? How do we increase the extent to which that objective is aligned with human preferences, such as via prompt design or fine-tuning?
- Fairness and Representation: How should performance criteria be established for fairness and representation in language models? How can language models be improved in order to effectively support the goals of fairness and representation in specific, deployed contexts?
- Interdisciplinary Research: How can AI development draw on insights from other disciplines such as philosophy, cognitive science, and sociolinguistics?
- Interpretability / Transparency: How do these models work, mechanistically? Can we identify what concepts they’re using, or extract latent knowledge from the model, make inferences about the training procedure, or predict surprising future behavior?
- Misuse Potential: How can systems like the API be misused? What sorts of ‘red teaming’ approaches can we develop to help us and other AI developers think about responsibly deploying technologies like this?
- Model Exploration: Models like those served by the API have a variety of capabilities which we have yet to explore. We're excited by investigations in many areas including model limitations, linguistic properties, commonsense reasoning, and potential uses for many other problems.
- Robustness: Generative models have uneven capability surfaces, with the potential for surprisingly strong and surprisingly weak areas of capability. How robust are large generative models to “natural” perturbations in the prompt, such as phrasing the same idea in different ways or with/without typos? Can we predict the kinds of domains and tasks for which large generative models are more likely to be robust (or not robust), and how does this relate to the training data? Are there techniques we can use to predict and mitigate worst-case behavior? How can robustness be measured in the context of few-shot learning (e.g. across variations in prompts)? Can we train models so that they satisfy safety properties with a very high level of reliability, even under adversarial inputs?