We build our generative models using a technology called deep learning, which leverages large amounts of data to train an AI system to perform a task.
Our text models are advanced language processing tools that can generate, classify, and summarize text with high levels of coherence and accuracy.
Aligning language models to follow instructionsWe’ve trained language models that are much better at following user intentions than GPT-3.
Summarizing books with human feedbackWe've trained a model to summarize entire books with human feedback.
Language models are few-shot learnersWe trained GPT-3, an autoregressive language model with 175 billion parameters.
Our research on generative modeling for images has led to representation models like CLIP, which makes a map between text and images that an AI can read, and DALL-E, a tool for creating vivid images from text descriptions.
Hierarchical text-conditional image generation with CLIP latentsWe show that explicitly generating image representations improves image diversity with minimal loss in photorealism and caption similarity.
DALL·E: Creating images from textWe’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language.
CLIP: Connecting text and imagesWe’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision.
Our research on applying AI to audio processing and audio generation has led to developments in automatic speech recognition and original musical compositions.
Introducing WhisperWe’ve trained and are open-sourcing a neural net that approaches human level robustness and accuracy on English speech recognition.
JukeboxWe’re introducing Jukebox, a neural net that generates music as raw audio in a variety of genres and artist styles.
MuseNetWe’ve created MuseNet, a deep neural network that can generate 4-minute musical compositions with 10 different instruments.
Our current AI research builds upon a wealth of previous projects and advances.
We are constantly seeking talented individuals to join our team. Explore featured roles or view all open roles.