Language

Community, Computer vision, Games, Human feedback, Image generation, Language, Open source, Reasoning, Reinforcement learning, Representation learning, Research, Responsible AI, Safety & Alignment, Speech recognition, Transformers, Video generation

Learning to play Minecraft with Video PreTraining

We trained a neural network to play Minecraft by Video PreTraining (VPT) on a massive unlabeled video dataset of human Minecraft play, while using only

Community, Computer vision, Human feedback, Image generation, Language, Open source, Reasoning, Reinforcement learning, Research, Responsible AI, Safety & Alignment, Speech recognition, Transformers, Video generation

DALL·E 2 pre-training mitigations

In order to share the magic of DALL·E 2 with a broad audience, we needed to reduce the risks associated with powerful image generation models.

Community, Computer vision, Human feedback, Language, Open source, Reasoning, Reinforcement learning, Research, Responsible AI, Safety & Alignment, Speech recognition, Transformers, Video generation

Efficient training of language models to fill in the middle

Community, Computer vision, Human feedback, Language, Open source, Reasoning, Reinforcement learning, Research, Responsible AI, Safety & Alignment, Speech recognition, Transformers, Video generation

A hazard analysis framework for code synthesis large language models

Community, Computer vision, Human feedback, Language, Open source, Reasoning, Reinforcement learning, Research, Responsible AI, Safety & Alignment, Speech recognition, Transformers, Video generation

Introducing Whisper

We’ve trained and are open-sourcing a neural net called Whisper that approaches human level robustness and accuracy on English speech recognition.

Community, Computer vision, Human feedback, Language, Reasoning, Reinforcement learning, Research, Responsible AI, Safety & Alignment, Video generation

Scaling laws for reward model overoptimization

Community, Computer vision, Language, Reasoning, Research, Responsible AI, Safety & Alignment, Video generation

Point-E: A system for generating 3D point clouds from complex prompts

Community, Language, Reasoning, Research, Responsible AI, Safety & Alignment, Video generation

Forecasting potential misuses of language models for disinformation campaigns and how to reduce risk

OpenAI researchers collaborated with Georgetown University’s Center for Security and Emerging Technology and the Stanford Internet Observatory to investigate how large language models might be

Community, Language, Reasoning, Research, Responsible AI, Safety & Alignment, Video generation

GPT-4

We’ve created GPT-4, the latest milestone in OpenAI’s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs,

Community, Language, Reasoning, Research, Responsible AI, Safety & Alignment, Video generation

GPTs are GPTs: An early look at the labor market impact potential of large language models