<校園專題演講>Mark Chen from OpenAI, From Compression to ChatGPT, 27-Sep-2023, 1:30pm, 清華大學旺宏館國際會議廳

Speaker: Mark Chen, Head of Multimodal and Frontiers Research, OpenAI

Title: From Compression to ChatGPT

Abstract: This talk offers a look into how ChatGPT was created. We begin with an introduction to GPT models and the reasons OpenAI invested so heavily in them, with a focus on compression and scaling laws. We then delve into our use of Reinforcement Learning from Human Feedback (RLHF) to transform these GPT models into user-friendly ChatGPT models. We end with a discussion of how ChatGPT can be trained to use external tools, such as a browser.
Bio: Mark Chen is the Head of Frontiers Research at OpenAI, where he focuses on multimodal modeling and reasoning research. He led the team that created DALL·E, and the team that incorporated visual perception into GPT-4. Mark also led Codex's development and contributed to the advancement of GPT models, including the development of Image GPT.

Prior to joining OpenAI, Mark worked as a quantitative trader at several proprietary trading firms, including Jane Street Capital, where he built machine learning algorithms for equities and futures trading. He graduated from MIT with a bachelor's degree in mathematics with computer science, and is also a coach for the USA Computing Olympiad team.