State of GPT

Some content could not be imported from the original document. View content ↗

Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions.

AI captioning languages supported: Arabic, Bulgarian, Chinese Simplified, Chinese Traditional, Czech, Danish, Dutch, English, Finnish, French, French Canadian, German, Greek, Hindi, Hungarian, Italian, Japanese, Korean, Norwegian, Polish, Portuguese, Portuguese (Brazil), Portuguese(Portugal), Romanian, Russian, Slovak, Slovenian, Spanish, Swedish, Thai, Turkish, Ukrainian

Speakers

Profile picture of Andrej Karpathy
Andrej Karpathy is a researcher and a founding team member at OpenAI. From 2017 to 2022, he was the Director of AI at Tesla, leading the computer vision team for Tesla Autopilot. He received his PhD in Computer Science from Stanford, where he developed early multimodal deep neural networks that processed both images and text, for example, for image captioning applications.He was also the primary instructor for CS231n, the first deep learning class at Stanford, which he designed, and which went on to become one of the largest classes in the AI curriculum.

Session Evaluation

The presentation of the session was effective.Strongly agreeAgreeNeutralDisagreeStrongly disagreeNot sure/Not applicable