913: LLM Pre-Training and Post-Training 101 — with Julien Launay

#PythonCode #AdaptiveML #LLM Julien Launay launched Adaptive to give data science teams in business enterprises their “RLOps tooling” to make reinforcement learning easier. Talking to ‪@JonKrohnLearns‬ Julien says, “Most of our users are data scientists who write Python codes to interface with the system”. Adaptive is also able to work with companies without data science teams, collaborating with partners like Deloitte to add the necessary personnel. Julien is currently working on making his platform more widely available. This episode is brought to you by: • Trainium2, the latest AI chip from AWS: https://aws.amazon.com/ai/machine-lea... Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: • (00:00:00) Introduction • (00:04:18) How to create an LLM • (00:10:58) The types of reinforcement learning • (00:27:32) About Adaptive • (00:49:58) Is synthetic data the future of reinforcement learning • (00:54:22) The future of hardware Additional materials: https://www.superdatascience.com/913