Reinforcement Learning Training Code: Tensor parallelism With Ray Placement Groups
Clarence Lee
0:00 / 0:00
Reinforcement Learning Training Code: Tensor parallelism With Ray Placement Groups
258 просмотров · 2 недели назад
Clarence Lee
56 подписчиков
258 просмотров · 2 недели назад
In this channel, we run a deep dive of how production grade RL engines work by breaking it down into smaller concepts, we go through each concept with live coding examples to help you understand how to implement it. In this episode we go through how to implement tensor parallelism with ray placement groups.
Code files: https://github.com/clarence-lee-sheng...