How to Use 2 (or more) NVIDIA GPUs to Speed Keras/TensorFlow Deep Learning Training

Dual GPU systems are becoming much more of a "deep learning thing" than a "gamer thing". But what will two (or more) GPUs on a single system actually get you? In this video, I show how to actually use two GPU's and how it can nearly cut your training time in half; under the right circumstances. We make use of a Lenovo P920 with dual Quadro GTX 8000 GPUs. Code here: https://github.com/jeffheaton/present... Install TensorFlow GPU: Windows:    • Installing TensorFlow/Keras CPU/GPU w/COND...   Linux:    • 2020, TensorFlow 2.2 NVIDIA GPU (CUDA)/CPU...   Which GPU to get?    • How to Choose an NVIDIA GPU for Deep Learn...   ** Follow Me on Social Media! GitHub: https://github.com/jeffheaton Twitter:   / jeffheaton   Instagram:   / jeffheatondotcom   TicTok:   / heatonresearch   Discord:   / discord   Patreon:   / jeffheaton