Residual Vector Quantization (RVQ) From Scratch

Code: https://github.com/priyammaz/PyTorch-... VQVAE Prereq:    • Vector Quantized Variational AutoEncoder (...   Today we learn an extension to the VQVAE architecture, Residual Vector Quantization. This technique is especially important in Audio Codec models, so lets take a look and see the basics of what's going on! Timestamps: 00:00:00 - Recap VQVAE 00:02:14 - What is Residual Vector Quantization? 00:09:10 - Starting the Implementation 00:11:29 - Implement a Linear RVQ 00:35:41 - A quick look at SoundStream 00:40:25 - Getting and Decoding Code Indexes Socials! X   / data_adventurer   Instagram   / nixielights   Linkedin   / priyammaz   Discord   / discord   🚀 Github: https://github.com/priyammaz 🌐 Website: https://www.priyammazumdar.com/