Перейти к содержимому

Three months wrong about why my 4-node AMD cluster was slow

Alex Ziskind

0:00 / 0:00

Three months wrong about why my 4-node AMD cluster was slow

219 555 просмотров · 3 месяца назад
Alex Ziskind
554 тыс. подписчиков
219 555 просмотров · 3 месяца назад
Three months on a 4-node Minisforum MS-S1 Max Strix Halo cluster, and the one assumption that was quietly killing my inference speed. Try out ChatLLM - http://chatllm.abacus.ai/ltf and Abacus AI DeepAgent - http://deepagent.abacus.ai/ltf 🛒 Gear Links 🛒 👀 2 400Gbps switch: https://bhpho.to/4r9vJi1 👀👀 4 400Gbps switch: https://bhpho.to/4qQqOlI 💻☕ Thunderbolt 5 external SSD: https://amzn.to/3XqetZO 💻☕ Favorite 15" display with magnet: https://amzn.to/3zD1DhQ 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo 📦🎮 My gear: https://www.amazon.com/shop/alexziskind 🎥 Related Videos 🎥 🏆 Skip M3 Ultra & RTX 5090 for LLMs | NEW 96GB KING -    • Skip M3 Ultra & RTX 5090 for LLMs | NEW 96...   💻 Smallest RTX Pro 6000 rig | OVERKILL -    • Going up against Apple's Ultra   🔧 Cheap mini runs a 70B LLM 🤯 -    • Cheap mini runs a 70B LLM 🤯   🌙 RAM torture test on Mac -    • TRUTH about RAM vs SSD UPGRADES for MacBook   🚀 FREE Local LLMs on Apple Silicon | FAST! -    • FREE Local LLMs on Apple Silicon | FAST!   🪞 REALITY vs Apple’s Memory Claims | vs RTX4090m -    • REALITY vs Apple’s Memory Claims | vs RTX4...   📦 Set up Conda -    • python environment setup on Apple Silicon ...   🤖 INSANE Machine Learning on Neural Engine -    • INSANE Machine Learning on Neural Engine |...   🛠️ Developer productivity Playlist -    • Developer Productivity   🔗 AI for Coding Playlist: 📚 -    • AI   — — — — — — — — — ❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe:    / @azisk   — — — — — — — — — Join this channel to get access to perks:    / @azisk   — — — — — — — — — 📱 ALEX ON X:   / digitalix   Donato's channel:    / @donatocapitella   #macmini #llm #nvidia