Перейти к содержимому

Running Local AI Demo and Everything you need to Know!

The Tech Girl

0:00 / 0:00

Running Local AI Demo and Everything you need to Know!

135 469 просмотров · 1 мес. назад
The Tech Girl
140 тыс. подписчиков
135 469 просмотров · 1 мес. назад
Want to run AI locally on your own computer without relying on the cloud? In this video, I’ll show you exactly how Local AI works and how you can set it up on your Mac or PC. We’ll start from the absolute basics and break down confusing AI terms like AI models, model weights, parameters, inference, quantization, RAM, VRAM and unified memory in a way that actually makes sense. Then we’ll jump into a complete hands-on demo using LM Studio, where I’ll download a local AI model, load it onto my computer and use it just like ChatGPT. The best part? Once your model is downloaded, Local AI can run without an internet connection, keep processing on your own computer, and let you use the model repeatedly without paying a per-token or per-prompt fee. CHAPTERS 00:00 Why Run AI Locally? 00:51 What Is Local AI? 01:33 Cloud AI vs Local AI 02:00 What Are AI Model Weights? 02:40 Training vs Inference 03:29 What Do 8B, 14B & 70B Mean? 04:20 Quantization Explained — Q4 vs Q5 vs Q8 05:04 Storage vs RAM vs VRAM 05:40 How Much Memory Do You Need? 06:16 Setting Up Local AI With LM Studio 06:48 Choosing the Right AI Model 07:31 Downloading & Loading the Model 07:52 Running AI on Your Computer 08:05 Using AI Without Internet 08:40 Comparing Local AI Models 09:08 Context Length & Advanced Settings 09:37 Private AI & Local Documents 09:58 Offline & Unlimited AI Usage #LocalAI #ArtificialIntelligence #LMStudio #AI #Llama #OpenSourceAI #AITutorial #GenerativeAI #MacAI #PrivateAI Subscribe if you liked the video:    / @anjanagowtham   ❤ Anjana