Running Local AI Demo and Everything you need to Know!
The Tech Girl
0:00 / 0:00
Running Local AI Demo and Everything you need to Know!
135 469 просмотров · 1 мес. назад
The Tech Girl
140 тыс. подписчиков
135 469 просмотров · 1 мес. назад
Want to run AI locally on your own computer without relying on the cloud? In this video, I’ll show you exactly how Local AI works and how you can set it up on your Mac or PC.
We’ll start from the absolute basics and break down confusing AI terms like AI models, model weights, parameters, inference, quantization, RAM, VRAM and unified memory in a way that actually makes sense. Then we’ll jump into a complete hands-on demo using LM Studio, where I’ll download a local AI model, load it onto my computer and use it just like ChatGPT.
The best part? Once your model is downloaded, Local AI can run without an internet connection, keep processing on your own computer, and let you use the model repeatedly without paying a per-token or per-prompt fee.
CHAPTERS
00:00 Why Run AI Locally?
00:51 What Is Local AI?
01:33 Cloud AI vs Local AI
02:00 What Are AI Model Weights?
02:40 Training vs Inference
03:29 What Do 8B, 14B & 70B Mean?
04:20 Quantization Explained — Q4 vs Q5 vs Q8
05:04 Storage vs RAM vs VRAM
05:40 How Much Memory Do You Need?
06:16 Setting Up Local AI With LM Studio
06:48 Choosing the Right AI Model
07:31 Downloading & Loading the Model
07:52 Running AI on Your Computer
08:05 Using AI Without Internet
08:40 Comparing Local AI Models
09:08 Context Length & Advanced Settings
09:37 Private AI & Local Documents
09:58 Offline & Unlimited AI Usage
#LocalAI #ArtificialIntelligence #LMStudio #AI #Llama #OpenSourceAI #AITutorial #GenerativeAI #MacAI #PrivateAI
Subscribe if you liked the video: / @anjanagowtham
❤ Anjana