Перейти к содержимому

Getting Started with Local AI (2/3)

vBrownBag

0:00 / 0:00

Getting Started with Local AI (2/3)

137 просмотров · Трансляция закончилась 3 месяца назад
vBrownBag
15,9 тыс. подписчиков
137 просмотров · Трансляция закончилась 3 месяца назад
Episode 2 of 3 with Du'An Lightfoot. You've got a model running locally — now how do you actually serve it? In this episode we take that single laptop instance and put it behind an API, then walk through standing it up on a cloud VM/VPC so you can serve inference to your own apps (or yourself) instead of just chatting in a terminal. We cover the jump from "it runs on my machine" to "it's a reachable endpoint," and what changes about hardware, networking, and access once inference leaves your laptop.