Build with AI 2026: Gemma day I Speaker: Tarun Jain
GDG Ahlen
0:00 / 0:00
Build with AI 2026: Gemma day I Speaker: Tarun Jain
252 просмотра · 2 мес. назад
GDG Ahlen
481 подписчик
252 просмотра · 2 мес. назад
Run On-Device AI Applications Without Internet Using Qdrant Edge and Google LiteRT | Tarun Jain | Build with AI 2026
Can you build a complete vector search and AI reasoning pipeline on embedded devices without sending a single byte over the internet? In this technical session from GDG Ahlen's virtual Build with AI 2026: Gemma Day, Tarun Jain explores how to architect fully offline, on-device AI applications.
Learn how to combine Qdrant Edge (an in-process vector search engine designed for resource-constrained hardware) with Google’s LiteRT to run Gemma 4 locally, creating self-contained retrieval and inference pipelines at the edge.
📌 What You’ll Learn in This Video:
• Getting started with Qdrant Edge for embedded, in-process vector search
• Deploying and running Gemma 4 locally with Google LiteRT on resource-constrained devices
• Building end-to-end on-device Retrieval-Augmented Generation (RAG) pipelines
• Designing resilient, zero-connectivity AI systems with absolute data privacy and ultra-low latency
👤 Speaker:
Tarun Jain — Software & AI Engineer specializing in edge computing, vector databases, and on-device machine learning architectures.
🔗 Resources & Links:
• you can refer to github.com/unslothai/unsloth
• for hands-on notebooks: github.com/unslothai/notebooks
• github.com/lucifertrj/offline-on-device-adi
• docs.google.com/presentation/d/1YV0S_A-DIOozD30fyAaOcxVH5Rf65pMlz3JtIGlw-aE/edit?usp=sharing
Recorded during the virtual Build with AI 2026: Gemma Day, organized by Google Developer Groups (GDG Ahlen).
#EdgeAI #Qdrant #LiteRT #Gemma #OnDeviceAI #VectorSearch #RAG #GDGAhlen #BuildWithAI #MachineLearning