Перейти к содержимому

Building a Dynamic RAG System | Job API + ChromaDB + Gemini | GenAI Series Ep 8

The Systems Mind

0:00 / 0:00

Building a Dynamic RAG System | Job API + ChromaDB + Gemini | GenAI Series Ep 8

43 просмотра · 4 мес. назад
The Systems Mind
54 подписчика
43 просмотра · 4 мес. назад
RAG Data Ingestion Tutorial | Learn how to build a ingestion pipeline for a Retrieval-Augmented Generation (RAG )system using Job APIs, Vector Databases, and Google Gemini. Welcome to Episode 8 of the “Generative AI & Agentic AI” Series 🚀 In the previous episode, we implemented a RAG-powered Resume Analyzer using static knowledge documents stored in a Vector Database. Now it's time to make our RAG system dynamic by ingesting job postings from external Job APIs 🔥 In this video, we will extend our Resume Analyzer and build a complete data ingestion pipeline that fetches real-time job data, processes it, and stores it inside a Vector Database for retrieval. In this video, we will explore: 👉 Fetching jobs from external Job APIs 👉 Building a data ingestion pipeline 👉 Data cleaning and normalization 👉 Creating embeddings from job descriptions 👉 Storing job data in ChromaDB 👉 Updating the Vector Database automatically 👉 Using job data during resume analysis Topics Covered: 📌 RAG Data Ingestion Pipeline 📌 Adzuna API Integration 📌 Data Cleaning and Preprocessing 📌 Embedding Generation 📌 Vector Database Updates 📌 Dynamic Knowledge Bases 📌 Semantic Search 📌 Context-Aware Resume Evaluation Project Overview: This project is an AI-powered Resume Analyzer that extracts resume content from PDF and DOCX files and uses Google Gemini to generate: ✅ Resume Scores ✅ Eligible Job Roles ✅ Improvement Suggestions To make the analysis more accurate and aligned with current market opportunities, we implement Retrieval-Augmented Generation (RAG) using ChromaDB and build a data ingestion pipeline that fetches live job postings from external APIs. The job data is cleaned, normalized, converted into embeddings, and stored in a Vector Database. When a resume is uploaded, the system retrieves relevant job information and domain knowledge from the Vector Database, enabling more accurate and context-aware evaluations instead of relying solely on the LLM's general knowledge. By the end of this video, you will understand how production-grade RAG systems keep their knowledge bases updated using automated data ingestion pipelines. This video is beginner-friendly and highly useful for developers learning: ✅ Generative AI ✅ RAG Implementation ✅ Data Ingestion Pipelines ✅ Google Gemini ✅ Vector Databases ✅ AI Engineering ✅ Enterprise AI Applications Links: GitHub Repository: https://github.com/the-systems-mind/Resume... Adzuna link: https://developer.adzuna.com/?utm_source=c... Adzuna login link: https://developer.adzuna.com/login