Model routing | AI system design | Nextia Learning

Compare a small model first, a strong model only and a routed design on the same questions, with an escalation rule and measured quality, latency and cost. Where we are: In Module 3, we priced the design, and the sensitivity table showed its biggest risk: the strong model for every answer. But is a stronger model even better for our questions? In this lesson, we measure three designs on Grace's 67 questions: the small model only, the strong model only, and a routed design. We start with a bank's help line with two levels. Lesson: https://learning.nextia-ai.com/course... Course: AI System Design and Cost Engineering https://learning.nextia-ai.com/course... Chapters: 0:00 Introduction 0:16 A help line with two levels 0:50 A better model for every answer? 1:31 Model routing 2:23 Five questions 3:20 Three designs, one workload 4:02 Why routing did not help 5:26 When to use routing 6:13 Recap Nextia Learning is free: every course and every certificate. Read the full lesson, run the notebook and answer the knowledge checks on the lesson page. En français:    • Routage entre modèles | Conception de syst...   #NextiaLearning #LearnAI