Перейти к содержимому

Amazon Bedrock Model Evaluation — Hands-On (AIP-C01)

Maruchin Tech

0:00 / 0:00

Amazon Bedrock Model Evaluation — Hands-On (AIP-C01)

91 просмотр · 13 дней назад
Maruchin Tech
471 подписчик
91 просмотр · 13 дней назад
Stop guessing which model is better — evaluate it with data. In this hands-on, we run Amazon Bedrock Model Evaluation in two modes: automatic evaluation (built-in metrics against reference answers) and LLM-as-a-Judge (a stronger model grades each response). We build the JSONL evaluation dataset, create both jobs, and aggregate the result files into comparable numbers with jq and awk. 📝 Full written version of this hands-on: https://dev.to/maruchin_tech_555/stop... 💻 Code & scripts (GitHub): https://github.com/maruchintech/bedro... 📚 Full course — AWS Certified Generative AI Developer Professional (AIP-C01) Exam Prep: https://www.udemy.com/course/aws-cert... 👨‍🏫 All my courses: (Eng) https://www.udemy.com/user/maruchin-t... (Jpn) https://www.udemy.com/user/shan-wang-... 🎫 Monthly discount coupons:    / @maruchintech-cloud