Amazon Bedrock Model Evaluation — Hands-On (AIP-C01)
Maruchin Tech
0:00 / 0:00
Amazon Bedrock Model Evaluation — Hands-On (AIP-C01)
91 просмотр · 13 дней назад
Maruchin Tech
471 подписчик
91 просмотр · 13 дней назад
Stop guessing which model is better — evaluate it with data. In this hands-on, we run Amazon Bedrock Model Evaluation in two modes: automatic evaluation (built-in metrics against reference answers) and LLM-as-a-Judge (a stronger model grades each response). We build the JSONL evaluation dataset, create both jobs, and aggregate the result files into comparable numbers with jq and awk.
📝 Full written version of this hands-on:
https://dev.to/maruchin_tech_555/stop...
💻 Code & scripts (GitHub):
https://github.com/maruchintech/bedro...
📚 Full course — AWS Certified Generative AI Developer Professional (AIP-C01) Exam Prep:
https://www.udemy.com/course/aws-cert...
👨🏫 All my courses:
(Eng) https://www.udemy.com/user/maruchin-t...
(Jpn) https://www.udemy.com/user/shan-wang-...
🎫 Monthly discount coupons:
/ @maruchintech-cloud