LLM-as-a-Judge Evaluation for Dataset Experiments in Langfuse
Langfuse
0:00 / 0:00
LLM-as-a-Judge Evaluation for Dataset Experiments in Langfuse
15 055 просмотров · 1 год назад
Langfuse
4,42 тыс. подписчиков
15 055 просмотров · 1 год назад
🚀 Introducing LLM-as-a-judge Evaluation for Dataset Experiments in Langfuse
Learn how to reliably evaluate your LLM application changes using Langfuse's new managed LLM-as-a-judge evaluators. This feature helps teams:
• Automatically evaluate experiment runs against test datasets
• Compare metrics across different versions
• Identify regressions before they hit production
• Score outputs based on criteria like hallucination, helpfulness, relevance, and more
Works with popular LLM providers including OpenAI, Anthropic, Azure OpenAI, and AWS Bedrock through function calling.
🔗 Learn more at https://langfuse.com/changelog/2024-1...