Calibrate Beliefs, Not Answers - Dev Log
Uncertain Systems
0:00 / 0:00
Calibrate Beliefs, Not Answers - Dev Log
30 просмотров · 6 дн. назад
Uncertain Systems
2,66 тыс. подписчиков
30 просмотров · 6 дн. назад
How do you measure what someone believes they know, without grading their answers?
Working through knowledge calibration live. The first idea scored people against an answer key, which punishes a real expert who is sure. The better direction: draft a path through the topic, pull out frozen states along it, shuffle them, and let the person sort "I could answer this" from "this would surprise me". The pattern is the measurement. To check those labels are grounded, they pick from frozen options instead of writing, so no LLM judge is needed. Still open: making it simple, and whether it should even be a canvas.
Learn more: https://academy-k.com