The Grant Review Committee Has a Consistency Problem

Five reviewers read the same proposal against the same rubric, and five different scores come back. Which one is right? If your committee can't answer that, your grants are being decided by which reviewers each proposal drew, not by the strength of the proposal. 👇 In this webinar, Reviewr shows grant administrators why reviewers disagree and how to build a committee that scores consistently, in six moves. It's framed through Review Integrity, a five-dimension framework for judging how well an application and award program runs, with a close look at Rubric Clarity, Reviewer Calibration, and Decision Traceability. What you'll see: ✅ Why even expert reviewers disagree, including a 2018 study of 43 reviewers scoring 25 real NIH grant applications ✅ The four reasons scores split: different lenses, different scales, different anchors, and vague criteria ✅ What inconsistency costs: decisions you can't defend, reviewers who don't return, and funding that drifts from board strategy ✅ How to rewrite vague questions into anchored response options that guide a decision ✅ How to weight criteria to what your board values, with totals calculated automatically ✅ How to treat outliers as a question, not an error: read, ask, discuss, document ✅ How AI summaries, baseline scoring, and AI detection add context while your team makes the decisions ✅ What a decision record needs so anyone could reconstruct why a grant was funded a year from now Plus a full live demo inside Reviewr, including: 🎥 Accounts with auto-saved progress for applicants and judges 🎥 Review assignments: auto-assign with minimums and maximums, manual matching, or assign all 🎥 The reviewer portal: assigned submissions, statuses, and each judge's own scores side by side 🎥 Data redaction so judges who know applicants can still score fairly 🎥 Side-by-side submission and scorecard with running score totals and comment boxes Timestamps: 0:00 Welcome and about Reviewr 1:45 Today's topic and agenda 2:45 Five reviewers, five different scores 3:30 What the research shows: experts don't agree 4:15 Why reviewers score differently: lenses, scales, anchors, vague criteria 6:00 What inconsistency costs your grant program 7:45 Review Integrity: five questions every review process should answer 9:00 Rubric Clarity: criteria that guide a decision 10:00 Anchored response options: the budget question example 11:00 Weighting criteria to what your board values 12:45 Judge guidance, shuffled reading order, and automatic reminders 14:15 Reviewer Calibration: outliers show you where to look 15:30 An outlier is a question: read, ask, discuss, document 17:00 AI adds context, people make the decision 19:30 Decision Traceability: could someone reconstruct why a grant was funded? 21:15 Self-check: where is your committee today? 22:45 Recap: six moves toward a consistent committee 24:00 Live demo: accounts and saved progress 26:00 Live demo: review assignments 27:00 Live demo: the reviewer portal and data redaction 28:00 Live demo: scoring side by side 29:30 Q&A When every reviewer works from the same anchored, weighted scorecard, your funding decisions reflect the proposals, not the luck of the draw. 🔗 Book a demo: https://calendly.com/reviewrsoftware/... #GrantManagement #GrantReview #Grantmaking #Philanthropy #Nonprofit #Reviewr