An Efficient, Effective Assessment Strategy for the GenAI Era with a Computer-Based Testing Facility

The rapid rise in genAI capabilities has been a shock to the educational system. GenAI can trivially do most of the well-specified assessment activities that help our students build basic skills in a domain. Educational theory (e.g., constructivism) suggests that building these basic skills remains important to develop higher-level skills. Many instructors are struggling, however, to ensure that their students are learning these basic skills, finding themselves pushed back into in-person paper-based exams and shifting a larger fraction of the student’s grade into a few large assessments, increasing student anxiety. In this talk, I’ve outlined a more modern, holistic strategy for assessment, that focuses on a "two-lane" approach, where the student’s fluency of building block skills is assessed without access to AI (lane 1) and students proficiency with using genAI to solve incompletely specified problems is assessed with open-ended projects (lane 2). In the proposed implementation, lane 1 is highly automated through the use of a Computer-Based Testing Facility (CBTF), allowing frequent, small exams with re-take opportunities to ensure mastery of these concepts with low student anxiety and almost no effort from the course staff. Automating lane 1 frees up course staff to focus on assisting student learning and lane 2 assessment. I’ve discussed the campus’s CBTF and show data representative of the benefit of frequent and second-chance testing on student learning and test anxiety.