First, we develop a robust rubric—a scoring guide that reflects your intent and success metrics; evaluative criteria and definitions for those criteria; and a scoring strategy. Valid Eval rubrics are built in consultation with domain experts to ensure that evaluation criteria are relevant and easy to understand.
Once the rubric is loaded into the system, judges log on to find an intuitive interface that guides them through a series of scoring dimensions. Valid Eval automatically assigns evaluators based on the relevance of their expertise.
Heat maps and data visualizations display detailed information, including relative performance and areas of evaluator agreement and disagreement. Valid Eval documents carefully considered expert opinions, produces auditable records, and packages detailed feedback and practical suggestions for applicants.