Machine Learning

How Do You Grade the Graders?

Every AI system learns from humans who label data by hand. But who checks the humans? Building a quality system for a health hotline's annotators, with answer keys, hidden test questions, and all.