OpenAI

Classifier with Noisy Annotators

Members only

A classifier trains on data labeled by multiple human annotators, but some annotators are noisy. Task: identify the bad annotators, exclude their labels, check whether the classifier improves.