Judging facts, judging norms: Training machine learning models to judge humans requires a modified approach to labeling data

Aparna Balagopalan, David Madras, David H Yang, Dylan Hadfield-Menell, Gillian K Hadfield, Marzyeh Ghassemi