Deep Learning From Multiple Noisy Annotators as A Union.

Crowdsourcing is a popular solution for large-scale data annotations. So far, various end-to-end deep learning methods have been proposed to improve the practical performance of learning from crowds. Despite their practical effectiveness, most of them have two major limitations-they do not hold learning consistency and suffer from computational inefficiency.