verifying crowdsourced labels
Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm - Dawid, Skene seems like the original paper that loads of things are based off of. This seems like a reasonable implementationespecially the hybrid algorithm -H
Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise also seems neat, but I was unable to get the code working.
Quality management on Amazon Mechanical Turk has a nice github page.
Learning from the Wisdom of the Crowds by Minimax Entropy-Zhou and The Multidimensional Wisdom of Crowds-Welinder both seem interesting, but have no software implementation
