Communications of the ACM
Making Crowdsourcing More Reliable
University of Southampton researcher Victor Naroditskiy
Credit: Victor Naroditskiy
One of the major obstacles in crowdsourcing information gathering is the reliability of collected reports, but researchers at the University of Southampton and the University of California, San Diego say they have developed methods for solving this problem. The researchers' methods involve crowdsourcing verification as well as information gathering.
"The success of an information-gathering task relies on the ability to identify trustworthy information reports, while false reports are bound to appear either due to honest mistakes or sabotage attempts," says Southampton researcher Victor Naroditskiy. "This information verification problem is a difficult task, which, just like the information-gathering task, requires the involvement of a large number of people."
The researchers have developed methods for combining incentives to recruit participants to verify information, according to Madsar Institute professor Iyad Rahwan. The methods involve compensations to the recruiter and to the reporting participant for submitting the correct report, as well as penalties for incorrect reports, which ensures the recruiter will perform verification.
From University of Southampton (United Kingdom)
View Full Article
Abstracts Copyright © 2012 Information Inc., Bethesda, Maryland, USA
No entries found