Conference paper
GeAnn at the TREC 2011 crowdsourcing track
NIST Special Publication
01/2011
Abstract
Relevance assessments of information retrieval results are often created by domain experts. This expertise is typically expensive in terms of money or personal effort. The TREC 2011 crowdsourcing track aims to evaluate different strategies of crowdsourcing relevance judgements. This work describes the joint participation of Delft University of Technology and The University of Iowa, using GeAnn, a term association game, we generate relevance judgements in an engaging way that encourages quality submissions, which otherwise would have to be motivated through rigid quality control mechanisms and additional incentives such as higher monetary rewards.
Details
- Title: Subtitle
- GeAnn at the TREC 2011 crowdsourcing track
- Creators
- Carsten EickhoffChristopher G Harris - University of IowaPadmini Srinivasan - University of Iowa, Computer ScienceArjen P De Vries
- Resource Type
- Conference paper
- Conference
- NIST Special Publication
- Number of pages
- 7
- Comment
- Is part of ISBN: 1048776X
- Language
- English
- Date published
- 01/2011
- Academic Unit
- Business Analytics; Computer Science; Nursing
- Record Identifier
- 9984013491802771
Metrics
9 Record Views