Crowdsourcing Lunch Seminar "DialCrowd: Crowdsourcing for Dummies"

Abstract:
Robust testing of (spoken) dialog systems requires large numbers of real users who can try the system out. Crowdsourcing offers the possibility to recruit such users, but entails considerable time and effort for designers  in familiarization with platforms and learning how to design and implement suitable tests. Moreover, researchers (the requesters) have to overcome the following difficulties: connecting the dialog systems that are to be assessed to the crowdsourcing platform, paying the workers with fair wage, assessing the quality of the workers' production, getting solid final results. DialCrowd makes system assessment using crowdsourcing easier by providing tools, templates, analytics, and quality controls to allow designers and researchers to quickly implement high quality and effective recruitment and testing. This 'crowdsourcing for dummies' approach saves research time and resources, and will help ensure high quality in research and results.

Lunch will be provided.  If you plan to attend, please sign up here:

https://doodle.com/poll/udrbseyq4rxnmec9

For the Crowdsourcing Lunch Seminar please go to:

http://cmu-crowd.blogspot.com/p/about-seminar.html

To subscribe Crowdsourcing Lunch Seminar mailing list:

https://mailman.srv.cs.cmu.edu/mailman/listinfo/crowdsourcing-lunch​