RQ1: To what extent can text-based conversational interfaces support the execution of different types of crowdsourced microtasks?

Researchers addressed RQ1 by comparing execution time, quality of results, and satisfaction of workers who used the standard Web interface and with those who used the conversational interface.

Boston College

- The goal of the researchers is to further the understanding of how text-based conversational interfaces could serve as an alternative to the standard Web interfaces typically used for microtask crowdsourcing.
- Researchers carried out experiments to gauge the interest and acceptance of automated, text-based conversational work interfaces by crowd workers, while assessing their performance within different task types.
- Participants were recruited  from the FigureEight (F8) microwork platform.
- Researchers addressed five typical microtask types: information finding, human OCR (captcha), speech transcription, sentiment analysis, and image annotation.

Chatterbox: Original Contributions

Mavridis, P., Huang, O., Qiu, S.. Gadiraju, U., & Bozzon, A. (2019) Chatterbox: conversational interfaces for microtask crowdsourcing. Association for Computing Machinery, 243–251. DOI:https://doi-org.ezproxy.lib.uconn.edu/10.1145/3320435.3320439

Chatterbox: conversational interfaces for microtask crowdsourcing

Chatterbox: Research Question 1

RQ2: How do different types of UI input elements in conversational interfaces affect quality-related outcomes in microtasks?

Researchers addressed RQ2 by comparing different implementations of conversational UI elements for single and multiple input selections in microtasks.

Learn Before

Related