- The recruited workers might not be representative of the whole population of crowd workers.
- To minimize the effect of user interface usability issues, researchers designed task interfaces that were either standard or simplified.
- Not all workers were familiar with the Telegram messaging system, but researchers believe in the presence of a web client to have minimized the risk of poor performance due to lack of experience with messaging systems.

Boston College

- Results show that chatbots could be a suitable alternative to Web-based microwork platforms, at least for the considered task types, both in terms of execution time and quality.
- Although a direct comparison is not possible, the results matched the outcome of previous studies with mobile UIs.
- Workers expressed positive opinions about this work interface modality.
- The obtained results are promising, and the researchers’ takeaway from the whole experimental procedure and the results is that the flexibility for the interface to be used, the design of the interface, and the task itself are all important factors to consider when building crowdsourcing tasks for conversational interfaces.
- Researchers argue that the use of conversational interfaces for crowd work can provide a number of potential benefits, such as the further democratization of crowd work, increased workers diversity, and increased workers capacity for low-latency and/or situational microtask crowdsourcing.

Chatterbox: Discussion and Implications

Mavridis, P., Huang, O., Qiu, S.. Gadiraju, U., & Bozzon, A. (2019) Chatterbox: conversational interfaces for microtask crowdsourcing. Association for Computing Machinery, 243–251. DOI:https://doi-org.ezproxy.lib.uconn.edu/10.1145/3320435.3320439

Learn Before

Related