logo
How it worksCoursesResearch CommunitiesBenefitsAbout Us
Schedule Demo
Learn Before
Concept

Crowdsourcing Workflows: Introduction

  • Crowdsourcing marketplaces are increasingly used to solve computational problems that require human intelligence (i.e. audio transcription, data verification). -Many of these problems are solved via a series of microtasks; multiple microtasks are then chained together into workflows. -Such workflows may decompose larger tasks into smaller subtasks, and later recompose subtask solutions into an overall work product. -A fundamental challenge in the use of crowdsourcing markets is the workflow design problem: how cam employees divide a complex task into a set of microtasks that can be accurately solved by a pool of crowd workers?
  • Effective workflow design remains a major challenge, requiring substantial planning, software development, and testing, which can limit participation in crowdsourcing marketplaces and the kind of work that can be crowdsourced.
  • Researchers propose that the responsibility for workflow design can be shared between the crowd and the requester.
  • Turkomatic uses a novel meta-workflow to induce the crowd to design and execute workflows, utilizing a continuous price-divide-solve loop that asks workers to recursively divide complex steps into smaller ones until they are at an appropriately simple level, then to solve them.

0

1

Updated 2021-07-05

Contributors are:

Amelia Henriques
Amelia Henriques
🏆 1

Who are from:

Boston College
Boston College
🏆 1

References

Tags

Psychology

Social Science

Empirical Science

Science

Related