logo
How it worksCoursesResearch CommunitiesBenefitsAbout Us
Schedule Demo
Learn Before
Concept

Crowdsourcing Workflows: Conclusion

  • This paper introduced Turkomatic, a system that harnesses crowds to design and execute workflows for complex tasks.
  • The system is based on a price-divide-price algorithm that guides workers through the steps of decomposing and solving tasks.
  • Researchers’ experience with Turkomatic suggests that unsupervised workers face planning challenges, but experiments also showed that planning succeeds for an interesting range of tasks when more knowledgeable workers are recruited and when requesters can review and edit crowd work in real-time.
  • The one-size-fits-all model of Turkomatic trades off simplicity of use for runtime supervision; workflows can be generated without exhaustive planning, but require requester monitoring at runtime to guarantee quality of results.

0

1

Updated 2021-07-05

Contributors are:

Amelia Henriques
Amelia Henriques
🏆 1

Who are from:

Boston College
Boston College
🏆 1

References

Tags

Psychology

Social Science

Empirical Science

Science

Related