- Providing workers with a birds-eye view of the overall decomposition is critical.
- Workers may become confused if their role in the larger process is not made explicit, and workers may need to refer to information contained in prior answers to adequately solve their sub-task.
- To communicate the larger goal, and the work completed towards this goal, Turkomatic shows an indented list view of the decomposition generated by other workers, highlighting the current subtask.
- Developers reserve further study of the optimal amount of context information that should be presented to future work.

Boston College

- Designing general-purpose HITs that fit a wide variety of tasks while still conveying specific requirements of the decomposition and merge phases to a worker is challenging.
- Two design techniques proceed especially useful and necessary: including larger task context in subtasks, and visually separating task language from context language.

Additional Sections:
- Show Context of Tasks in a Workflow
- Visually Separate Task Language from Context Language

Crowdsourcing Workflows: Task Design Strategies

Kulkarni, A., Can, M., & Harmann, B. (2012). Collaboratively crowdsourcing workflows with Turkomatic. Association for Computing Machinery, 1003-1012. DOI: https://doi.org/10.1145/2145204.2145354 

Collaboratively crowdsourcing workflows with Turkomatic

Crowdsourcing Workflows: Show Context of Tasks in a Workflow

- The HITs for subdivide and merge steps contain complex information and require careful attention of the worker.
- Workers can have difficulty identifying which task in a complex plan they were bring asked to carry out.
- Developers used background colors to emphasize and separate the primary task instructions from explanatory and context information.

Learn Before

Related