- A. Task unpredictability
- B. Workflow flexibility and design consistency
- C. Design iterations


Challenges Presented (A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design)

In order to shed light on potential workflows that could overcome the challenges discussed, researchers outline three experiments informing various aspects of a potential workflow:
- A. Decomposition by task owners versus by task workers
- B. Balancing flexibility and consistency
- C. Revising own tasks versus revising others’ tasks

Three Workflow Design experiments (A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design)

In order to make microtask crowdsourcing more supportive for interface design,   a workflow that can help task owners to break down interface design tasks more easily is needed. This paper briefly describes three experiments that help inform various aspects of workflow design for interface design through microtask crowdsourcing.


Macalester College

The use of microtasks to break down large-scale collaborative projects into small chunks that can be conducted individually and with little need for coordination between individual workers. 

Microtasks in Crowd Work

Mengyao Zhao and Andree van der Hoek (2015) A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design. 2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering. Department of Informatics. University of California, Irvine


A Brief Perspective on Microtask Crowdsourcing 
Workflows for Interface Design


A system of collaborative writing that breaks the process down into three types of microtasks: 

- 1) Idea Generation: wherein collaborators brainstorm and collect raw ideas to be included in the final report;

- 2) Labelling: wherein these ideas are labelled and organized into clusters based on relatedness;

- 3) Writing: wherein related ideas collected under the same label are merged into a single coherent paragraph.


MicroWriter

Approach to support communication of task context between requester and crowd workers using short, structured tasks. The goal is to reduce the effort of communication and maximize guidance. 

Structured Communication for Complex tasks 

Completing a set of microtasks in succession. The ways that microtasks are ordered in a chain affects the extent to which people complete the tasks productively and accurately and continue to engage with subsequent tasks.

Microtask Chaining

A marketplace for microtasks that helps people accomplish a variety of tasks with workers from all around the world in a less amount of time and cost compared to normal ways.


Amazon Mechanical Turk 

A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design


Tools for Crowd Work

This paper proposed a micro-tasking framework that supports skill development of individual workers. Researchers designed the framework based on the review of two micro-tasking projects we have conducted. It consists of four key components, a tutorial generator, a task dispatcher, a feedback visualizer, and a skill assessment engine. The framework will help developers create sustainable micro-tasking systems


Learn Before

Related

Learn After