Cost forecasting is a technique that allows the crowdsourcer to decide between having the crowd generate more tasks or letting the crowd complete some of the already-generated tasks to more efficiently balance resources in a situation where crowdworkers are both proposing new tasks and completing them.

(Proposed in the paper Efficient crowdsouring of crowd-generated microtasks.)

Cost Forecasting

A bursty process is characterized by long pauses of nonactivity interrupted by sudden bursts of activity. Bursty processes tend to follow power-law distributions.

Bursty Processes (needs a new parent)

Disadvantages of Algorithmic Crowdsourcing

1. Efficiently and accurately gathering responses
2. Maximizes accuracy

Advantages of Algorithmic Crowdsourcing

Algorithmic crowdsourcing concentrates on computational approaches to solving the problems caused by introducing crowdworkers.

University of Rochester

The practice of completing microtasks by using a group of remote workers.

Microtask Crowdsourcing

Hotaling, A., &amp; Bagrow, J. P. (2020). Efficient crowdsourcing of crowd-generated microtasks. PLOS ONE, 15(12). https://doi.org/10.1371/journal.pone.0244245 

Efficient crowdsourcing of crowd-generated microtasks

The process of preparing jobs for  the crowdsourcing marketplace requires planning, as well as the development of an efficient workflow design. Researchers of this study introduce the program Turkomatic, which aims to recruit crowdworkers to develop workflows for larger tasks, where their goal is to break a job down into microtasks which can then be completed by other crowdsource workers. Results suggest that allowing independent crowdworkers to develop the workflow design is partially successful without requester supervision, but requester supervision during workflow planning and execution improves results dramatically. Researchers argue that Turkomatic’s design will be more successful than the conventional workflow design process.

Collaboratively crowdsourcing workflows with Turkomatic

Conversational interfaces can facilitate human-computer interactions, but researchers still speculate as to if conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces. Researchers explore this concept by designing Chatterbox, aimed at gauging the interest and acceptance by crowdworkers for this type of interface. Results suggest that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in high satisfaction from workers without a negative impact on task execution time or work quality.

Chatterbox: conversational interfaces for microtask crowdsourcing

This paper proposed a micro-tasking framework that supports skill development of individual workers. Researchers designed the framework based on the review of two micro-tasking projects we have conducted. It consists of four key components, a tutorial generator, a task dispatcher, a feedback visualizer, and a skill assessment engine. The framework will help developers create sustainable micro-tasking systems


Skill Development Framework for Micro-Tasking

Priming has been used in the realms of psychology as a way to alter people's behaviors or performance. It can be overt (supraliminal) or covert (subliminal). A subsequent behavior, which is a result of the priming, occurs typically without conscious awareness. In the field of microtask crowdsourcing, multiple types of primes have been used to increase and alter people's performance.

Priming to Increase Performance in Microtask Crowdsourcing

Algorithmic Crowdsourcing

Having individuals with skill carrying out research and technical tasks for payment. 

Enterprise Crowdsourcing

Microtasking models include primitive tasks—simple, repetitive, centrally managed work requiring little expertise—and task modularization, which divides larger problems into modules whose solutions can be recombined. In emergency crowdsourcing, effective management must coordinate this work and account for workers' individual differences and goals.

Learn Before

Related

Learn After