1Cademy - Chain Reactions: The Impact of Order on Microtask Chains--Methods, Determining Complexity

Relation

Chain Reactions: The Impact of Order on Microtask Chains--Methods, Determining Complexity

In order to test each hypothesis, it was necessary to identify sets of "easy" and "hard" operations. To identify the complexity of each proposed operation, a between-subject study was conducted recruiting participants from Amazon Mechanical Turk. Researchers analyzed how task complexity compared along the lines of semantic processing (extent to which meaning is processed during a task), time (spent on task), mental demand, interest, meaningfulness, and open-endedness.
Participants were randomly assigned an operation and completed it on a given sentence. They then answered subjective questions about the microtask (to assess mental demand, interest, meaningfulness, open-endedness) and multiple choice questions about the objective meaning of the sentence (to assess semantic processing). A baseline condition was included for this assessment. All sentences were held constant.
As expected, semantics-based microtasks exhibited greater semantic processing, took longer to complete, presented more mental demand, and were considered more open-ended. There were significant differences found between mechanical and semantic operations as well. Crowd-based microtasks shared similarities with both mechanical and semantic operations (shorter time and lower mental demand, but higher levels of open-endedness, meaning, and interest). High, medium, and low complexity tasks were selected for inclusion in further study based on these results.

0

2

Updated 2021-06-15

Contributors are:

Who are from:

References