Learn Before
Concept
Crowdsourcing Workflows: Editing Workflows
- Ongoing work can be unsatisfactory for multiple reasons: a crowd-authored decomposition may be flawed, or a solution to a subtask may be of low quality.
- Requesters can edit existing workflows in real-time to address such challenges.
- Requesters edit the task description, decomposition, or solution for any one node; once an edit is completed, Turkomatic computes which tasks will have to be performed again by additional workers.
- When a task description is changed, any subtasks created for this task by the crowd may also no longer be valid, so Turkomatic then invalidates the entire subtree below the edited task and reissues the tasks.
- When a requester edits a task solution or decomposition directly, the entire subtree of that task is discarded.
0
1
Updated 2021-07-05
Tags
Psychology
Social Science
Empirical Science
Science