* Actions plans were found to be more helpful than the original comments. For the other two types of documents, it depends. 
* For early stage documents, unstructured plans were preferred more than vocabulary planning because they give more flexibility in creating plans for comments that are more reflection or deliberation oriented than task oriented. 
* For comments that are more concrete, vocabulary planning is better of providing granular steps.

Phase 3: Plan Evaluation Results

* For the online study, they used crowd workers as a proxy for wikipedia. 
* Randomly sampled 100 comments from the dataset of 768 and ask crowd workers to rank the comment, the unstructured and vocabulary plans in order of preference and to explain their rankings.
* For the Lab study, asked interns to rank the comments and plans left by their mentors and they used the same questions from the online study (ranking of comment, unstructured and vocabulary plans)
* Asked the interns to answer for all 12 comments left on the document.

University of Michigan - Ann Arbor

* Time: Vocabulary plans took less time to make than unstructured plans.
* Effort: No significant difference in any of the questionnaire questions for Unstructured vs vocabulary planning. However, for the additional vocabulary condition-only question, people felt that if they already knew the vocabulary without having to train or learn it, then the planning task would be less mentally demanding. 
* Granularity: Vocabulary plans had more steps (3) than unstructured plans (2)
* Atomicity: a 28% increase in mechanical steps between vocabulary based plans and comments and a 26% increase between vocabulary and unstructured plans. Vocabulary plans help people break down tasks better
* Sourcing potential: 28% increase in crowdsourcing  potential between comment and vocabulary planning and a 25% increase between unstructured and vocabulary planning. This means that vocabulary planning leads to planners using more steps that can be crowdsourced


Learn Before

Related

Learn After