Researchers have hypothesized three factors that may increase the difficulty of creating action plans from feedback comments during document collaboration:

1. Stage of the Document: Mentors often find it more difficult and context-dependent to create action plans for early-stage initial drafts compared to documents in the core writing and editing stages.
2. Domain Knowledge: Writing that requires high domain knowledge (e.g., academic articles) is less conducive to creating consistent action plans than writing with low domain-specific knowledge requirements (e.g., Wikipedia articles) (Kaur et al., 2018).
3. Interpersonal Relationships: Unlike democratized platforms like Wikipedia, academic writing often relies on an apprenticeship model. This dynamic allows mentors to use writing collaboration to teach mentees how to write, which changes the types of tasks and comments they leave.

Factors Influencing Action Planning Difficulty in Document Review

* Actions plans were found to be more helpful than the original comments. For the other two types of documents, it depends. 
* For early stage documents, unstructured plans were preferred more than vocabulary planning because they give more flexibility in creating plans for comments that are more reflection or deliberation oriented than task oriented. 
* For comments that are more concrete, vocabulary planning is better of providing granular steps.

University of Michigan - Ann Arbor

* For the online study, they used crowd workers as a proxy for wikipedia. 
* Randomly sampled 100 comments from the dataset of 768 and ask crowd workers to rank the comment, the unstructured and vocabulary plans in order of preference and to explain their rankings.
* For the Lab study, asked interns to rank the comments and plans left by their mentors and they used the same questions from the online study (ranking of comment, unstructured and vocabulary plans)
* Asked the interns to answer for all 12 comments left on the document.

Learn Before

Related

Learn After