1. For low quality paragraphs the Main problem mechanism created the highest average score differences.
2. The highlight and Q&A specific mechanisms are least valuable for low quality paragraphs because they are closely tied to the content of the paragraph and mechanisms that give the reviewer more freedom to transfer information are effective at enabling them to communicate major issues.
3. In practice, when given the option to provide free-form comments and edits, requesters often engaged in low-level fixes instead of communicating major problems.

Macalester College

The cost of communication with the system is relatively low, with an average of 10.6 minute to complete the task, 3.2/5 for mental demand of the task and 2.2/5 for hard work.
All researchers reported that they would be willing to use the system again in the future for writing tasks such as a blog post, the abstract, or introduction of a paper, but not for academic purposes or professional writing. 
They found that the paragraph matched what they would have written themselves in terms of content, but not writing style.

Result (Communicating Context to the Crowd for Complex Writing Tasks)

Salehi, N., Teevan, J., Iqbal, S., Kamar, E., (2017) Communicating Context to the Crowd for Complex Writing Tasks. Stanford University, Microsoft Research. 
http://dx.doi.org/10.1145/2998181.2998332

Learn Before

Related