Survey:
Invited ~11,000 new editors to use the tutorial by using the Wiki talks page. Afterward, they were sent a survey that asked about their confidence and engagement in editing Wikipedia.


Field Experiment:
Selected 1,967 accounts for this experiment, 1,751 accounts were randomly selected for the treatment group and were invited to use the tutorial. The remaining 216 accounts were assigned to a control group and were not invited to the tutorial.

Each group was being observed for their editing behavior 180 days since they were invited/not invited


University of Michigan - Ann Arbor

Purpose:
- How new users perceive the system design and tone (via survey~11,000 editors)
- If using TWA led to making more contributions prior to being invited to participate in the tutorial (via field experiment~1,967 editors)

Results:
- From the survey, users found TWA engaging and well-designed for new users.
- Even though new users say that TWA is very useful and helps new editors, the results from the field experiment report that TWA did not effect editing contributions)


Purpose and Summary of Results

Methods

- 91% of respondents said that TWA is an useful introduction to edit Wikipedia

- 90% of respondents agreed (strongly agreed) that TWA made them feel more confident as an editor and helped them develop a better understanding of Wikipedia

- 85% said that TWA is very useful on reviewing Wiki's policies

- 80% responded that TWA encourages them to make more edits. They also reported that they felt welcome and supported

Survey Results

- 22% of those invited complete some part of the tutorial
- 46% editors played till the seventh and final mission
- The first mission lost the most editors at 24% after completion. 
   The dropout rates were decreasing after the first mission 

Field Experiment Results

After using TWA, new editors will:
- Increase the number of overall contributions
- Increase the number of contributions on talk pages
- Create contributions of greater quality

Learn Before

Related