Positive review spikes were exceedingly rare in the Culture 500 sample, accounting for 0.1% of company-months.

Rarity of Positive Review Spikes in Culture 500 Sample

Not all review spikes indicate that a company is gaming the system. Review surges can occur by chance, from positive or negative news events, or when companies ask employees to write honest reviews without attempting to influence the content. Some positive spikes can also happen by chance or be triggered by positive news.

Non-Gaming Causes of Glassdoor Review Spikes

The Culture 500 researchers dropped all positive spike months from the sample. After the positive spikes were removed, the remaining months with a large number of reviews were indistinguishable from the full sample.

Removal of Positive Spike Months from Culture 500 Sample

To detect potentially problematic reviews, the Culture 500 researchers identified positive spikes: company-months in which both the number of reviews and the overall company rating were two or more standard deviations above the monthly mean.

Google

To accurately classify text into topics that matter to managers and researchers, the Culture 500 researchers built a custom dictionary using machine learning tools and human expertise. After a three-year process, the dictionary contained over 20,000 highly accurate terms mapped to more than 90 topics.

MIT SMR/Glassdoor Culture 500

MIT Sloan Management Review project page on measuring culture in leading companies, including the Culture 500 dataset. https://sloanreview.mit.edu/projects/measuring-culture-in-leading-companies/

MIT Sloan Management Review

The MIT Sloan Culture 500 ranks major companies across nine dimensions of corporate culture using Glassdoor reviews. It also celebrates cultural excellence through public recognition and identifies areas where influential companies can improve their culture.

MIT Sloan Culture 500 Rankings of Corporate Culture

The Culture 500 interactive tool provides a snapshot of how frequently and positively employees within a company talk about the Big Nine values.

Culture 500 Snapshot of a Single Company's Cultural Profile

The Culture 500 allows users to benchmark companies against their competitors on each of the Big Nine values.

Competitor Benchmarking View in Culture 500

Glassdoor reviewers use rich and varied language when describing culture. That language paints a nuanced picture of corporate culture, but it also defies simplistic approaches to textual analysis.

Glassdoor Open-Text Reviews for Culture Insight

Positive Review Spike Detection in Culture 500

To classify reviews into topics that matter to managers and researchers, the Culture 500 team built a custom dictionary from the ground up by combining machine learning tools with human expertise. This approach dramatically improved the accuracy of their models.

Custom Culture 500 Dictionary Combining Machine Learning and Human Expertise

Nearly all organizations in the Culture 500 are for-profit companies and most are headquartered in the United States. Some international companies with large U.S.-based workforces are also included, but regardless of headquarters location, only reviews from employees based in the U.S. are used in the analysis.

For-Profit US-Based Composition of the Culture 500 Sample

The Culture 500 organizes its companies into 33 clearly defined industries, with an average of 18 companies per industry. In the tool's industry bar graphs, the number to the right of each bar denotes the count of companies included in that industry.

Learn Before

Related

Learn After