Learn Before
On Violations of LLM Review Policies
On Violations of LLM Review Policies
Source: https://blog.icml.cc/2026/03/18/on-violations-of-llm-review-policies/
Published: 2026-03-18. Updated: 2026-03-26. Inspected version: Official conference account, updated. Retrieved: 2026-11-09T21:38:53.814986+00:00.
Source annotation (reported findings): The ICML conference chairs’ report (published March 18, 2026; updated March 26, 2026) records 795 flagged reviews by 506 reviewers under an agreed no-language-model policy. Corrected figures link 497 rejected submissions to 398 reciprocal reviewers, whose own submissions depended on reviewer participation. Organizers describe hidden PDF instructions plus human checking of every flag, acknowledging detection is partial and evadable. Flagged reviews were removed; 51 reviewers lost all their reviews, so 795 is not necessarily the total deleted. These are organizer-reported policy violations, not findings about review quality or reviewer intent.
0
1
Tags
Scientific Oversight of AI-Assisted Research
1Cademy
Related
Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study
An evaluation of Cochrane Crowd found that crowdsourcing produced accurate results in identifying randomized trials
Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025
AI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilot
Use and Effects of LLMs in Peer Review: A Randomized Experiment and Survey at ICML 2026
FAQs - Peer Community In
Guide for Authors
Frequently asked questions
Related
Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study
An evaluation of Cochrane Crowd found that crowdsourcing produced accurate results in identifying randomized trials
Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025
AI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilot
Use and Effects of LLMs in Peer Review: A Randomized Experiment and Survey at ICML 2026
FAQs - Peer Community In
Guide for Authors
Frequently asked questions