Peer Review

Open full-size illustration →

Peer review is the practice of having independent, qualified peers scrutinize a claim, method, or piece of work before it is accepted, published, or acted on.

The idea

No individual can reliably catch every error, gap, or blind spot in their own work. Peer review replaces one person’s judgment with the scrutiny of others who have relevant expertise and no stake in defending the work. In science it is the standard gate before publication. Reviewers check whether the methods are sound, whether conclusions follow from the evidence, and whether prior work is accounted for. The same check is useful outside academia, wherever an independent review makes a decision or a piece of work more reliable.

When to use it

How to apply it

  1. Choose reviewers with relevant expertise and no strong incentive to simply agree with you.
  2. Give reviewers enough detail to evaluate the method or reasoning. The conclusion alone is not enough.
  3. Treat disagreement from a reviewer as useful signal to investigate, not an obstacle to route around.

Watch out for

Sources

Sociologist Robert K. Merton’s writings on the norms of science describe “organized skepticism” as the disposition peer review is meant to formalize.