Peer review by the numbers
- 5 to 8 hours typical time to peer review a colleague’s master’s chapter; 10–20 hours for a journal article (Kovanis et al., Scientometrics, 2017).
- 2 to 3 reviewers standard for journal submissions; 2 examiners for UK PhD theses (UKCGE, 2024).
- Inter-rater agreement of r ≈ 0.34 — meaning reviewers often disagree, which is why multiple reviews matter (Bornmann et al., Research Evaluation, 2010).
- 57% of UK postgraduate students report receiving “vague” or “contradictory” peer feedback as their main feedback complaint (HEPI, 2024).
- 4 to 6 review cycles typical for a master’s dissertation between submission to supervisor and final acceptance.
The four-criteria reviewer framework
| Criterion | Question to answer | Common failures |
|---|---|---|
| 1. Research question | Is it specific, novel, feasible, ethical? | Too broad; not novel; sample inaccessible |
| 2. Methodology | Does the design match the question? Is it rigorous? | Quant method for inherently qual question; weak sample |
| 3. Evidence | Are claims supported? Are alternative explanations addressed? | Cherry-picking; ignoring counter-evidence |
| 4. Writing & structure | Is it clear, cohesive, properly cited? | Inconsistent referencing; weak transitions |
The four-section comment structure
Organise every review into four sections — never paragraph-by-paragraph from start to finish:
- Summary (1 paragraph). Restate the work’s central argument in your own words. Tells the author you understood it; flags misunderstandings.
- Strengths (3–5 bullets). What’s working well. Prevents authors dismissing the whole review.
- Major issues (3–6 bullets, prioritised). Issues that affect the central argument. These are the ones to act on first.
- Minor issues + line-level (annotated PDF or list). Typos, citation format, sentence-level edits.
Get a PhD-qualified review of your draft
Subject-matched experts review your dissertation chapter for argument, methodology, evidence and writing.
Sample peer review comment
Strengths:
- Strong methodological mapping between question and design
- Effect-size reporting follows APA 7 conventions
- Synthesis matrix structure clear in literature review section
Major issues:
- Sample boundary unclear. The methodology says “UK Gen Z” but the sample appears to be predominantly London university students (page 47). The generalisability claim needs to be narrowed or evidence broadened.
- Mediation model assumes one direction. Hayes (2022) PROCESS macro tests one path; an alternative (purchase intention shaping perceived authenticity post-hoc) is plausible. Worth a sentence acknowledging.
- Limitations section is too short. 180 words won’t satisfy examiners at master’s level. Aim for 350–500 covering sample, design, ethics, researcher positionality.
Minor issues:
- Page 12: typo “demmonstrates” → “demonstrates”
- References inconsistent — some use “&” some use “and”; pick one
- Figure 3 caption missing source
Reviewer pitfalls to avoid
| Pitfall | Better alternative |
|---|---|
| “This is unclear.” | “Sentence X (page Y) — I read this as meaning Z; is that intended?” |
| “You should…” (instructions) | “One option would be…” (suggestions) |
| Critiquing the writer (style) | Critiquing the work (“the argument needs…” not “you need…”) |
| Listing 50 minor issues | 3–5 prioritised major + annotated PDF for the rest |
| Reviewing your preferences not the work | Distinguish “this could be done differently” from “this is wrong” |
Receiving feedback constructively
- Wait 24 hours before responding — first reaction is usually defensive.
- Look for patterns across reviewers. If 2 of 3 say the methodology is unclear, it is unclear. Single complaints can be considered.
- Separate substance from style of delivery. Even harsh feedback can contain useful substance.
- Map every comment to action: accept, decline (with reason), or compromise. Document this in a response letter for journal work.
- Don’t make changes you don’t understand. If a reviewer suggests something unclear, ask for clarification — making a change you don’t grasp leads to incoherent revisions.
The reviewer response letter (for journals + theses)
Most journals and many supervisors expect a structured response letter. Format:
| Reviewer comment | Author response |
|---|---|
| “Sample boundary unclear…” | “We thank the reviewer for highlighting this. We have narrowed the generalisability claim to UK university students aged 18–24 (revised page 47, paragraph 2).” |
| “Mediation model assumes one direction…” | “We agree this is plausible. We have added a 4-line acknowledgement in the limitations section (page 89).” |
| “Limitations section too short…” | “We have expanded from 180 to 420 words covering sample, design, ethics and researcher positionality (revised pages 88–90).” |
Want a PhD-level review before submission?
Subject-matched experts review every aspect of your dissertation — argument, methodology, evidence and writing.
References
- Hames, I. (2007) Peer Review and Manuscript Management in Scientific Journals. Oxford: Wiley-Blackwell.
- Kovanis, M. et al. (2017) “The global burden of journal peer review”, Scientometrics, 113, pp. 245–263.
- Bornmann, L., Mutz, R. and Daniel, H. (2010) “A reliability-generalization study of journal peer reviews”, Research Evaluation, 19(2).
- Higher Education Policy Institute (2024) Student Academic Experience Survey. Oxford: HEPI.
- Hyland, K. (2019) Metadiscourse. 2nd edn. London: Bloomsbury.
- UK Council for Graduate Education (2024) UK PhD Examiner Reports 2023–2024. Lichfield: UKCGE.
- Hayes, A. F. (2022) Introduction to Mediation, Moderation, and Conditional Process Analysis. 3rd edn. New York: Guilford.
Submit with confidence
PhD-qualified specialists review your draft against the same four-criteria framework examiners use. Same-day options.