Strata Academy

Student Journal Club Facilitator Guide (Critical Appraisal)

How to choose a paper, structure a 45-minute session, lead ROB 2 and AMSTAR 2 discussions, and avoid common facilitation pitfalls

Quick answer

A good student journal club session: one paper matched to the group's level, a clear PICO on slide one, 10 minutes context, 20 minutes structured appraisal (framework-aligned), 10 minutes clinical relevance, 5 minutes summary. Prepare three probing questions per ROB 2 or AMSTAR 2 domain — not a slide deck of generic 'strengths and weaknesses'.

1. What the facilitator actually does

The facilitator is not a mini-lecturer. Your job is to keep the group moving through a structured appraisal, ensure quiet students contribute, and redirect vague comments ('good paper') toward specific domains ('Domain 4 — was the outcome assessor blinded?').

At UK medical schools, journal club often sits in SSC blocks, surgical firms, or PAR modules. Marks may depend on facilitation quality, not just attendance. Treat it like an OSCE station: prepare, timekeep, close with learning points.

You do not need to be the smartest person in the room — you need the best-prepared worksheet. Use official frameworks (ROB 2, AMSTAR 2, QUADAS-2) so discussion stays defensible.

2. Choosing the right paper

Pick one primary study or one systematic review — not a narrative review or editorial. RCTs suit ROB 2; cohort studies suit ROBINS-I or NOS; systematic reviews suit AMSTAR 2 + PRISMA; diagnostic papers suit QUADAS-2.

Avoid papers your audience cannot access (paywalled without institutional login) or methods so opaque the group spends 30 minutes on statistics with no clinical payoff.

Ideal length: 6–10 page clinical trial or 10–15 page systematic review with clear abstract PICO. Landmark trials (WOMAN, RECOVERY) work well because students may have heard of them — your job is to deepen appraisal, not recite headlines.

Check with your supervisor or firm lead that the paper fits the curriculum week (e.g. sepsis firm → fluid trial; ethics week → consent or cluster-RCT design).

3. 45-minute session structure

Minutes 0–5: Title slide with citation, your name, learning objectives ('By the end we will have completed ROB 2 domains 1–3 and decided if results are trustworthy for practice').

Minutes 5–15: Background — clinical problem, current guideline position, study PICO in one slide. No epidemiology lecture.

Minutes 15–35: Structured appraisal — walk domains in order. Ask paired questions; cold-call gently if the room is silent.

Minutes 35–42: Clinical relevance — effect size vs MCID, applicability to NHS patients, implementation barriers.

Minutes 42–45: Summary — three takeaways, limitations acknowledged, optional link to coursework frameworks.

4. ROB 2 facilitation prompts (RCT papers)

Domain 1 — Randomisation: 'How was the sequence generated? Was allocation concealed until enrolment?' Push for registry or methods detail, not 'they said randomised'.

Domain 2 — Deviations: 'Was analysis intention-to-treat? Any crossover or protocol switches?' Students often skip this — it matters for pragmatic trials.

Domain 3 — Missing data: 'Attrition per arm? Was imputation appropriate?' Link to how much missing data would change trust in the effect.

Domain 4 — Measurement: 'Primary outcome subjective or objective? Who assessed it?' Blinding matters more for pain scores than mortality.

Domain 5 — Selective reporting: 'Compare ClinicalTrials.gov outcomes to published paper.' This domain separates strong journal clubs from superficial ones.

5. AMSTAR 2 facilitation prompts (systematic reviews)

Search: 'Which databases? Was Embase included? Trial registries?' PubMed-only is a critical flaw — say so clearly.

Selection: 'Dual independent screening? PRISMA flow with exclusions?' Single-reviewer screening is dissertation-grade failure.

Synthesis: 'Random or fixed effects pre-specified? Heterogeneity explored?' Ask if the forest plot matches the protocol.

RoB integration: 'Did authors use ROB 2 on included trials and bring it into GRADE?' Reviews that ignore bias in primary studies inflate certainty.

Close with: 'Overall AMSTAR 2 confidence — would you cite this review in a guideline?'

6. Managing the room

Send a one-page prep sheet: PICO blanks, five domain headings, 'bring one question'. Students who skim the abstract still contribute.

If one student dominates, thank them and redirect: 'Good point on statistics — let's hear someone on Domain 5 selective reporting.'

If the room is silent, use think-pair-share: two minutes individual, two minutes pairs, then plenary.

If you do not know the answer, model intellectual honesty: 'I'm not sure — let's check the supplement together.' Examiners prefer that to bluffing.

7. Sign-off sheets and portfolio evidence

Many UK schools require a facilitator sign-off sheet: date, paper citation, attendance, learning objectives met. Submit within a week while memories are fresh.

Attach your slide deck and completed ROB 2 or AMSTAR 2 worksheet as appendix evidence for SSC portfolios.

Write three reflective bullets: what went well, what you would change, one thing you learned about appraisal.

If scored, rubrics often reward framework use and participation — not slide aesthetics.

Interactive version (quizzes, walkthroughs) loads when JavaScript is enabled.