Strata Academy
Student Journal Club Facilitator Guide (Critical Appraisal)
How to choose a paper, structure a 45-minute session, lead ROB 2 and AMSTAR 2 discussions, and avoid common facilitation pitfalls
Quick answer
A good student journal club session: one paper matched to the group's level, a clear PICO on slide one, 10 minutes context, 20 minutes structured appraisal (framework-aligned), 10 minutes clinical relevance, 5 minutes summary. Prepare three probing questions per ROB 2 or AMSTAR 2 domain — not a slide deck of generic 'strengths and weaknesses'.
- Match paper design to the framework before the session — RCT needs ROB 2, review needs AMSTAR 2.
- Send the PDF and a one-page prep sheet 48 hours ahead.
- Facilitate discussion; do not lecture for 45 minutes.
- End with 'would this change practice?' — not just 'was p<0.05?'.
1. What the facilitator actually does
The facilitator is not a mini-lecturer. Your job is to keep the group moving through a structured appraisal, ensure quiet students contribute, and redirect vague comments ('good paper') toward specific domains ('Domain 4 — was the outcome assessor blinded?').
At UK medical schools, journal club often sits in SSC blocks, surgical firms, or PAR modules. Marks may depend on facilitation quality, not just attendance. Treat it like an OSCE station: prepare, timekeep, close with learning points.
You do not need to be the smartest person in the room — you need the best-prepared worksheet. Use official frameworks (ROB 2, AMSTAR 2, QUADAS-2) so discussion stays defensible.
- Select paper and framework before advertising the session
- Distribute PDF + prep questions 48 hours early
- Timekeep: context → appraisal → clinical relevance → summary
- Capture 3–5 learning points for the sign-off sheet
2. Choosing the right paper
Pick one primary study or one systematic review — not a narrative review or editorial. RCTs suit ROB 2; cohort studies suit ROBINS-I or NOS; systematic reviews suit AMSTAR 2 + PRISMA; diagnostic papers suit QUADAS-2.
Avoid papers your audience cannot access (paywalled without institutional login) or methods so opaque the group spends 30 minutes on statistics with no clinical payoff.
Ideal length: 6–10 page clinical trial or 10–15 page systematic review with clear abstract PICO. Landmark trials (WOMAN, RECOVERY) work well because students may have heard of them — your job is to deepen appraisal, not recite headlines.
Check with your supervisor or firm lead that the paper fits the curriculum week (e.g. sepsis firm → fluid trial; ethics week → consent or cluster-RCT design).
Tip: If unsure which framework applies, run the abstract through Strata Lite or read our which-framework guide before committing.
3. 45-minute session structure
Minutes 0–5: Title slide with citation, your name, learning objectives ('By the end we will have completed ROB 2 domains 1–3 and decided if results are trustworthy for practice').
Minutes 5–15: Background — clinical problem, current guideline position, study PICO in one slide. No epidemiology lecture.
Minutes 15–35: Structured appraisal — walk domains in order. Ask paired questions; cold-call gently if the room is silent.
Minutes 35–42: Clinical relevance — effect size vs MCID, applicability to NHS patients, implementation barriers.
Minutes 42–45: Summary — three takeaways, limitations acknowledged, optional link to coursework frameworks.
| Segment | Time | Facilitator focus |
|---|---|---|
| Intro + PICO | 5 min | Display structured question; state framework |
| Context | 10 min | Why this question matters clinically |
| Appraisal | 20 min | Domain-by-domain framework questions |
| Relevance | 7 min | So what? for patients and guidelines |
| Close | 3 min | Learning points + thank you |
4. ROB 2 facilitation prompts (RCT papers)
Domain 1 — Randomisation: 'How was the sequence generated? Was allocation concealed until enrolment?' Push for registry or methods detail, not 'they said randomised'.
Domain 2 — Deviations: 'Was analysis intention-to-treat? Any crossover or protocol switches?' Students often skip this — it matters for pragmatic trials.
Domain 3 — Missing data: 'Attrition per arm? Was imputation appropriate?' Link to how much missing data would change trust in the effect.
Domain 4 — Measurement: 'Primary outcome subjective or objective? Who assessed it?' Blinding matters more for pain scores than mortality.
Domain 5 — Selective reporting: 'Compare ClinicalTrials.gov outcomes to published paper.' This domain separates strong journal clubs from superficial ones.
Note: Do not let the group stop at 'double-blinded therefore low risk'. ROB 2 requires all five domains.
5. AMSTAR 2 facilitation prompts (systematic reviews)
Search: 'Which databases? Was Embase included? Trial registries?' PubMed-only is a critical flaw — say so clearly.
Selection: 'Dual independent screening? PRISMA flow with exclusions?' Single-reviewer screening is dissertation-grade failure.
Synthesis: 'Random or fixed effects pre-specified? Heterogeneity explored?' Ask if the forest plot matches the protocol.
RoB integration: 'Did authors use ROB 2 on included trials and bring it into GRADE?' Reviews that ignore bias in primary studies inflate certainty.
Close with: 'Overall AMSTAR 2 confidence — would you cite this review in a guideline?'
6. Managing the room
Send a one-page prep sheet: PICO blanks, five domain headings, 'bring one question'. Students who skim the abstract still contribute.
If one student dominates, thank them and redirect: 'Good point on statistics — let's hear someone on Domain 5 selective reporting.'
If the room is silent, use think-pair-share: two minutes individual, two minutes pairs, then plenary.
If you do not know the answer, model intellectual honesty: 'I'm not sure — let's check the supplement together.' Examiners prefer that to bluffing.
- Prep sheet 48 hours before
- Think-pair-share for quiet groups
- Park off-topic statistics for after the session
- Assign a timekeeper in the group if needed
7. Sign-off sheets and portfolio evidence
Many UK schools require a facilitator sign-off sheet: date, paper citation, attendance, learning objectives met. Submit within a week while memories are fresh.
Attach your slide deck and completed ROB 2 or AMSTAR 2 worksheet as appendix evidence for SSC portfolios.
Write three reflective bullets: what went well, what you would change, one thing you learned about appraisal.
If scored, rubrics often reward framework use and participation — not slide aesthetics.
Tip: Export a StrataResearch appraisal report as a facilitator backup worksheet — compare group judgements to structured output in the debrief.
Frequently asked questions
How long before the session should I send the paper?
At least 48 hours; a week is better for systematic reviews. Include the PDF, citation, framework name, and three warm-up questions.
What if nobody read the paper?
Spend five extra minutes on PICO and abstract results, then run a condensed domain walk using think-pair-share. Do not cancel — use it as a lesson on preparation. For assessed facilitation, mention low prep in your reflection.
Can I facilitate a paper I do not fully understand?
Choose a simpler paper or a trial type you have practised (parallel RCT). Prepare domain questions in advance using our ROB 2 hub. You need to steer discussion, not master every subgroup analysis.
RCT or systematic review for first-time facilitators?
A single parallel RCT with clear CONSORT flow is usually easier than a systematic review. Reviews require AMSTAR 2 across sixteen items — better once you have facilitated at least one trial.
How do I link journal club to coursework?
Reference the same frameworks as your evidence-based medicine assignments. Note completed domains on your appraisal walkthrough guide worksheet. Supervisors notice when journal club matches dissertation methods teaching.
Interactive walkthroughs and quizzes load when JavaScript is enabled — the checklist and tables above are fully readable without it.