Strata Academy
Which Critical Appraisal Framework Should I Use?
Interactive decision tree for RCTs, systematic reviews, diagnostic studies, and observational research — ROB 2, PRISMA, AMSTAR 2, QUADAS-2, and more
Quick answer
Match the framework to study design: ROB 2 for RCTs, ROBINS-I for non-randomised interventions, PRISMA + AMSTAR 2 for systematic reviews, QUADAS-2 for diagnostic accuracy, GRADE for certainty of evidence. Use the picker below for a guided recommendation.
1. Why framework choice matters
Applying the wrong checklist is one of the most common student errors in critical appraisal. ROB 2 questions do not apply to systematic reviews; AMSTAR 2 does not replace risk-of-bias assessment in primary RCTs.
Supervisors and examiners expect you to name the official tool, cite its source, and justify why it matches the study design in the paper you are appraising.
Framework choice also determines what you look for in the methods: allocation concealment for RCTs, search reproducibility for reviews, index test reference standard for diagnostic accuracy.
2. Interactive framework picker
Answer a few questions about the manuscript you are appraising. The picker links to our full framework hubs and workflow guides.
3. Quick reference matrix
Use this table when you already know the study design.
| Study type | Primary tools | Also consider |
|---|---|---|
| RCT | ROB 2, CONSORT | GRADE if part of a review |
| Non-randomised intervention | ROBINS-I | CONSORT extension if applicable |
| Systematic review / meta-analysis | PRISMA 2020, AMSTAR 2, ROBIS | GRADE for certainty |
| Diagnostic accuracy | QUADAS-2 | STARD reporting |
| Cohort / case–control | JBI or NOS | STROBE reporting |
| Qualitative | JBI qualitative | COREQ reporting |
4. Free tools to practise
After choosing a framework, use our interactive tools to rehearse checklist items before appraising a full PDF.
- PRISMA 2020 checklist tool for reporting items
- ROB 2 domain assistant for RCT risk-of-bias practice
- PICO builder for protocol questions
- Forest plot explainer for meta-analysis appraisal
Tip: Upload the same PDF to StrataResearch quick analysis to compare your manual appraisal with framework-aligned automated scoring.
Frequently asked questions
Can I use CASP for every study type?
CASP offers helpful generic prompts but is not a substitute for design-specific tools like ROB 2 or AMSTAR 2 in formal appraisal or dissertations expecting Cochrane-aligned methods.
Do I need PRISMA and AMSTAR 2 for the same review?
Yes when appraising a published systematic review. PRISMA checks reporting transparency; AMSTAR 2 checks methodological conduct. They answer different questions.
What if my paper is a preprint or protocol?
Protocols use PRISMA-P; preprints may lack full results — note limitations and appraise what is reported. Return after publication for full ROB 2 or AMSTAR 2 assessment.
Interactive walkthroughs and quizzes load when JavaScript is enabled — the checklist and tables above are fully readable without it.