Is CONSORT the same as a quality assessment tool?

No. CONSORT is a reporting guideline that promotes transparency. It does not assign risk-of-bias judgements. Use ROB 2 (or ROBINS-I for non-randomised studies) for methodological quality of the effect estimate.

Can a trial pass CONSORT but have high risk of bias?

Yes. Transparent reporting can describe inadequate concealment, high attrition, or unblinded subjective outcomes — all of which may yield high ROB 2 risk despite good CONSORT adherence.

Which should I use first — CONSORT or ROB 2?

Start with CONSORT to locate methods and flow information, then apply ROB 2 domains using what you found. CONSORT prepares the evidence ROB 2 needs; ROB 2 interprets it.

Do I cite CONSORT and ROB 2 in my dissertation?

Yes. Name CONSORT when discussing reporting limitations of included trials and cite ROB 2 as your formal risk-of-bias tool in methods. Link to official publications or the Cochrane ROB 2 guidance.

What if the CONSORT flow diagram is missing?

Record it as a major CONSORT deficiency. For ROB 2, attrition and missing-data domains may be 'some concerns' or 'high' until numbers and reasons are obtained from authors or protocols.

Strata Academy

CONSORT vs ROB 2: Reporting vs Risk of Bias

Why complete reporting does not guarantee valid results — pairing CONSORT transparency with ROB 2 causal inference assessment

Quick answer

CONSORT checks whether an RCT is reported transparently (allocation, blinding, flow diagram, outcomes). ROB 2 assesses whether the design and conduct make the effect estimate trustworthy. A trial can score well on CONSORT yet have high risk of bias — or poor reporting can force 'unclear' ROB judgements even when conduct was sound.

1. Two different appraisal questions

Students often conflate 'well reported' with 'low risk of bias'. CONSORT and ROB 2 answer different questions and should be applied sequentially in RCT appraisal.

CONSORT 2010 (and extensions) is a reporting guideline: did authors describe eligibility, interventions, randomisation, blinding, outcomes, harms, and participant flow clearly enough that the trial could be replicated and appraised?

ROB 2 is a risk-of-bias tool: given what was done, how likely is it that the estimated effect is distorted by problems in randomisation, deviations, missing data, measurement, or selective reporting?

CONSORT → transparency and reproducibility of the write-up
ROB 2 → trustworthiness of the effect estimate
Reporting ≠ conduct, but poor reporting hides conduct problems
Both are standard in UK medical school critical appraisal

2. What CONSORT covers

CONSORT's 25-item checklist spans title, abstract, introduction, methods, results, discussion, and other information. High-yield items for students: trial design, eligibility, interventions, outcomes, sample size, randomisation sequence generation and concealment, blinding, participant flow, and harms.

The CONSORT flow diagram tracks participants from enrolment through allocation, follow-up, and analysis. Discrepancies between randomised and analysed numbers are both a CONSORT reporting issue and a ROB 2 missing-data signal.

CONSORT extensions exist for cluster trials, non-inferiority designs, pragmatic trials, and patient-reported outcomes. Check whether the paper cites the appropriate extension.

3. What ROB 2 covers

ROB 2 evaluates five domains: bias arising from the randomisation process; deviations from intended interventions; missing outcome data; measurement of the outcome; selection of the reported result.

Each domain uses signalling questions answered from the paper (and sometimes protocol). Judgements are low, some concerns, or high risk of bias per domain, with an overall judgement for the effect of assignment to intervention.

ROB 2 does not score how nicely the paper is written — it scores whether methodological choices likely biased the result. A beautifully written methods section can still describe inadequate concealment.

Domain 1 – random sequence generation and allocation concealment
Domain 2 – deviations from intended interventions (ITT vs per-protocol)
Domain 3 – missing outcome data and attrition patterns
Domain 4 – blinding of outcome assessors and measurement validity
Domain 5 – selective reporting of outcomes from trial registry

4. When CONSORT and ROB 2 diverge

Good CONSORT, high ROB 2: authors report transparently that allocation was by date of birth, 40% attrition differed by arm, and no blinding of subjective outcomes — CONSORT complete, ROB 2 high risk.

Poor CONSORT, unclear ROB 2: methods omit concealment details and flow diagram — you cannot confirm low bias; ROB 2 domains become 'some concerns' or 'unclear' despite possibly sound conduct.

Good CONSORT, low ROB 2: well-reported RCT with proper concealment, ITT analysis, low attrition, blinded assessment — the ideal case for trusting the primary estimate.

5. Student appraisal workflow

Step 1: Confirm the paper is an RCT (random allocation to intervention groups). If not, redirect to ROBINS-I or cohort appraisal tools.

Step 2: Run CONSORT mentally or with the checklist — note missing flow diagram, unregistered outcomes, or absent harms table.

Step 3: Apply ROB 2 domain by domain. Where CONSORT gaps exist, document 'unclear due to incomplete reporting' rather than guessing low risk.

Step 4: Integrate into clinical bottom line — effect size, precision, ROB overall, and CONSORT limitations for trustworthiness.

Verify RCT design and registered protocol if available
Complete CONSORT checklist — list major reporting deficiencies
Map CONSORT gaps to ROB 2 domains (flow → missing data, blinding → measurement)
Assign ROB 2 domain and overall judgements with plain-language rationale
State whether you would use this trial in clinical decision-making or guideline synthesis

6. CONSORT and ROB 2 in systematic reviews

Systematic reviewers apply ROB 2 to every included RCT and often summarise results in a traffic-light plot. CONSORT is not scored per trial in the same way — but incomplete reporting across included trials may trigger ROB 2 'some concerns' patterns.

AMSTAR 2 expects risk-of-bias assessment of included studies. PRISMA 2020 expects transparent reporting of ROB methods and results. Your dissertation methods should name both CONSORT awareness (for per-trial appraisal) and ROB 2 as the formal tool.

GRADE risk-of-bias downgrades draw on ROB 2 judgements across the body of evidence — not on CONSORT scores.

7. Common student mistakes

Using CONSORT as a quality score out of 25 — it is a reporting guide, not a numeric quality metric for pooling weights.

Skipping ROB 2 because the abstract claims 'rigorous double-blind RCT' — verify in methods and flow diagram.

Applying ROB 2 to observational studies — use ROBINS-I instead.

Ignoring protocol registration when judging ROB 2 Domain 5 (selective reporting) — compare ClinicalTrials.gov outcomes to published results.

Mistake: CONSORT complete → automatically low bias
Mistake: ROB 2 without reading flow diagram
Mistake: Confusing blinding of participants with blinded outcome assessment
Mistake: Treating per-protocol analysis as primary without justification

Interactive version (quizzes, walkthroughs) loads when JavaScript is enabled.