Risk-of-Bias, Certainty, and Decision-Relevance Appraisal by Evidence Group.
Risk-of-Bias, Certainty, and Decision-Relevance Appraisal by Evidence Group.
| Evidence Group | Dominant Bias Concerns | Risk-of-bias Judgment | Certainty of Evidence (GRADE)* |
|---|---|---|---|
| RCT post hoc / pooled analyses | Psychiatric exclusion criteria; post hoc harms; rare-event underpowering | Some concerns (RoB 2) | Moderate |
| RCT meta-analyses | Rare-event ascertainment; heterogeneous harms definitions | Not re-appraised with RoB 2; risk of bias as judged within each source synthesis | Moderate |
| Active-comparator cohort / target-trial emulations | Residual confounding; outcome misclassification; treatment channeling | Moderate (ROBINS-I) | Moderate |
| Broad EHR / passive-comparator studies | Comparator imbalance; surveillance bias; obesity-severity confounding | Serious to critical (ROBINS-I) | Low |
| Pharmacovigilance / disproportionality | Notoriety bias; no denominator data; cannot estimate incidence | Not formally scored (qualitative appraisal only) | Very low |
| Regulatory reviews | Dependence on quality of underlying data; integration of multiple sources | Not applicable (regulatory evidence synthesis) | Not applicable † |