When calculating the overall effect of conflicting studies or studies conducted on different populations, we do not ignore methodological differences. We stratify studies based on predetermined categorical moderators (e.g., study design).
- When independent studies are statistically synthesized, what is the overall net direction of the effect?
- Do the selected sub-groups (e.g., study design, applied dose, clinical stage) create a significant difference (heterogeneity) on the effectiveness of the intervention?
Resolves the problem of "inconsistency" in the literature. Mathematically isolates the source of differences without falling into the "comparing apples and oranges" fallacy frequently criticized by reviewers.