Pairwise: continuous outcomes
Mean and standardized mean differences for stay, operative time or pain.
What it is
Here every patient contributes a measurement rather than a yes or no: minutes in the operating room, days in hospital, a pain score. Each trial is summarized by the mean, the standard deviation (SD) and the number of patients in each arm.
The simplest comparison is the mean difference: the mean with the intervention minus the mean with the control, in the original unit. When trials measure the same thing with different instruments, such as two different pain scales, the difference is divided by the SD to give a standardized mean difference, expressed in SD units.
As with binary outcomes, the trial-level differences are then pooled, with more weight for larger and more precise trials, into one estimate with its 95% confidence interval and a measure of heterogeneity.
| Mean | SD | Patients | |
|---|---|---|---|
| Intervention | 5.2 days | 2.1 | 60 |
| Control | 6.4 days | 2.5 | 58 |
Repeat for every trial, then pool: that is the meta-analysis.
When to use it
Use it when
- The outcome is measured on a scale: operative time, length of stay, blood loss, pain or quality-of-life scores.
- You are comparing two groups.
- Each study reports mean and SD per group, or median with interquartile range or range, which can be converted.
Choose another tool when
- The outcome is an event (yes or no): use binary outcomes.
- The data are very skewed and only medians are available in most studies: conversion becomes unreliable, so pool with caution and test the result without the converted studies.
- Some trials report change from baseline and others final values: do not mix them in a standardized mean difference.
- There is no comparison group, only case series: use single-arm continuous outcomes.
Preparing the data: mean and SD
metacont() needs the mean, the standard deviation (SD) and the number of patients in each arm. Many studies report something else; convert it before the analysis, in the extraction sheet, so every number can be traced back.
Mark every converted value in a separate column. Medians are a sign of skewed data, so the result should be checked in a sensitivity analysis without the converted studies.
| The study reports | What to do | Method |
|---|---|---|
| Mean and SD | Use directly. | - |
| Mean and standard error (SE) | SD = SE × √n | Cochrane Handbook 6.5.2.2 |
| Mean and 95% confidence interval | SD = √n × (upper − lower) ÷ 3.92; with fewer than about 60 patients per arm, replace 3.92 by 2 × the t value for n − 1 degrees of freedom | Cochrane Handbook 6.5.2.2 |
| Only a P value or t statistic | Recover the SE of the difference from the t value, then the SD | Cochrane Handbook 6.5.2.3 |
| Only the mean (no SD, SE or CI) | Impute the SD from the other studies of the meta-analysis (for example, the mean or the largest SD of similar studies) and check the result without the imputed studies | Cochrane Handbook 6.5.2.7; Furukawa |
| Median and interquartile range (IQR) | Estimate the mean and the SD | Mean: Wan or Luo. SD: Wan or Shi |
| Median and range (minimum-maximum) | Estimate the mean and the SD | Mean: Hozo (older), Wan or Luo. SD: Wan or Shi |
| Median, IQR and range | Use all five numbers together | Mean: Luo. SD: Shi |
| Medians from clearly skewed data | Methods that do not assume a normal distribution | McGrath (quantile estimation, Box-Cox) |
| Change from baseline without its SD | Impute the SD from the baseline and final SDs and a correlation coefficient taken from similar studies | Cochrane Handbook 6.5.2.8 |
| Several groups that form one arm (e.g., two doses) | Combine their means and SDs into one group | Cochrane Handbook 6.5.2.10, Table 6.5.a |
In R, the estmeansd package and the median, quartile and range arguments of metacont() apply these estimators; online calculators based on the same papers give identical results.
The template, parameter by parameter
Click a highlighted argument to see what it does and which values to use. Picking a value updates the code.
m <- metacont(n.e = n_int, mean.e = mean_int, sd.e = sd_int,
n.c = n_ctl, mean.c = mean_ctl, sd.c = sd_ctl,
studlab = study, data = dat,
= "MD",
= "Hedges",
= "REML",
= FALSE, = TRUE, = FALSE,
label.e = "Intervention", label.c = "Control")
m <- update(m,
= if (m$tau2 > 0) "HK" else "classic")
# forest plot: see section 5
The forest plot, parameter by parameter
These arguments change only how the result is shown, not the result itself. Click one to see the options.
("forest.png", width = 5500, height = 1100 + 170 * m$k, = 500)
forest(m,
= "RevMan5",
= studlab,
= "s",
= "navyblue",
= "black",
= 2,
= 2,
label.left = "Favors intervention",
label.right = "Favors control",
colgap.forest.left = "7mm")
()
In my work
Figures from my published reviews, next to the metacont() call behind them. These analyses used the Wald confidence interval: when they were done, Cochrane had not yet recommended switching to Hartung-Knapp when tau² > 0. Click a figure to enlarge it.
m <- metacont(
n.e, mean.e, sd.e, # intervention arm
n.c, mean.c, sd.c, # control arm
data = dat, # one row per study
studlab = Study, # study names
sm = "MD", # mean difference
method.tau = "DL", # DerSimonian-Laird tau²
method.random.ci = "classic" # Wald CI
)
m <- metacont(
n.e, mean.e, sd.e, # intervention arm
n.c, mean.c, sd.c, # control arm
data = dat, # one row per study
studlab = Study, # study names
sm = "MD", # mean difference
method.tau = "DL", # DerSimonian-Laird tau²
method.random.ci = "classic" # Wald CI
)
References
- Higgins JPT, Thomas J, Chandler J, et al. Cochrane Handbook for Systematic Reviews of Interventions, version 6.5. Cochrane; 2024. Chapter 6 (effect measures) and Chapter 10 (analysing data).
- Hedges LV. Distribution theory for Glass's estimator of effect size and related estimators. J Educ Stat. 1981;6:107-128.
- Hozo SP, Djulbegovic B, Hozo I. Estimating the mean and variance from the median, range, and the size of a sample. BMC Med Res Methodol. 2005;5:13.
- Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14:135.
- Luo D, Wan X, Liu J, Tong T. Optimally estimating the sample mean from the sample size, median, mid-range, and/or mid-quartile range. Stat Methods Med Res. 2018;27:1785-1805.
- Shi J, Luo D, Weng H, et al. Optimally estimating the sample standard deviation from the five-number summary. Res Synth Methods. 2020;11:641-654.
- Furukawa TA, Barbui C, Cipriani A, Brambilla P, Watanabe N. Imputing missing standard deviations in meta-analyses can provide accurate results. J Clin Epidemiol. 2006;59:7-10.
- McGrath S, Zhao X, Steele R, et al. Estimating the sample mean and standard deviation from commonly reported quantiles in meta-analysis. Stat Methods Med Res. 2020;29:2520-2537.
- Veroniki AA, Jackson D, Viechtbauer W, et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2016;7:55-79.