Proportion Meta-analysis

Menu location: Analysis_Meta-Analysis_Proportion.

This function enables you to calculate an overall proportion from a set of proportions, for example from a systematic review of studies of adherence with a particular drug treatment.

This function can also be applied to a review of diagnostic test studies to give an overall sensitivity or specificity as follows:

		DISEASE/OUTCOME
		Present	Absent
TEST:	+:	a (true +ve)	b (false +ve)
	-:	c (false -ve)	d (true -ve)

Sensitivity = a/(a+c)

Specificity = d/(b+d)

Another way to summarise diagnostic test performance is via the diagnostic odds ratio:

Diagnostic odds ratio = true/false = (a * d)/(b * c)

In order to run a meta-analysis of diagnostic odds ratios simply use the odds ratio meta-analysis function with the experimental group as the true (test correct) outcomes and the control group as the false outcomes – enter a as experimental group responders; a+d as experimental group number; b as control group responders; and b+c as control group total.

Many study designs can be expressed as a proportion, and relatively complex statistical models can be explored using sets of proportions – for example a random effects logistic regression. You should seek the assistance of a statistician if you want to pursue analyses deeper than the summaries that this StatsDirect function offers.

The inconsistency of results across studies is summarised in the I² statistic, which is the percentage of variation across studies that is due to heterogeneity rather than chance – see the heterogeneity section for more information.

Beyond this meta-analysis function, logistic regression can be used to compare pooled proportions. Consult with a statistician if you are considering a random effects logistic model.

DATA INPUT:

You enter the number of subjects responding (with the study outcome) and the total number of subjects studied. You may also enter a title for each study.

Technical Validation

StatsDirect first transforms proportions via the Freeman-Tukey double arcsine method (Murray et al. 1950, Miller 1978) then performs an inverse-variance weighted fixed and random effects meta-analysis by conventional methods (DerSimonian and Laird, 1986). The appropriate weight is n+0.5 but some other software uses n+1. In our own simulation testing of the variance options within the formula 1/(n+c), varying c from 0.5 to 1, we found that the n+1 method (Stuart and Ord, 1994) is conservative, avoiding underestimation of the true variance of the transformed proportion, but the original n+0.5 method (Freeman et al, 1950) method is closer to the true variance in absolute terms. Note that there is no fixed transformation of a binomial proportion that provides optimal variance stabilization, which depends on your data - iterative variance stabilization methods may emerge with further research. The pooled proportion can be calculated as the back-transform of the weighted mean of the transformed proportions (Miller 1978):

- where p hat is the fixed effects pooled proportion, x is the Freeman-Tukey transformed proportion, w is the inverse variance weight for the transformed proportion, q is the Cochran q statistic, tau squared is the moment-based estimate of the between-studies variance, w r is the DerSimonian-Laird weight, and p hat r is the random effects estimate of the pooled proportion.

An alternative, simpler, back transform, as used in previous versions of StatsDirect is:

This form is strictly less accurate than the Miller method above but it is less susceptible to the bias effects of non-linear transformations, giving more credible estimates of pooled proportions where the true population value is close to 0 or 1.

Example

The following data represent adherence with medication from 22 fictitious trials of a class of drug:

Trial	Adherent	Total
Brown	214	311
Lamont	58	65
Lally	59	67
Orwell	182	285
Wagner	65	73
Werner	66	116
Venner	99	183
Adams	600	696
Brenner	45	57
Borrowdale	165	277
Byers	32	35
Daniels	49	60
Darling	175	199
Ehert	155	311
Fern	64	81
Mullen	526	537
Orton	104	107
Jones	97	102
Ning	2310	4612
Sherraton	72	91
Zu	37	37
Tarone	31	87

To analyse these data in StatsDirect first prepare them in three workbook columns and label these columns appropriately. Alternatively, open the test workbook using the file open function of the file menu. Then select proportion from the meta-analysis section of the analysis menu, and then select the columns 'Trial', 'Adherent', and 'Total' as prompted.

For this example:

Method: Stuart-Ord (inverse double arcsine square root)

Study	Proportion	95% CI (exact)		% Weight (fixed, random)
1	0.688103	0.633392	0.739187	3.71	4.66	Brown
2	0.892308	0.790618	0.955591	0.78	4.46	Lamont
3	0.880597	0.778215	0.947015	0.80	4.46	Lally
4	0.638596	0.579853	0.694424	3.40	4.65	Orwell
5	0.890411	0.795436	0.951484	0.88	4.49	Wagner
6	0.568966	0.473763	0.660561	1.39	4.57	Werner
7	0.540984	0.465895	0.614723	2.18	4.62	Venner
8	0.862069	0.834196	0.886827	8.29	4.69	Adams
9	0.789474	0.66113	0.88621	0.68	4.43	Brenner
10	0.595668	0.5353	0.653966	3.30	4.65	Borrowdale
11	0.914286	0.769425	0.981962	0.42	4.27	Byers
12	0.816667	0.695604	0.904764	0.72	4.44	Daniels
13	0.879397	0.825884	0.921178	2.38	4.63	Darling
14	0.498392	0.441461	0.555354	3.71	4.66	Ehert
15	0.790123	0.685373	0.872724	0.97	4.51	Fern
16	0.979516	0.963644	0.989731	6.40	4.68	Mullen
17	0.971963	0.920245	0.99418	1.28	4.56	Orton
18	0.95098	0.889304	0.983894	1.22	4.55	Jones
19	0.500867	0.486332	0.515402	54.91	4.71	Ning
20	0.791209	0.693308	0.869362	1.09	4.53	Sherraton
21	1	0.905109	1	0.45	4.29	Zu
22	0.356322	0.256493	0.466236	1.04	4.52	Tarone

Fixed effects (inverse variance)

Pooled proportion = 0.63958 (95% CI = 0.629281 to 0.649814)

Non-combinability of studies

Cochran Q = 1553.004499 (df = 21) P < 0.0001

Moment-based estimate of between studies variance = 0.268086

I² (inconsistency) = 98.6% (95% CI = 98.5% to 98.8%)

Random effects (DerSimonian-Laird)

Pooled proportion = 0.785824 (95% CI = 0.689259 to 0.868571)

The differences between trials are very large (99% inconsistency), therefore a random effects model should be followed. In order to change the weights displayed from fixed to random effects, go to the menu Analysis_Meta-Analysis_Calculation Options and select 'Random effects diagnostics' – this will show you that the weights used to calculate the pooled proportion are similar in the random effects approach, unlike the weights shown above for the fixed effects approach. We conclude that the adherence for this class of drug is approximately 79%, and with 95% confidence at least 69%.