Joint first authorship.
Alcohol and drug use (A&D) and dietary risks are two increasingly important risk factors. This study examines whether there is a relationship between the burden of these risk factors in countries of specific income bands as defined by the World Bank, and the number of primary studies included in Cochrane Systematic Reviews (CSRs) conducted in those countries.
Data was extracted from primary studies included in CSRs assessing two risk factors as outcomes. For each risk factor, data was obtained on its overall burden in disability-adjusted life years (DALYs) by World Bank Income Levels and examined for a link between DALYs, the number of primary studies and participants.
A total of 1601 studies from 95 CSRs were included. Only 18.3% of the global burden for A&D is in high income-countries (HICs) but they produced 90.5% of primary studies and include 99.5% of participants. Only 14.2% of the dietary risk burden is in HICs but they produced 80.5% of primary studies and included 98.1% of participants.
This study demonstrates the unequal output of research heavily weighted towards HICs. More initiatives with informed contextual understanding are required to address this inequality and promote health research in low and middle-income countries.
Health research is important in informing improvements in health, and systematic reviews are key in developing the evidence base. However, research volume, in terms of Cochrane Systematic Review (CSR) output of reviews of interventions addressing specific risk factors, has been demonstrated by Roberts et al. to correlate only weakly with global risk burden [
To investigate the inequalities further, two behavioural risk factors were examined: alcohol and drug use (A&D) and dietary risks. These risk factors were selected because Roberts et al showed that there was a higher than expected number of reviews given the disease burden addressing the risk factor of A&D but a lower than expected number addressing dietary risks. The Global Burden of Disease (GBD) study measures the burden of risk factors in disability-adjusted life years (DALYs), that is, the sum of years lived with disability and years of life lost to premature death. The 2016 GBD study shows behavioural risk factors accounted for 32.7% (95% confidence interval 30.7-34.8) of attributable DALYs and highlights the importance of dietary risk factors and A&D risk factors in LMICs as well as in high income countries (HICs) [
The aim is to determine whether the burden of each of these two risk factors in countries of a particular income band (defined by the World Bank), and the number of primary studies and of study participants included in Cochrane Systematic Reviews conducted in those countries are related.
The Cochrane Database of Systematic Reviews via the Cochrane Library was searched using two filters (intervention and custom range date) to identify relevant systematic reviews published from 1st January 2013 to the 2nd October 2018. This five-year period was decided because it represents the median life expectancy of systematic reviews [
All titles and abstracts were independently screened to exclude irrelevant reviews. Full texts were obtained for a final decision where necessary. Any disagreements were resolved by discussion, and an additional reviewer participated until an agreement was reached. Each included CSR was independently reviewed by two of the team of reviewing authors (CF, KM, MS, MM) to identify primary studies assessing interventions addressing diet and A&D.
The reviewing authors independently extracted data on the characteristics of primary studies including publication year, study design, country of first author, country where study took place, and number of participants. A 10% random selection of the extracted data was checked by one of the other reviewers. For each risk factor assessed, we obtained data on its overall burden in DALYs by World Bank Country Income Levels (WBIL) grouped into high, upper-middle, lower-middle and low income from the Global Burden of Disease study 2016 [
A descriptive analysis of characteristics of the included primary studies was performed. Data was analysed and presented in tables using frequency and percentage for categorical variables. We used the Chi squared Goodness of Fit (CSGOF) to test the null hypothesis that the number of primary studies and the number of DALYs for that risk factor grouped by income band (high income vs upper middle, lower middle and low-income countries) were of the same distribution. This was repeated for the number of study participants. All statistical analyses were performed with STATA version 11 software [
A total of 95 CSRs met the inclusion criteria; 45 (47.4%) addressed dietary risks, 47 (49.5%) addressed A&D and three addressed (3.1%) both factors; and included 1601 primary studies. The selection process of the systematic reviews and its respective primary studies is shown in
Prisma diagram of study selection.
Characteristics of primary studies included in Cochrane systematic reviews by assessed risk factors
| Alcohol & drug use |
Dietary risks | Total | ||
|---|---|---|---|---|
| 2011-2018 |
194 (26.7) |
369 (42.1) |
563 (35.2) |
|
| 2001-2010 |
356 (49.1) |
320 (36.5) |
676 (42.2) |
|
| 1991-2000 |
131 (18.1) |
142 (16.2) |
273 (17.0) |
|
| ≤1990 |
44 (6.1) |
45 (5.1) |
89 (5.6) |
|
| Cross-sectional |
0 (0) |
5 (0.6) |
5 (0.3) |
|
| Cohort |
9 (1.3) |
38 (4.3) |
47 (3.0) |
|
| NRS |
1 (0.1) |
6 (0.7) |
7 (0.4) |
|
| Quasi-RCT |
11 (1.5) |
1 (0.1) |
12 (0.7) |
|
| RCT |
704 (97.1) |
826 (94.3) |
1530 (95.6) |
|
| High |
685 (94.5) |
705 (80.5) |
1390 (86.8) |
|
| Upper middle |
33 (4.5) |
89 (10.2) |
122 (7.6) |
|
| Lower middle |
7 (1.0) |
59 (6.7) |
66 (4.1) |
|
| Low |
0 (0) |
23 (2.6) |
23 (1.5) |
|
| 725 (100) | 876 (100) | 1601 (100) | ||
NRS - no randomized controlled study, RCT - randomised controlled trial
The majority of the burden for A&D was in LMICs but they only produced 5.5% of primary studies and 0.5% of participants were from these countries. Likewise, LMICs carried 85.8% of the burden for dietary risks but produced only 19.5% of primary studies and included 1.9% of participants. Details of the characteristics for the assessed risk factors by country income level can be found in
Characteristics for the assessed risk factors by country income level
| Country income level | DALYs, n in millions (%) | Primary studies, n (%) | Country of primary study 1st author, n (%) | Participants primary studies, n (%) |
|---|---|---|---|---|
| High |
24.8 (18.3) |
685 (94.5) |
689 (95) |
469 607 (99.5) |
| Upper middle |
57.9 (42.7) |
33 (4.5) |
30 (4.1) |
1929 (0.4) |
| Lower middle |
39.2 (28.9) |
7 (1.0) |
6 (0.9) |
472 (0.1) |
| Low |
13.6 (10) |
0 (0) |
0 (0) |
0 (0) |
| 135.5 (100) |
725 (100) |
725 (100) |
472 008 (100) |
|
| High |
32.4 (14.2) |
705 (80.5) |
738 (84.2) |
530 009 (98.1) |
| Upper middle |
91.8 (40.2) |
89 (10.2) |
87 (10.0) |
6186 (1.1) |
| Lower middle |
92.2 (40.3) |
59 (6.7) |
44 (5.0) |
3050 (0.6) |
| Low |
12.2 (5.3) |
23 (2.6) |
7 (0.8) |
1256 (0.2) |
| 228.6 (100) | 876 (100) | 876 (100) | 540 501 (100) | |
DALYs – disability-adjusted life years
The χ2 goodness of fit (CSGOF) test showed the number of primary studies was of a different distribution to both risk factors studied; A&D risk factor burden in HICs and LMICs (
The authors examined 1601 primary studies from 95 CSRs. The results show 85.8% of the burden of disease for dietary risks is borne by LMICs yet only 19.5% of the primary studies and 1.9% of participants came from LMICs. The pattern is even starker for A&D since 81.7% of the burden of disease related to A&D is borne by LMICs but only 5.5% of the primary studies and 0.5% of participants came from LMICs. Notably 1390 (86.8%) of the 1601 primary studies examined were conducted in HICs. The total number of included studies taking place in the USA alone was 836, two thirds of those in HICs.
This study shows that the output of primary studies for the two behavioural risk factors, diet and A&D, are not in line with their respective burden of ill health in countries at differing WBIL.
The findings were similar to the ones of other studies conducted around these two risk factors. A previous study had shown that there were a higher number of CSRs addressing A&D than expected given risk factor disease burden [
Also shown is the globally ‘understudied’ risk factor of poor diet is severely ‘understudied’ in LMICs. The World Health Organisation’s 2012 Strategy on Research for Health recognised the need to address “gaps in national and global research on health and health systems” [
Dietary risk is an increasing health issue for many countries [
There is no doubt that A&D is on the increase [
To the authors knowledge this is the first study that examines the burden of two behavioural risk factors, diet and A&D, in countries of specific World Bank income bands and how it relates to the number of primary studies and their participants included in CSRs conducted in those countries. The study was rigorously conducted, with two reviewers looking at a sample of all data with 92.6% agreement.
Limitations of the study were that only primary studies eligible for inclusion in CSRs were considered and other systematic reviews could have been included. The sources of bias in the included systematic reviews was not investigated. Furthermore because of resource constraints, the reviewing authors were only able to examine two specific risk factors, dietary risk and A&D, rather than all GBD level 2 modifiable risk factors. Finally, the identification of factors related to the burden of ill health is only exploratory. Several unmeasured confounders, for instance the difference in rural and urban areas, the cultural settings or the different quality of studies, could account for some of the findings. Other unmeasured confounders may exist, and great caution is warranted in interpreting these results, which naturally cannot be considered as reflecting any causal relationship.
The results of this research highlight that more primary research needs to be conducted in LMICs for the two behavioural risk factors studied; it should not be assumed that what is effective in HICs will also be effective in LMICs, although some interventions may indeed be globally relevant. This is part of a much wider problem regarding inequities in global health research. Factors hindering research equity in LMICs are worthy of further investigation such as sources of funding, language barriers to publication and broader socio-economic issues. HICs can support justice in global health by the design of grant programmes that will help adjust the disparity [
In conclusion, this study demonstrates the inequal output of research heavily weighted towards HICs for A&D and Dietary risks. Therefore, more initiatives with informed contextual understanding are required to address this inequality and promote health research in low and middle-income countries.
The authors thank Anne Eisinga for her contribution to this work. This work was conducted during a student elective period at Cochrane UK by the four first authors. Cochrane UK provided office space during the elective period for the reviewing authors.