revista pan american panamericana journal of de … · 2016. 7. 28. · schonstein e, suutarinen j,...

26
REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE SALUD PÚBLICA PUBLIC HEALTH Supplementary material to: Haby MM, Chapman E, Clark R, Galvão LAC. Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews. Rev Panam Salud Publica. 2016;40(1): 48–56. This material formed part of the original submission and has been peer reviewed. We post it as supplied by the authors. Material suplementario / Supplementary material / Material supplementar

Upload: others

Post on 07-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

REVISTA PAN AMERICANPANAMERICANA JOURNAL OFDE SALUD PÚBLICA PUBLIC HEALTH

Supplementary material to: Haby MM, Chapman E, Clark R, Galvão LAC. Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews. Rev Panam Salud Publica. 2016;40(1): 48–56.

This material formed part of the original submission and has been peer reviewed.We post it as supplied by the authors.

Material suplementario / Supplementary material / Material supplementar

Page 2: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

1

Additional file 1. References for excluded systematic reviews Systematic reviews excluded at full-text stage (n=38)

Bambra C, Gibson M, Sowden A, Wright K, Whitehead M, Petticrew M. Tackling the wider social determinants of health and health inequalities: evidence from systematic reviews. J Epidemiol Community Health. 2010;64(4):284-91. doi:10.1136/jech.2008.082743.

Brambila-Macias J, Shankar B, Capacci S, Mazzocchi M, Perez-Cueto FJA, Verbeke W et al. Policy interventions to promote healthy eating: A review of what works, what does not, and what is promising. Food and Nutrition Bulletin. 2011;32(4):365-75.

Briggs A, Scarborough P, Kehlbacher A, Tiffin R. Modelling the effect on chronic disease health of changing food prices based on greenhouse gas emissions [Abstract]. Lancet. 2012;380(Supplement 3):S26. doi:http://dx.doi.org/10.1016/S0140-6736(13)60382-7.

Carter MA, Edwards R, Signal L, Hoek J. Availability and marketing of food and beverages to children through sports settings: a systematic review. Public Health Nutrition. 2012;15(8):1373-9. doi:10.1017/s136898001100320x.

Conan A, Goutard FL, Sorn S, Vong S. Biosecurity measures for backyard poultry in developing countries: a systematic review. BMC Veterinary Research. 2012;8(1):240.

de Sa J, Lock K. Will European agricultural policy for school fruit and vegetables improve public health? A review of school fruit and vegetable programmes. European Journal of Public Health. 2008;18(6):558-68. doi:10.1093/eurpub/ckn061.

Downs SM, Thow AM, Leeder SR. The effectiveness of policies for reducing dietary trans fat: a systematic review of the evidence. Bulletin of the World Health Organization. 2013;91(4):262-9H. doi:10.2471/BLT.12.111468.

Everson-Hock ES, Johnson M, Jones R, Woods HB, Goyder E, Payne N et al. Community-based dietary and physical activity interventions in low socioeconomic groups in the UK: A mixed methods systematic review. Preventive Medicine. 2013;56(5):265-72.

Faith MS, Fontaine KR, Baskin ML, Allison DB. Toward the reduction of population obesity: Macrolevel environmental approaches to the problems of food, eating, and obesity. Psychological Bulletin. 2007;133(2):205-26.

Frison EA, Smith IF, Johns T, Cherfas J, Eyzaguirre PB. Agricultural biodiversity, nutrition, and health: making a difference to hunger and nutrition in the developing world. Food and Nutrition Bulletin. 2006;27(2):167-79.

Geerligs PD, Brabin BJ, Omari AA. Food prepared in iron cooking pots as an intervention for reducing iron deficiency anaemia in developing countries: a systematic review. Journal of Human Nutrition and Dietetics. 2003;16(4):275-81.

Gilbert PA, Khokhar S. Changing dietary habits of ethnic groups in Europe and implications for health. Nutrition Reviews. 2008;66(4):203-15.

Green R, Cornelsen L, Dangour AD, Turner R, Shankar B, Mazzocchi M et al. The effect of rising food prices on food consumption: systematic review with meta-regression. Br Med J. 2013;346:f3703. doi:10.1136/bmj.f3703.

Hendrie GA, Brindal E, Baird D, Gardner C. Improving children's dairy food and calcium intake: can intervention work? A systematic review of the literature. Public Health Nutrition. 2013;16:365-76.

Hider P. Environmental interventions to reduce energy intake or density: a critical appraisal of the literature (Structured abstract). Health Technology Assessment Database 2001.

Iacovou M, Pattieson DC, Truby H, Palermo C. Social health and nutrition impacts of community kitchens: a systematic review. Public Health Nutrition. 2013;16(3):535-43. doi:10.1017/s1368980012002753.

Jago R, Baranowski T, Baranowski JC. Fruit and vegetable availability: a micro environmental mediating variable? Public Health Nutrition. 2007;10(7):681-9. doi:10.1017/s1368980007441441.

Jaime PC, Lock K. Do school based food and nutrition policies improve diet and reduce obesity? Preventive Medicine. 2009;48(1):45-53. doi:http://dx.doi.org/10.1016/j.ypmed.2008.10.018.

Page 3: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

2

Lee JH, Ralston RA, Truby H. Influence of food cost on diet quality and risk factors for chronic disease: A systematic review. Nutrition & Dietetics. 2011;68(4):248-61.

Lehtola MM, Rautiainen RH, Day LM, Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture: a systematic review and meta-analysis (Structured abstract). Scandinavian Journal of Work, Environment and Health 2008.

Magnusson RS. What's law got to do with it Part 2: Legal strategies for healthier nutrition and obesity prevention. Australia and New Zealand Health Policy. 2008;5:11. doi:http://dx.doi.org/10.1186/1743-8462-5-11.

Moise N, Cifuentes E, Orozco E, Willett W. Limiting the consumption of sugar sweetened beverages in Mexico's obesogenic environment: A qualitative policy review and stakeholder analysis. Journal of Public Health Policy. 2011;32(4):458-75. doi:http://dx.doi.org/10.1057/jphp.2011.39.

Nhemachena C, Chakwizira J, editors. Meta analysis of research on climate change adaptation and health in southern Africa: Identifying research gaps. CSIR 3rd biennial conference: science real and relevant; 2010; Pretoria, South Africa: CSIR.

Penafiel D, Lachat C, Espinel R, Van Damme P, Kolsteren P. A systematic review on the contributions of edible plant and animal biodiversity to human diets.

EcoHealth. 2011;8(3):381-99. doi:http://dx.doi.org/10.1007/s10393-011-0700-3.

Rautiainen R, Lehtola Marika M, Day Lesley M, Schonstein E, Suutarinen J, Salminen S et al. Interventions for preventing injuries in the agricultural industry. Cochrane Database of Systematic Reviews 2008 doi:10.1002/14651858.CD006398.pub2.

Robinson-O'Brien R, Story M, Heim S. Impact of garden-based youth nutrition intervention programs: A review. Journal of the American Dietetic Association. 2009;109(2):273-80.

Rui W, Zhang W. Effect size and duration of recommended management practices on carbon sequestration in paddy field in Yangtze Delta Plain of China: A meta-analysis. Agriculture, Ecosystems & Environment. 2010;135(3):199-205. doi:http://dx.doi.org/10.1016/j.agee.2009.09.010.

Sabate J, Wien M. Vegetarian diets and childhood obesity prevention. American Journal of Clinical Nutrition. 2010;91(5):1525s-9s. doi:10.3945/ajcn.2010.28701F.

Seymour JD, Yaroch AL, Serdula M, Blanck HM, Khan LK. Impact of nutrition environmental interventions on point-of-purchase behavior in adults: A review. Preventive Medicine. 2004;39(Suppl 2):S108-S36.

Small L, Lane H, Vaughan L, Melnyk B, McBurnett D. A systematic review of the evidence: the effects of portion size

manipulation with children and portion education/training interventions on dietary intake with adults (Provisional abstract). Database of Abstracts of Reviews of Effects 2013.

Steenhuis IHM, Vermeer WM. Portion size: Review and framework for interventions. International Journal of Behavioral Nutrition and Physical Activity. 2009;6:58.

Stewart R, Korth M, Langer L, Rafferty S, Rebelo Da Silva N, van Rooyen C. What are the impacts of urban agriculture programs on food security in low and middle-income countries? [Systematic review protocol]. Environmental Evidence. 2013;2:7.

Swanson JC, Mench JA, Thompson PB. Introduction – the socially sustainable egg production project. Poultry Science. 2011;90(1):227-8.

Ton G, de Grip K, Klerkx L, Rau M-L, Douma M, Friis-Hansen E et al. Effectiveness of innovation grants to smallholder agricultural producers: an explorative systematic review. : EPPI-Centre, Social Science Research Unit, Institute of Education, University of London2013. Report No.: ISBN: 978-1-907345-54-8.

van der Horst K, Oenema A, Ferreira I, Wendel-Vos W, Giskes K, van Lenthe F et al. A systematic review of environmental correlates of obesity-related dietary behaviors in youth. Health Education Research. 2007;22(2):203-26. doi:http://dx.doi.org/10.1093/her/cyl069.

Page 4: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

3

Walker RE, Keane CR, Burke JG. Disparities and access to healthy food in the United States: A review of food deserts literature. Health & Place. 2010;16(5):876-84. doi:10.1016/j.healthplace.2010.04.013.

Wharton CM, Long M, Schwartz MB. Changing nutrition standards in schools: the emerging impact on school revenue. Journal of School Health. 2008;78(5):245-51. doi:10.1111/j.1746-1561.2008.00296.x.

Woodman J, Lorenc T, Harden A, Oakley A. Social and environmental interventions to reduce childhood obesity: a systematic map of reviews. London: EPPI-Centre, Social Science Research Unit, Institute of

Education, University of London 2008. Systematic reviews on genetically modified foods excluded (n=4)

Diels J, Cunha M, Manaia C, Sabugosa-Madeira B, Silva M. Association of financial or professional conflict of interest to research outcomes on health risks or nutritional assessment studies of genetically modified products. Food Policy. 2010;36:197–203.

Domingo JL, Gine Bordonaba J. A literature review on the safety assessment of genetically modified plants. Environ Int.

2011;37(4):734-42. doi:10.1016/j.envint.2011.01.003.

Nicolia A, Manzo A, Veronesi F, Rosellini D. An overview of the last 10 years of genetically engineered crop safety research. Crit Rev Biotechnol. 2013;Early Online:1-12. doi:10.3109/07388551.2013.823595.

Snell C, Bernheim A, Berge JB, Kuntz M, Pascal G, Paris A et al. Assessment of the health impact of GM plant diets in long-term and multigenerational animal feeding trials: a literature review. Food Chem Toxicol. 2012;50(3-4):1134-48. doi:10.1016/j.fct.2011.11.048.

Page 5: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

4

Additional File 2. Characteristics of included systematic reviews

Note: Two tables are included in this file in order to show all relevant details – Tables A2a and A2b. Table A2a. Characteristics of included systematic reviews – sorted by intervention type

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

Agriculture interventions

Berti et al. (2004)

To review the impact of agriculture interventions on nutritional status in participating households, and to analyses the characteristics of interventions that improved nutrition outcomes.

P – Human I – Agriculture interventions C – NS O – Nutrition status and/or anthropometry S – NS Years: 1985-2001

November 2001 34 papers / 30 projects AMSTAR – 6

Masset et al. (2011); Masset et al. (2012b)

To assess the effectiveness of agricultural interventions in improving the nutritional status of children in developing countries.

P – Human; middle or low income countries I – Agriculture interventions (bio-fortification, home gardens, small scale fisheries and aquaculture, dairy development, and animal husbandry and poultry development). C – NS O – Nutritional status, and/or intermediate outcomes: participation, household income, diversity of diet, and micronutrient intake S – Only studies that used a valid counterfactual analysis and written in English were included. Years: 1990-2010

July to September 2010. 23 studies Note: includes the meta-analysis by Gunaratna et al. 2010. AMSTAR – 8

Webb Girard et al. (2012b); Webb Girard et al. (2012a)

The objective of this review is to systematically examine and summaries the effects of agricultural interventions to increase household food production on the nutrition and health outcomes of women and young children and provide recommendations for future research and programming.

P – Children 0–59 months and/or women of reproductive age, regardless of pregnancy status in low-income countries and LMIC I – Interventions aimed at increasing the quantity and/or quality of household food production C – NS O – Maternal, neonatal and young child nutrition and health outcomes S – Intervention studies (observational studies were excluded)

NS 35a papers, representing 27 unique projects AMSTAR – 6

Page 6: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

5

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

Years: 1990-?(NS) Organic farming / diet Dangour et al. (2010)

We sought to assess the strength of evidence that nutrition-related health benefits could be attributed to the consumption of foods produced under organic farming methods.

P – Human; (animal or human cell lines and serum; animal models) I – Consumption of or exposure to foodstuffs produced by organic farming methods. C – Conventionally produced foodstuffs. O – Nutrition-related health outcomes S – Randomized and nonrandomized controlled trials and studies with cohort, case-control, and cross-sectional designs; (in vitro and ex vivo studies in human or animal cell lines and serum; animal studies); abstract written in English. Years: 1958 to March 2010

15 September 2008; 10 March 2010 for update 8 studies in humans (plus 4 studies in animals or human cell lines or serum). AMSTAR – 8

Smith-Spangler et al. (2012)

To review evidence comparing the health (nutrition, safety) effects of organic and conventional foods.

P – Human; foods grown conventionally or organically. I – Consumption of or exposure to foodstuffs produced by organic farming methods. C – Conventionally produced foodstuffs. O – NS, though reported health outcomes for the human studies and nutrient and contaminant levels for the food studies. S – Peer-reviewed studies of comparisons of organically and conventionally grown food or of populations consuming these foods; written in English. Years: 1966 to May 2009

May 2009 17 studies (14 unique populations) in humans and 223 studies of nutrient and contaminant levels in foods AMSTAR – 7

Reduction in meat production and consumption Yip et al. (2013)

This review evaluates existing co-benefit models for emission and health outcomes of counterfactual scenarios of reduced meat consumption at a population level.

P – Human; defined study population. I – Meat consumption mitigation strategies with respect to both reduced greenhouse gas emissions and health benefits for a defined study population. C – NS O – Study focused on both emission and health outcomes of shared scenarios; and quantified at

NS 7 reports / 5 studies AMSTAR – 6

Page 7: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

6

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

least one of the two outcomes: greenhouse gas emissions and human health outcomes directly associated with dietary meat intake. S – Model-based co-benefit studies of reduced meat consumption in peer-reviewed journal articles and official reports. Years: No limit

Bio-fortification of maize, rice or wheat Gunaratna et al. (2010)

To evaluate the existing evidence for nutritional impact of Quality Protein Maize on child growth.

P – Children I – Bio-fortified maize - opaque-2 (o2) maize or Quality Protein Maize C – Conventional maize O – Mean changes in weight or height S – Randomized, controlled trials Years: NS

NS 7 reports / 9 studies AMSTAR – 7

Genetically modified (GM) foods Loevinsohn et al. (2013)

The primary question addressed by this review is: Under what circumstances and conditions does adoption of technology result in increased agricultural productivity?

P – Family farmers – those whose livelihood derives primarily from agriculture which they pursue mostly with their own and family labor; LMIC. I – Adoption of the major agricultural production technology types: i) Crop varieties and their management regimes (e.g. planting date, spacing); ii) Soil, soil fertility, pest and disease management; and iii) Water and irrigation management – implemented by individuals or groups. The primary focus was on agricultural technologies involving the major food crops of LMIC: maize, rice, wheat, millet, sorghum cassava, banana and bean. C – NS O – Change in productivity of a specified input (e.g. land, water, chemical inputs, labor); some of these studies also assessed non-productivity outcomes (e.g. income, health, risk). S – Any primary study; written in English or

NS 5 papers AMSTAR – 4

Page 8: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

7

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

French. Years: Any

Solari et al. (2011)

To review systematically the existing publications from the medical literature on the potential adverse effects of consuming GM foods on human health. Note: 3 related systematic reviews (SRs) were conducted, including: 1) A SR of primary studies in humans; 2) A SR of reviews on the subject; and 3) A SR of primary studies published in

the last two years in humans or animals.

Only the first and third meet our inclusion criteria and are detailed here.

P – Humans (for SR 1); Humans and Animals (for SR 3) I – Consumption of GM food C – NS O – Adverse events (on health) S – Primary Studies (case reports, case series) on adverse events with GM food consumption Years: Up to 4th May 2011

NS 3 papers in humans; 7 papers in animals AMSTAR – 3

Agriculture policies Dangour et al. (2013b)

To systematically review the available evidence on whether national or international agricultural policies that directly affect the price of food influence the prevalence rates of undernutrition or nutrition-related chronic disease in children and adults.

P – Human I – Existing or proposed national or international agricultural policies that could directly affect the price of food: defined as output price policies; trade liberalization policies or public distribution system polices. C – NS O – Prevalence rates of undernutrition (measured with anthropometry or clinical deficiencies) and overnutrition (obesity and nutrition-related chronic diseases including cancer, heart disease and diabetes). S – Studies presenting multivariate quantitative analysis specifically designed to evaluate (ex post) or simulate (ex ante) the effects of the policies; written in English. Years: Data collected post-1990 to Dec 2012

December 2012 5 articles / 4 studies AMSTAR – 7

McCorriston et al. (2013)

This systematic review focuses on the evidence for links between agricultural

P – Human; developing countries I – Agriculture trade liberalization intervention /

NS

Page 9: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

8

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

trade liberalization in developing countries and food security.

policy, including: export subsidies, tariffs (import or export), quotas, trade-restricting taxes, trade-restricting laws, import subsidies, other non-tariff barriers, and trade agreements C – NS O – Food security, including: income/poverty levels, food expenditure, food consumption, nutritional status, and food prices S – NS; written in English Years: NS

34 studies AMSTAR – 7

Taxes and subsidies Eyles et al. (2012)

Specific objectives were to assess: (1) the magnitude of the association of food taxes and subsidies with changes in food and nutrient intake, (2) the magnitude of the association of taxes and subsidies with health and disease states, and (3) the evidence for heterogeneity in these findings by socio-economic position.

P – Human; countries in the Organization for Economic Co-operation and Development. I – Food pricing strategies (taxes and subsidies) C – NS O – At least one of: food consumption (intake or food purchases), health status (biological risk factors such as blood pressure and cholesterol), and NCDs S – Simulation modelling studies; written in English Years: 1990 to 24 October 2011

24 October 2011 32 studies (30 with food consumption outcomes and 19 with health and disease outcomes) AMSTAR – 9

Powell and Chaloupka (2009)

This article examines whether altering the cost of unhealthy, energy-dense foods, compared with healthy, less-dense foods through the use of fiscal pricing (tax or subsidy) policy instruments would, in fact, change food consumption patterns and overall diet enough to significantly reduce individuals’ weight outcomes.

P – Human, USA only I – Food prices (or taxes or subsidies) C – NS O – Body weight, BMI S – Provide peer-reviewed, original quantitative empirical evidence; written in English Years: 1990-2008

September 2008 9 papers / 7 separate studies AMSTAR – 1

Powell et al. (2013)b

The aim of this review of studies that examined prices and weight outcomes was to assess the extent to which changes in food or beverage prices have the potential to translate into significant

P – Human, USA only I – Food prices, taxes or subsidies (reporting was limited to taxes on sugar-sweetened beverages (SSBs) and fast food and subsidies on fruits and vegetables)

March 2012 36 papers in total, of which 20 studies reported weight outcomes and 22 studies

Page 10: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

9

Systematic review

Objectives Inclusion criteria – PICOS (Participants, Interventions, Comparisons, Outcomes, Study Types); Years of publication of papers

Date of search; number of papers/studies included; AMSTAR score

changes in body weight.

C – NS O – Consumption or weight outcomes S – Peer-reviewed or a research report from the Economic Research Service of the USDA; provided original quantitative evidence; was not an intervention study or pilot study; assessed demand for product categories (i.e. regular carbonated soda) rather than brands (i.e. Coke or Pepsi); for weight outcomes, contained direct estimates and was not a modelling study that drew on price elasticity estimates to derive simulated impacts on weight; written in English. Years: 2007 to March 2012

reported consumption AMSTAR – 2

Thow et al. (2010)

To assess the effect of food taxes and subsidies on diet, body weight and health through a systematic review of the literature.

P – Human I – Monetary subsidies or taxes levied on specific food products (i.e. general agricultural subsidies or food taxes were excluded) C – NS O – Health outcome such as food consumption, body weight or disease. S – Empirical (i.e. assessed the effect of an actual tax) or modelling study (i.e. predicted rather than measured outcomes); written in English. Years: NS (all published between 2000 and 2009)

NS 24 studies, including 18 with food consumption outcomes and 15 with body weight and/or disease outcomes. AMSTAR – 2

GM – genetically modified; LMIC – low / middle-income countries; NCD – non-communicable diseases; NS – not specified; SR – systematic review a This was revised down from 36 articles (as cited in the journal paper) following correspondence with the lead author (Dr Amy Webb-Girard) due to discrepancies in the number of studies. b Note: this review builds on a previous review by the same authors (Powell and Chaloupka 2009). There are significant limitations with the conduct of this systematic review. The lead author for the review was an author on 12 (out of 20) of the included studies that reported weight outcomes but declared no conflict of interest.

Page 11: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

10

Table A2b. Characteristics of included systematic reviews – sorted by intervention type

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

Agriculture interventions Berti et al. (2004)

Vegetable/home gardening (13) Livestock (3) Mixed garden and livestock (2) Cash croppinga (7) Irrigation (2) Other (3) - land redistribution, promotion of production with credit and extension services, duck–fish production system.

Africa (12), Asia (14) & the Americas (4)

Well-conducted agriculture interventions productivity (Econ) and possibly nutrition (Social). Some interventions will also have environmental benefits (Env).

Most agriculture interventions increased food production, but not necessarily improved nutrition or health. Nutrition was improved in 11 of 13 home gardening interventions, and in 11 of 17 other types of intervention. Among the projects reviewed, home gardening projects usually had a higher success rate than other types of intervention, with at least some positive nutrition outcomes in all nine of the projects weighted as mid and high. Investing broadly in five types of capital, especially human capital, increases the prospects for nutrition improvement.

Masset et al. (2011); Masset et al. (2012b)

Bio-fortification (2) Home gardens (16) Small scale fisheries and aquaculture (3) Dairy development (1) Animal husbandry and poultry development (1)

Middle or low income countries

The adoption of a technology increases household income (Econ) and leads to better diets, which in turn lead to improvements in nutritional status (Social). Home gardens will also have environmental benefits as may bio-fortification (Env).

The interventions had a positive effect on the production of the agricultural goods promoted. The overall effect on household income remains unclear. The interventions were successful in promoting the consumption of food rich in protein and micronutrients, but the effect on the overall diet of poor people remains unclear. No evidence was found of an effect on the absorption of iron, but some evidence exists of a positive effect on absorption of vitamin A. Very little evidence was found of a positive effect on the prevalence of stunting, wasting, and underweight among children aged under 5 years. The lack of impact of agricultural interventions on child nutrition were attributed to methodological weaknesses of the studies reviewed rather than to specific characteristics of these interventions.

Webb Promotion and support of home Low-income Improvements in Although studies were too heterogeneous to

Page 12: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

11

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

Girard et al. (2012b); Webb Girard et al. (2012a)

gardens or the enhancement of existing gardens with improved, micronutrient-rich fruits, vegetables and/or tubers (16). Support for small livestock production, namely poultry rearing and fish farming alone or in combination with home gardens (9).b Promotion of dairy production with cattle or goats alone or in combination with home gardens (2).

countries and LMIC

household food production can increase income (Econ), the quantity and quality of foods for household consumption, and potentially nutrition and health (Social). An intergenerational cycle of malnutrition can productivity and economic potential. (Econ) Home gardens will also have environmental benefits (Env).

conduct meta-analysis, agricultural strategies consistently reported significantly improved diet patterns and vitamin A intakes for both women and children. Although some individual studies reported significant reductions in child malnutrition, summary estimates for effects on stunting [relative risk (RR) 0.93 [95% confidence interval (CI) 0.84, 1.04]], underweight (RR 0.80 [95% CI 0.60, 1.07]) and wasting (RR 0.91 [95% CI 0.60, 1.38]) were not significant. Findings for an effect on vitamin A status, anemia and morbidity were inconsistent. Overall the evidence base for the potential of agricultural strategies to improve the nutrition and health of women and young children is largely grounded in a limited number of highly heterogeneous, quasi-experimental studies, most of which have significant methodological limitations.

Organic farming / diet Dangour et al. (2010)

Organic farming methods, though most studies limited to testing of one organic foodstuff, e.g. carrots, apples. Only two examined consumption as part of a whole diet.

NS Organic farming has environmental (Env) and possibly health benefits (Social). It can also bring economic benefits to producers (Econ).

Note: only results from the human studies are included here. The results of the largest study suggested an association of reported consumption of strictly organic dairy products with a reduced risk of eczema in infants, but the majority of the remaining studies showed no evidence of differences in nutrition-related health outcomes that result from exposure to organic or conventionally produced foodstuffs.

Smith-Spangler et al. (2012)

Participants consumed: A predominately organic diet (4); A limited organic diet (2); Only certain organic foods – apples (2), carrots (1), tomatoes (1), juice and fresh produce (1) or

Human studies: USA (2), Europe (11), USA & Europe (1)

Organic farming has environmental (Env) and possibly health benefits (Social). It can also bring economic benefits to

The published literature lacks strong evidence that organic foods are significantly more nutritious or healthier than conventional foods. However, organic produce may reduce exposure to pesticide residues (conventional produce has a 30% higher risk for pesticide contamination than

Page 13: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

12

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

meat or dairy products (2).

producers (Econ). organic produce) and organic chicken and pork may reduce exposure to antibiotic-resistant bacteria.

Reduction in meat consumption Yip et al. (2013)

Reduction in livestock product consumption – various scenarios modelled.

UK (2), UK and São Paulo city, Brazil (1) Europe (1), OECD (1)

Reducing meat consumption would reduce greenhouse gas emissions from livestock (Env) and improve health (Social), with potential economic impacts (Econ).

The estimated counterfactual scenario emission effects presented in the included studies ranged from a reduction of <3–30% and reduction in the burden of disease ranged from 1 to 16%. All co-benefit studies estimated that reducing population meat consumption could reduce greenhouse gas emissions and the burden of disease. However, important attention must be paid to nutrition balance and a systematic approach in input and output attribute parameters is recommended for better model quality.

Bio-fortification of maize, rice or wheat Gunaratna et al. (2010)

Bio-fortification with maize varieties with improved protein quality – Quality Protein Maize (9) All interventions were designed either to provide a daily meal to supplement children’s typical diets or to substitute the maize in children’s typical diets with either Quality Protein Maize (treatment) or conventional maize (control).

Sub-Saharan Africa, Asia, or Latin America – Ethiopia (2), Ghana (4), India (1), Mexico (1), Nicaragua (1)

Bio-fortification is believed to be cost-effective (Econ), improve health (Social), and more accessible to the rural poor than nutrient supplementation (Social / Econ). May have environmental effects due to higher yield (Env).

The results indicated that consumption of QPM instead of conventional maize leads to a 12% (95% CI: 7–18%) increase in the rate of growth in weight and a 9% (95% CI: 6–15%) increase in the rate of growth in height in infants and young children with mild to moderate undernutrition from populations in which maize is the major staple food. Participating subjects were children under five years of age, with most under 24 months at baseline. All studies were conducted in locations where children exhibited mild to moderate undernutrition.

Genetically modified foods Loevinsohn Biotechnology/ Genetically India (2), Genetically modified No studies were found that assess the effect of

Page 14: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

13

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

et al. (2013)

Modified Organism (1) Hybrid seed (1) System of Rice Intensification (1) Irrigation and water management (1) Multiple technologies (1)

Peru (1), Rwanda (1) & Timor Leste (1)

foods have potential health (Social), environment (Env) and economic (Econ) benefits.

genetically modified foods. One study of genetically modified cotton was included.

Solari et al. (2011)

Consumption of genetically modified (GM) food (3) Note: only the studies in humans are included here.

China (1), England (1) & USA (1)

Genetically modified foods have potential health (Social), environment (Env) and economic (Econ) benefits.

While most of the studies reviewed found no evidence of adverse effects associated with the consumption of GM foods, some did find significant alterations at the morphological and functional levels of certain organs. The evidence is not sufficient to determine whether the consumption of GM foods has adverse effects on human health or not.

Agriculture policies Dangour et al. (2013b)

Output price policies – subsidized price of agricultural outputs (2); Public food distribution system polices – food subsidy programs (2).

The Netherlands, USA India, Egypt

These policies affect the price of food (Econ) and possibly food consumption, nutrition and disease (Social).

There is currently no direct evidence that agricultural policies that directly influence the price of food affect rates of undernutrition. However, there is a small effect on overnutrition, including a reduction in adult weight and risks of nutrition-related chronic disease.

McCorriston et al. (2013)

Agriculture trade liberalization intervention / policy, including: export subsidies, tariffs (import or export), quotas, trade-restricting taxes, trade-restricting laws, import subsidies, other non-tariff barriers, and trade agreements (numbers of each not given)

Developing countries

Most food-insecure segments of the population are also the poorest, as poverty limits their purchasing power to access food on the market. Trade reform can also affect poverty (Econ) and hence by extension has a bearing on food security (Econ, Social).

The evidence indicates no consistent outcome, as 13 studies suggested that agricultural trade reform has led to an improvement in food security, while 10 studies reported a decline. The remaining 11 studies indicated a more mixed outcome. Part of the reason for the lack of clear evidence is that agricultural trade liberalization is often introduced alongside other reforms at the macroeconomic or sector level. These wider reforms can also impact on food security metrics, making it difficult to isolate any link with agricultural trade liberalization from other influences.

Page 15: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

14

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

Taxes and Subsidies Eyles et al. (2012)

Food taxes (17, 15) Subsidies (6, 3) Combinations of food taxes and subsidies (7, 4) Note: the first number in each of the brackets above refers to studies that assessed the impact of food pricing on diet (n=30) and the second to studies that assessed the impact on health and disease outcomes (n=19). Note that some studies assessed taxes, subsidies, and/or combinations of taxes and subsidies and as such have been included in more than one category above.

OECD countries

Food taxes raise revenue for governments (Econ). Pricing strategies (food taxes and subsidies) influence food choice and potentially health (Social).

Based on modelling studies, taxes on carbonated drinks and saturated fat and subsidies on fruits and vegetables would be associated with beneficial dietary change, with the potential for improved health.

Higher quality studies suggested unintended compensatory purchasing that could result in overall effects being counter to health. Higher quality studies estimated that dairy/saturated fat taxes may increase mortality from CVD and CHD (n=1 study), and less healthy/junk food taxes may increase overall mortality (n=1 study) and mortality from stroke and CVD (n=2 studies).

Most (11/14) studies assessing absolute impacts for lower socio-economic groups estimated that effects on food and nutrient consumption, and health and disease, would be pro-health. Relative impacts may also be greater for lower income groups, and thus food taxes and subsidies have the potential to be pro-equity.

Powell and Chaloupka (2009)

Prices of:

- Fruits and vegetables, and fast food (3)

- Sugar, potatoes and whole milk (2 papers but 1 study with different analyses)

- Meat, fruits and vegetables, dairy, and fast food (2 papers but same authors and with overlap in data used).

- Full-service restaurants, fast food restaurants, and food at home (1)

USA (7 studies, 9 papers)

Food pricing policies impact on revenue (Econ), influence food choice and potentially health (Social).

The limited existing evidence suggests that small taxes or subsidies are not likely to produce significant changes in BMI or obesity prevalence but that nontrivial pricing interventions may have some measurable effects on Americans’ weight outcomes, particularly for children and adolescents, low-SES populations, and those most at risk for overweight. Note: that there are significant limitations with the included studies, as well as with the conduct of this systematic review.

Page 16: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

15

Systematic review

Details of interventions studied (number of studies)

Country / Region of studies (number)

Link with sustainable development / dimensions of integrated framework

Summary of findings

Tax on soft drink and snacks (1) Powell et al. (2013)

Tax on sugar-sweetened beverages (5) Prices of:

- Fast food and fruit and vegetables (8)

- Fast food (4) - Soft drink and fruit and

vegetables (1) - Fruit and vegetables (1) - Carbonated beverages, fruit

drinks, green vegetables (1)

USA (20) Food pricing policies impact on revenue (Econ), influence food choice and potentially health (Social).

Overall, the evidence on the extent to which changes in food or beverage prices may significantly impact weight outcomes remains mixed. The studies that linked soda taxes to weight outcomes showed minimal impacts on weight; however, they were based on existing state-level sales taxes that were relatively low. Higher fast-food prices were associated with lower weight outcomes particularly among adolescents, suggesting that raising prices would potentially impact weight outcomes. Lower fruit and vegetable prices were generally found to be associated with lower body weight outcomes among both low-income children and adults, suggesting that subsidies that would reduce the cost of fruits and vegetables for lower-socioeconomic populations may be effective in reducing obesity.

Thow et al. (2010)

Food taxes, including on sof.t drink, snack food, “unhealthy food” and/or nutrient content, e.g. fat (17)

Fruit and vegetable subsidies (2)

Combinations of food taxes and subsidies (5)

USA, Ireland, Scotland, UK, Egypt, Denmark, Norway, Sweden, France

Food taxes raise revenue for governments (Econ). Pricing strategies (food taxes and subsidies) influence food choice and potentially health (Social).

In general, taxes and subsidies influenced consumption in the desired direction, with larger taxes being associated with more significant changes in consumption, body weight and disease incidence. However, studies that focused on a single target food or nutrient may have overestimated the impact of taxes by failing to take into account shifts in consumption to other foods. The quality of the evidence was generally low. Almost all studies were conducted in high-income countries.

Econ – Economic; Env – Environment; GM – genetically modified; NS – not specified; P&S – Peace & Security; QPM – Quality Protein Maize; UK – United Kingdom; USA – United States of America. a A cash crop is an agricultural crop which is grown for sale to return a profit. b This number was revised down from the 10 cited in the journal paper following correspondence with the lead author (Dr Amy Webb-Girard) due to discrepancies in the number of studies.

Page 17: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

16

Additional File 3. Characteristics of included economic evaluations

Note: Two tables are included in this file in order to show all relevant details – Tables A3a and A3b. Table A3a. Characteristics of included economic evaluations – methods & results – sorted by intervention type

Economic evaluation

Intervention, Source of effectiveness data, & Setting

Methods – Population, Comparator, Outcomes, Costs included,

Methods – Type of study, Model, Reference Year, Perspective, Time horizon, Discounting, Funding source

Result, incremental cost-effectiveness ratio

Bio-fortification of maize, rice or wheat Stein et al. (2007)

Intervention: Bio-fortification of rice and wheat with zinc – optimistic and pessimistic scenarios for zinc content and coverage.

Source of effectiveness data: Projected increases in zinc content and potential coverage rates were estimated by plant breeders and other experts.

Setting: India

Population – Infants (below 1 year of age) and children (1–5 years of age); India.

Comparator – Alternative micronutrient interventions and international reference standards

Benefits – DALYs (due to reductions in diarrhea, stunting, pneumonia and mortality)

Costs – Basic R&D, country-specific activities (adaptive breeding, dissemination, extension) and maintenance breeding.

Type of study – Cost-utility analysis

Model – NS, used a model based on DALYs

Ref. Year – 2004

Perspective – NS

Time horizon – 30 years

Discounting – 3% on costs and health benefits

Funding source – German Research Foundation

The cost for saving one DALY amounts to $US 0.73-7.31, which is very cost-effective by standards of the World Bank and the World Health Organization, and is lower than that of most other micronutrient interventions.

Steur et al. (2012)

Intervention: Transgenic bio-fortification of rice with enhanced provitamin A, zinc, iron and folate concentrations (multi-biofortification).

Source of effectiveness data: Projected increases in micronutrient content were estimated based on previous literature and input of scientists involved in bio-fortification

Population – Whole population; China.

Comparator – Status quo (current practice)

Benefits – DALYs

Costs – Basic R&D, country-specific activities (adaptive breeding, regulatory requirements), social marketing and maintenance breeding.

Type of study – Cost-utility analysis

Model – NS, used the DALY framework

Ref. Year – NS, costs and benefits calculated for 2002-2032

Perspective – NS

Time horizon – 30 years

Under optimistic assumptions, the cost per DALY saved would be around US$ 2; it would stay below US$ 10 even under pessimistic assumptions. The total cost of developing and implementing multi-biofortified rice in China is

Page 18: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

17

Economic evaluation

Intervention, Source of effectiveness data, & Setting

Methods – Population, Comparator, Outcomes, Costs included,

Methods – Type of study, Model, Reference Year, Perspective, Time horizon, Discounting, Funding source

Result, incremental cost-effectiveness ratio

projects.

Setting: China

Discounting – 3% on costs and health benefits

Funding source – NS

approximately US$ 85.4 million.

Taxes and subsidies Cecchini et al. (2010)

Intervention:a Fiscal measures (taxes or subsidies) that increase the price of unhealthy food content (fat) or reduce the price of healthy foods rich in fiber (fruits and vegetables)

Source of effectiveness data: Demand elasticities from French Government report that reviewed results from 9 studies.

Setting: LMIC - Brazil, China, India, Mexico, Russia, and South Africa; plus England.

Population – Whole of population, 0-100 years

Comparator – No prevention or treatment only

Benefits – DALYs

Costs – basic administration, planning, monitoring and enforcement at the national level. Potential revenues from the tax, as well as expenditures originating from the subsidy, are not accounted for in the analysis, as they represent transfers rather than costs.

Type of study – Cost-utility analysisb

Model – Micro-simulation model developed by WHO and OECD (CDP model)

Ref. Year – 2005

Perspective – NS

Time horizon – Lifetime of cohort (100 years)

Discounting – 3% on costs and health benefits

Funding source – Contributions of OECD member countries and a grant from the European Commission

Effective and cost-saving (dominant)

Intervention costs ≤ $US0.02 per head in LMIC; $US0.11 per head in England

Dallongeville et al. (2011)

Interventionc: Fiscal measures (taxes or subsidies) including: 1) 3.4% reduction in VAT, and 2) €100/year/person fruit & vegetable stamp policy designed for low-income consumers

Source of effectiveness data: Income elasticity and price

Population – Whole of population plus those in the first decile of income (low income), age NS

Comparator – Current practice

Benefits – number of deaths avoided (DA) and life-years saved (LYS)

Type of study – Cost-effectiveness analysis

Model – Economic model of the fruit and vegetables market, incorporating supply and demand.

Ref. Year – 2006

Average cost-effectiveness ratio: The costs/LYS are €100,000 for VAT reduction and €474,000 for the food stamp policy.

Total LYS are larger with VAT reduction than F&V stamps policies (5,024 vs

Page 19: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

18

Economic evaluation

Intervention, Source of effectiveness data, & Setting

Methods – Population, Comparator, Outcomes, Costs included,

Methods – Type of study, Model, Reference Year, Perspective, Time horizon, Discounting, Funding source

Result, incremental cost-effectiveness ratio

elasticity of demand were from French studies; the price elasticity of supply was from a UK study.

Setting: France

Costs – The direct costs included those of decreases in government revenue due to 1) decreases in VAT on fruit and vegetables and 2) the costs of subsidizing fruit and vegetable consumption.

Perspective – NS

Time horizon – NS

Discounting – NS

Funding source – NS

1,032).

The food stamp policy reduces health inequalities between low-income consumers and others, whereas the VAT reduction can increase them.

Sacks et al. (2011)

Intervention: d Fiscal measure (tax) – 10% tax on unhealthy food (biscuits, cakes, pastries, pies, snack foods, confectionery and soft drinks)

Source of effectiveness data: In the absence of direct evidence of effect on BMI and health outcomes, a logic pathway was used. At each stage of the logic pathway, the best available evidence was used, in some cases supplemented with reasoned assumptions. Food consumption: Australian 1995 National Nutrition Survey, Own-price and cross-price elasticities: UK National Food Survey

Setting: Australia

Population – Adults, ≥20 years

Comparator – Current practice

Benefits – DALYs

Costs – Implementation of the legislation (including costs related to legislative activities, and administration and enforcement of laws once passed for a period of 10 years, costs to food industry for changing food labels)

Type of study – Cost-utility analysis

Model – Used multistate life table Markov model

Ref. Year – 2003

Perspective – Health sector perspective (with some industry costs included)

Time horizon – Lifetime of cohort (remaining lifetime of cohorts – ages grouped by 5 years)

Discounting – 3% on costs and health benefits

Funding source – Australian National Health and Medical Research Council

Effective and cost-saving (dominant)

Reduced mean weight 1.6 kg (95% UI: 1.5; 1.7); DALYs averted 559,000 (95% UI: 459500; 676,000).

Cost outlay was $AUD18 million (95% UI: 14.4; 21.6).

Strategies to combat acidification and ozone Krewitt Intervention: Strategies to Population – NS Type of study – Cost-benefit Net benefits for all

Page 20: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

19

Economic evaluation

Intervention, Source of effectiveness data, & Setting

Methods – Population, Comparator, Outcomes, Costs included,

Methods – Type of study, Model, Reference Year, Perspective, Time horizon, Discounting, Funding source

Result, incremental cost-effectiveness ratio

(1999) combat acidification and ozone in Europe, including: 1) 50% Gap closure between the level of ecosystem protection in 1990 and the target of 100% ecosystem protection by 2010; 2) Joint optimization; and 3) Maximum feasible reduction

Source of effectiveness data: Effectiveness of measures to achieve the targets under each of the three scenarios were not specified.

Setting: Europe

Comparator – Current Reduction Plan

Benefits – Avoided damage costs ($) due to reduced adverse effects on human health (mortality and morbidity), crop production and building materials. All impacts valued in $US 1990 using the approach of willingness-to-pay for improved environmental quality.

Costs – Emission control costs ($) required to implement the strategies.

analysis

Model – Used an impact assessment model (EcoSense), which uses relevant input data from the whole of Europe.

Ref. Year – 2010, costs calculated in 1990.

Perspective – NS

Time horizon – NS

Discounting – 0% on health and environmental benefits

Funding source – Partly funded by the European Commission under the JOULE Program.

scenarios. That is, the estimated benefits of moving from the Current Reduction Plan scenario to scenarios implementing more stringent abatement measures substantially exceed the costs of achieving them.

Benefits are not evenly distributed throughout Europe

Aflatoxin control strategies in maize and groundnuts Wu and Khlangwiset (2010)

Interventions: Two potential aflatoxin control strategies: (1) pre-harvest biocontrol, using atoxigenic strains of Aspergillus flavus competitively to exclude toxigenic strains from colonizing maize in Nigeria; and (2) post-harvest interventions in a package to reduce aflatoxin accumulation in groundnuts in Guinea

Population – Whole of population of Nigeria and Guinea, respectively.

Comparator – NS (No intervention)

Benefits – DALYs (due to reduction in aflatoxin-induced hepatocellular carcinoma cases) multiplied by gross domestic product

Type of study – Cost-utility analysis

Model – NS, Used a combination of health–economic formulae and quantitative cancer risk assessment

Ref. Year – 2009

Perspective – NS

The estimated cost-effectiveness ratio (CER) for biocontrol in Nigerian maize ranged from 5.10 to 24.8 (‘very cost-effective’)e; and for the post-harvest intervention package in Guinean groundnuts ranged from 0.21 to 2.08 (‘not cost-effective’ to ‘very cost-

Page 21: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

20

Economic evaluation

Intervention, Source of effectiveness data, & Setting

Methods – Population, Comparator, Outcomes, Costs included,

Methods – Type of study, Model, Reference Year, Perspective, Time horizon, Discounting, Funding source

Result, incremental cost-effectiveness ratio

Source of effectiveness data: 1) Personal communication (R Bandyopadhyay, International Institute of Tropical Agriculture, Ibadan, Nigeria) 2) Community-based controlled trial in West Africa

Setting: Africa – Nigeria, Guinea.

Costs – 1) Biocontrol costs from production to use; 2) Intervention package cost.

Time horizon – 5 years

Discounting – 3% on benefits

Funding source – US Department of Agriculture Special Cooperative Agreement and a National Institutes of Health Early Career Award

effective).

CDP – chronic disease prevention; DALYs – Disability-adjusted life years saved; LMIC – low / middle-income countries; NS – not specified; OECD – Organization for Economic Co-operation and Development; UI – Uncertainty Interval; WHO – World Health Organization;

a Cost-utility analysis is a special form of cost-effectiveness analysis where consequences are measured in terms of preference-based measures of health, such as quality adjusted life years (QALYs) or disability adjusted life years (DALYs). The advantage of cost-utility analysis over cost-effectiveness analysis is that it allows the comparison of alternative interventions that have very different health benefits (e.g. interventions for heart disease vs interventions for mental health).

b As well as these fiscal measures, this study also examined a range of population‐based interventions for obesity, including school‐based health promotion, work site health promotion, mass media campaigns, counselling of individuals at risk in primary care, regulation of food advertising to children, and compulsory food labelling. A combination of a mass media campaign, fiscal measures, food advertising regulation, and food labelling was also considered.

c In addition to the two interventions reported here, this study also examined a €10M information campaign.

d This study also examined traffic-light nutrition labelling.

e According to World Health Organization guidelines for cost-effectiveness, an intervention with a cost-effectiveness ratio (CER) > 1 can be considered ‘very cost-effective’; an intervention with a CER > 0.33 is considered ‘cost-effective’; and an intervention with a CER < 0.33 ‘not cost-effective’ (WHO 2001). The CER is the per-capita GDP multiplied by total DALYs saved divided by the cost of the intervention.

Page 22: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

21

Table A3b. Characteristics of included economic evaluations – commentary – sorted by intervention type

Economic evaluation

Link with sustainable development / dimensions of integrated framework

Strengths & Limitations Critical success factors / Comments

Bio-fortification of maize, rice or wheat Stein et al. (2007)

Bio-fortification is believed to increase yield (Econ) and micronutrient content and thus, potentially improve health (Social). Also, because stable foods predominate in the diets of the poor, this strategy implicitly targets low-income households, for which it is also more affordable than nutrient supplementation (Social / Econ).

A significant limitation is the lack of effectiveness data for zinc bio-fortification. Another limitation is the use of household-level rather than individual-level food intake data. Consequently, the use of adult equivalent weights to attribute a share of the household’s overall consumption to each household member only approximates actual individual intakes, and may significantly overestimate infant intakes.

As with all interventions, impact depends on coverage and the further the program is from urban centers and the more it targets people at the margin of society, the more difficult and expensive it is to increase coverage – this is an advantage of bio-fortification. While the biggest burden of zinc deficiency is borne by infants, the biggest health gain through bio-fortification occurs among children aged 1–5 years. Given the higher natural zinc content in existing wheat varieties and the lower potential increases in bio-fortified wheat compared with rice, the impact of wheat bio-fortification is lower than the impact of rice bio-fortification.

Steur et al. (2012)

Bio-fortification is believed to increase micronutrient content and thus, potentially improve health (Social). Also, because stable foods predominate in the diets of the poor, this strategy implicitly targets low-income, rural households, for which it is also more affordable than nutrient supplementation (Social / Econ).

An optimistic and pessimistic scenario was modelled due to uncertainty about effectiveness. It was assumed that the effects for each individual micronutrient can simply be added due to lack of knowledge on micronutrient interactions – but these could lead to double-counting (and overestimation) or there could be a synergistic effect, which would lead to underestimation. Limitations include the data used in the DALY framework – the data used in the scenario calculations build on several assumptions. While we have made great effort to use the most realistic data and assumptions, some degree of uncertainty remains, which needs to be kept in mind. Second, our approach relies on average micronutrient intake and food consumption data for the target

While iron and zinc bio-fortification is possible with conventional breeding methods, pro-vitamin A and folate bio-fortification in rice requires transgenic approaches. Despite the support of the Chinese government, there may potentially be problems of public acceptance with transgenic rice. Moreover, pro-vitamin A bio-fortification in particular is associated with a yellowish color, which may also entail skepticism among rice producers and consumers, if not accompanied by special awareness-building and marketing efforts.

Page 23: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

22

Economic evaluation

Link with sustainable development / dimensions of integrated framework

Strengths & Limitations Critical success factors / Comments

groups considered. To capture distributional effects, disaggregated household or individual level data would be preferable, but unfortunately such data are not available for China on a nationally representative basis.

Taxes and subsidies Cecchini et al. (2010)

Food pricing policies impact on revenue (Econ), influence food choice and potentially health (Social).

The CDP model developed for this study is a simplified representation of the complex reality and is heavily constrained by the availability of national (or subnational) data for the many required input parameters. A key limitation is that information about the long-term effects of interventions is almost non-existent, so authors assumed that effects disappear once exposure to an intervention ends. One of the key strengths is that it allows combination of multiple and heterogeneous sources of data, thus overcoming the limitations of individual sources. Probabilistic uncertainty analysis confirmed the cost-effectiveness of the intervention against country-specific thresholds for cost-effectiveness. Although the CDP model was designed to assess the distributional effects of prevention strategies, we were unable to undertake such assessment in this analysis because of data limitations. CRD commentary – The analysis was conducted in low‐ and middle‐income countries, as well as in the UK, and the results might be transferable to other countries with similar income and epidemiological

characteristics. The cost‐effectiveness approach was conventional and the results appear to be robust, but the data sources and some methods were not clearly presented.

The advantage of fiscal measures (along with regulatory measures that improve nutritional information content or restrict the marketing of unhealthy food products) is their greater coverage in the population—i.e. more people are exposed to their positive effects—and the fairly low cost of their implementation. Price interventions and regulation – biggest health gains in shortest timeframe. Fiscal measures are consistently cost saving in LMIC and generate largest (or second largest) health effects at 20 and 50 years.

Dallongeville et al. (2011)

Food pricing policies impact on revenue (Econ), influence food choice and potentially health (Social).

CRD commentary - The study had a number of methodological limitations. The key methods were not well reported and the authors did not perform an incremental cost‐effectiveness analysis. These points

(i) targeted and non-targeted policies to promote F&V intake have a modest impact on consumption and as a result on health gains, (ii) non-targeted

Page 24: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

23

Economic evaluation

Link with sustainable development / dimensions of integrated framework

Strengths & Limitations Critical success factors / Comments

make it difficult to determine if the results are reliable and if the conclusions are appropriate. Authors note – methods rely on restrictive assumptions, which would influence results.

interventions through price modifications appear to be more cost-effective than targeted actions through subsidizing the consumption of the most disfavored subpopulations and (iii) owing to their lower cost, information campaigns are more cost-effective, despite lower deaths avoided than VAT reduction. LYS are larger with VAT reduction than F&V stamps policies, (ii) information campaigns are the most cost-effective and (iii) market forces can limit the impacts of public health policies designed to favour F&V consumption increase

Sacks et al. (2011)

Food pricing policies impact on revenue (Econ), influence food choice and potentially health (Social).

The key strengths of this study are that it combines technical analysis (using the best available evidence) with other considerations of importance to decision makers, utilizes extensive uncertainty analysis, and employs assumptions which are both transparent and conservative.

The limitations of this study are predominantly around the quality of the evidence supporting the effect of the interventions. The direct evidence supporting the likely impact of the interventions on consumer behavior is relatively weak. To counter this uncertainty, the assumptions underpinning the estimates of the change in food consumption resulting from the intervention were conservative, and several different scenarios of intervention effect were examined.

The intervention impacts on the total adult population. As a consequence, the DALYs saved and cost offsets are generally significantly higher than for interventions which only impact on a proportion of the population.

Even if the effect of the intervention was assumed to decay progressively down to no effect after 10 years, and if the effect of the price elasticities was 20 times less than what was estimated, the intervention would remain dominant (when cost offsets are included).

There is weak evidence indicating specifically how this intervention will influence consumer behavior and its overall impact on diet and diet-related disease. The intervention is likely to be regressive; however, the health benefits of the tax are also likely to be relatively greater in lower income groups. The

Page 25: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

Haby et al. • Interventions for sustainable food production that impact health SUPPLEMENTARY MATERIAL

24

Economic evaluation

Link with sustainable development / dimensions of integrated framework

Strengths & Limitations Critical success factors / Comments

specific way in which the tax would be operationalized in the Australian context is uncertain, and there may be concerns about the feasibility of this type of tax on food products.

Strategies to combat acidification and ozone Krewitt (1999)

Strategies to combat acidification and ozone have both environmental (Env) and health (Social) benefits. The analysis also shows economic (Econ) benefits.

Uncertainty arises due to the need for better information on the effects of particles on human health (e.g. is it number, mass concentration, or their chemical composition that is the driving force?); effects of nitrate aerosols on health; and the best approach to valuation of mortality. The overall effect of significant variation in the approach for valuation of mortality was found to be insignificant in terms of whether benefits would exceed costs. It did however affect cost-benefit ratios. The impact categories that are included in the analysis (except for ecosystem damage that could not be quantified) include the most important sources of environmental damage costs. However, total benefits may be underestimated due to the exclusion of a large number of effects.

The largest reductions in damage are found in the countries with the largest populations – France, Germany, Italy, Spain, and the UK. Avoided damages also tend to be larger in central states, because of the reduction in emissions in neighboring areas. The countries where net losses or only small benefits are predicted are those on the fringe of the European Union - particularly Ireland.

Aflatoxin control strategies in maize and groundnuts

Page 26: REVISTA PAN AMERICAN PANAMERICANA JOURNAL OF DE … · 2016. 7. 28. · Schonstein E, Suutarinen J, Salminen S et al. Effectiveness of interventions in preventing injuries in agriculture:

SUPPLEMENTARY MATERIAL Haby et al. • Interventions for sustainable food production that impact health

25

Economic evaluation

Link with sustainable development / dimensions of integrated framework

Strengths & Limitations Critical success factors / Comments

(Wu and Khlangwiset (2010))

Aflatoxin (a toxin of fungal origin) reduces the market value of affected commodities (e.g. maize, peanuts) (Econ) and, if consumed, has health impacts (e.g. causing aflatoxin-induced hepatocellular carcinoma or liver cancer) (Social)

The cost-effectiveness ratios are underestimated in this study because the only end-point measured was a reduction in aflatoxin-induced liver cancer (aflatoxin-induced immunotoxicity or growth retardation in early life were not included due to insufficient information). Moreover, improving food quality can also result in improved market outcomes, which were not included in this study. The assumption that there was a linear dose–response relationship between the amount of aflatoxin reduction afforded by each intervention and the reduction of aflatoxin-induced liver cancer cases in the population is a limitation of the study. Though used in previous risk assessments, the true relationship between aflatoxin exposure and liver cancer may possibly be non-linear at lower doses.

There is a potential risk of invasive aspergillosis from A. flavus exposure among immunocompromised individuals, thus, it is important to ensure that the biocontrol material is applied in such a way as to minimize direct inhalation of spores. The feasibility of interventions to reduce aflatoxin from a global perspective must also be addressed by answering questions such as:

What would be the delivery mechanism of the intervention?

Can the intervention be manufactured locally, or must it be imported?

Can farmers or consumers afford the up-front costs, and if not, who will pay for the intervention? etc.

CRD – Centre for Reviews and Dissemination, UK; LMIC – low / middle-income countries; NS – not specified;