healthy kids obesity risk assessment demonstrates predictive validity in … · 2015. 10. 15. ·...

1
Healthy Kids Obesity Risk Assessment Demonstrates Predictive Validity in Sample of Low-Income Children Marilyn Townsend PhD, RD, Mical Shilts PhD, Dennis Styne MD, Lindsey Allen PhD, Christiana Drake PhD, Lenna Ontai PhD Supported by National Research Initiative #2009-55215-05019 & Agriculture and Food Research Initiative #2010- 85215-20658 from the USDA National Institute of Food and Agriculture, Human Nutrition and Obesity 93330. References Ontai L, Ritchie L, Williams ST, Young T, Townsend MS. Guiding family-based obesity prevention efforts in low-income children in the United States: Part 1What determinants do we target? International J Child Adolescent Health. 2009; Vol 2 (1): 19-30. Townsend MS, Young T, Ontai L, Ritchie L, Williams ST. Guiding family-based obesity prevention efforts in low-income children in the United States: Part 2 What behaviors do we measure? Intl J Child Adoles Health. 2009; Vol 2 (1): 31-48. Townsend MS, Shilts MK, Sylva K, Davidson C, Leavens, Sitnick S, Ontai L. Obesity Risk for Young Children: Development and initial validation of an assessment tool participants of USDA programs. Forum For Family and Consumer Issues. Winter 2014. Vol. 19, No.3. Townsend MS, Shilts MK, Styne DM, Allen L, Ontai L. Healthy Kids [Child obesity risk assessment tool, now 14 items reduced from 25, for low-income families with young children. Content includes diet, physical activity, screen time, sleep.] Design: M Reed. University of California Cooperative Extension. Copyright © Regents of the University of California. All rights reserved. April 2015. Shilts MK, Townsend MS, Ontai LL, Leavens LL and Davidson CA. Graphic Design by Reed ML. (2014, April 10) Healthy Kids. Retrieved from http://healthykids.ucdavis.edu/ Parents have direct influence over young children’s physical and social environments and specifically their physical activity, eating, sleep, and lifestyle behaviors (American Academy of Pediatrics 2003). Yet, many families are practicing nutrition, parenting, and lifestyle behaviors that set young children on trajectories for unhealthy weight gain. Recognizing that parents directly influence their children’s physical, eating, and social environments, the Institute of Medicine (IOM) and the American Academy of Pediatrics [AAP] recommend the development of assessments targeting families’ modifiable environmental and behavioral factors associated with the risk of pediatric obesity (AAP 2003; IOM 2005). Consistent with the AAP recommendation, a comprehensive evidence-based literature review identified twelve modifiable determinants of pediatric obesity (Ontai et al 2009). Another review focused on the behaviors practiced by low-income families within each of these twelve identified determinants and the corresponding tools available (Townsend et al. 2009). Previous Research Cognitive interviews (n=77) with ethnically diverse low-income parents provided contextually rich qualitative data for instrument development, including how respondents interpreted text and photographs and their recommendations for changes to improve understanding, consistency of interpretation, and appeal by limited literacy readers. Respondents modified text for all questions, revised content for most photographs, identified unnecessary text for elimination and suggested visual content to replace text resulting in a new version provided support for the face validity of the tool, now called Healthy Kids, with low-income respondents [Townsend et al. 2015]. BACKGROUND Recruitment Parent-child pairs were recruited at Head Start and WIC. Interviews for consent and data collection were conducted on site. A stipend of $10 was given to the parent at each interview session. Low-income parents (n=103) provided data about themselves and their young children. Longitudinal data collection included the 45-item Healthy Kids (HK) and child height/weight for BMI percentile and was repeated 24 months later. Of the 43 potential behavioral items, 14 were selected for the final model using random forests analysis and stepwise regression to predict BMI percentile. Anthropometry Two trained research assistants weighed each participant twice to the nearest 0.1 pound using the Seca Digital Medical Scale. Height was measured twice to the nearest 0.1 centimeter using the Perspective Enterprises stadiometer. BMI (kg/m2) was calculated as a continuous variable, using the average of the two measured weights (in kilograms) divided by the average of the two measured heights (meters squared). BMI percentile were then derived by using the Center for Disease Controls BMI Percentile Calculator for Children. Waist and hip circumference were measured twice to the nearest 0.1cm. Waist circumference was divided by height to calculate a ratio. Waist circumference was divided by hip circumference to calculate a second ratio. Healthy Kids 45-item Healthy Kids tool reflects the parents’ control their child’s environment for calorie intake, vegetables, eating as a family, sleep, physical activity, and screen time while modelling corresponding healthful behaviors. The 45 items visually demonstrate 23 behaviors identified in previous evidence analysis. Random Forest Analysis and Stepwise Regression Random forest, an alternative statistical method to generalized linear models, was applied to the 45 items from the Healthy Kids tool. After generating 100s of RF trees, an importance plot determined the relative importance of each question by computing the average error when the particular question is omitted from a tree. This method avoided problems faced by stepwise regression in fitting large models. Stepwise regression was applied to the top 20 items that were most predictive of child overweight. METHODS Random Forest Analysis Random Forest results for BMI percentile, waist circumference: height, waist:hip circumference is shown in Table 1 for T6 (3 months from baseline) and T12 (24 months from baseline). The most predictive HK items are identified in the importance table (Figure 1). Stepwise Regression Analysis The R 2 was .74 for the final model that included the HK items and BMI percentile compared to an R 2 of .56 for BMI percentile alone. The partial F-test (F = 4.01, p<.0001) comparing a model with BMI percentile and HK to model with BMI percentile alone supports the predictive value of HK tool. Summing the estimates indicates a negative relationship; the lower the HK score, the higher the child's BMI percentile 24 months later (Figure 2b). RESULTS Congress has authorized food and nutrition education programs in the United States serving low-income families to include an obesity prevention focus in their education programs for low-income families. In proposing the development of such a tool targeting the determinants of obesity, four federal programs should be considered for its use. They offer an excellent environment in which to make an impact on the pediatric obesity prevalence and are available in all or most low-income communities. They include the following: Head Start, Special Supplemental Nutrition Program for Women, Infants, and Children (WIC), SNAP-Ed and EFNEP. HK tool could be used for needs assessment. The Healthy Kids tool for low-income parents in our sample adds predictive value to the health providers' knowledge of the child's BMI 24 months later. Next step includes further testing with other low-income audiences in California. CONCLUSION A valid behavioral tool focusing on the behaviors under the control of the parent in the child’s environment would be beneficial for these programs for the purpose of needs assessment for the group and risk assessment for the individual parent. In addition, medical providers would benefit from a risk assessment tool to supplement a physical exam to predict a BMI trajectory in young children, 3-5 years. Our objective is to estimate predictive validity of a pictorial assessment tool based on BMI collected 24 months later (Figure 2a). OBJECTIVE The Healthy Kids website is designed for parents, educators and program directors (Shilts et al.). Parents can complete Healthy Kids (HK) and receive tailored nutrition and child feeding goals. Educators can use HK and the Guided goal setting intervention in education sessions. Program directors can tailor HK to client’s specific cultural group. http://healthykids.ucdavis.edu/ Figure 1 Question # Summarized T13 percentile T12 percentile T12 wa/hp T12 wa/ht T6 percentile T6 wa/hp T6 wa/ht Total (wa/hp not included) 1 Child outside x x 2 2 Child eat veg x x x x x 4 3 Bed time x x x x 4 4 Wake time 0 5 Child plays outside x x x x 3 6 Child not eat breakfast x x 2 7 Child eat fruit x x x x 2 8 Child drink milk _times a day 0 9 Child drink milk (type) x x x 3 10 Child play inside 0 11 Plan meals x x x x x x 4 12 I eat fruit x x x x x x 4 13 Buy veg x x x x x 4 14 Buy fruits x x x x x 3 15 Know child watches on TV x x x 2 16 I drink milk _times a day x x 0 17 Play outside with child x x x 3 18 Buy chips, candy x x x 3 19 Ready to eat fruit x x x x 3 20 Child eats beans x x x 2 21 Cookies, chips snacks x x 1 22 TV in bedroom 0 23 TV while eating x x x 2 24 TV hours per day 0 25 Picky eater 0 26 Apples, carrots snacks x x x x x x 4 27 Veg at main meal x x x 2 28 Cereal breakfast x x x 2 29 More than 1 veg x x x 1 30 Video/ computer x x x x x 4 31 Candy, cake _times per day x x x x 3 32 Soda x 0 33 Soda _times per day x x 1 34 Sports drinks _times per day x x 2 35 Child eats fast food x x x 3 36 Chips snack _times per day x x x x x x x 5 37 Sees eat veg x x 2 38 Family eats fried food x x 1 39 Ready to eat veg x x 1 40 Eat out x x x 2 41 Sit with child x x x x 3 42 Cook from scratch x x x 3 43 Trim fat x x x x 2 44 Eat skin x x x 2 45 Watch TV x 0 Table 1 0 when wa/hp is removed Medical providers would benefit from a risk assessment tool to supplement a physical exam to predict a BMI trajectory in young children, 3-5 years. Our objective is to estimate predictive validity of a pictorial assessment tool based on BMI collected 24 months later. Low-income parents (n=103) provided data about themselves and their young children. Longitudinal data collection included the 43-item Healthy Kids (HK) and child height/weight for BMI percentile and was repeated 24 months later. Of the 43 potential behavioral items, 14 were selected for the final model using random forests analysis and stepwise regression to predict BMI percentile. The R 2 was .74 for the final model that included the HK items and BMI percentile compared to an R 2 of .56 for BMI percentile alone. The partial F-test (F = 4.01, p<.0001) comparing a model with BMI percentile and HK to model with BMI percentile only supports the predictive value of HK tool. Summing the estimates indicates a negative relationship; the lower the HK score, the higher the child's BMI percentile 24 months later. Healthy Kids tool for low-literate parents adds predictive value to the medical providers' knowledge of the child's BMI. ABSTRACT Figure 2b The new version of Healthy Kids now contains 14 items and reflects the results of this study. Figure 2a

Upload: others

Post on 03-Feb-2021

5 views

Category:

Documents


0 download

TRANSCRIPT

  • Healthy Kids Obesity Risk Assessment Demonstrates Predictive Validity in Sample of Low-Income Children

    Marilyn Townsend PhD, RD, Mical Shilts PhD, Dennis Styne MD, Lindsey Allen PhD, Christiana Drake PhD, Lenna Ontai PhD

    Supported by National Research Initiative #2009-55215-05019 & Agriculture and Food Research Initiative #2010-

    85215-20658 from the USDA National Institute of Food and Agriculture, Human Nutrition and Obesity 93330.

    References Ontai L, Ritchie L, Williams ST, Young T, Townsend MS. Guiding family-based obesity prevention efforts in low-income children in the United States: Part 1− What determinants do we target? International J Child Adolescent Health. 2009; Vol 2 (1): 19-30. Townsend MS, Young T, Ontai L, Ritchie L, Williams ST. Guiding family-based obesity prevention efforts in low-income children in the United States: Part 2 −What behaviors do we measure? Intl J Child Adoles Health. 2009; Vol 2 (1): 31-48. Townsend MS, Shilts MK, Sylva K, Davidson C, Leavens, Sitnick S, Ontai L. Obesity Risk for Young Children: Development and initial validation of an assessment tool participants of USDA programs. Forum For Family and Consumer Issues. Winter 2014. Vol. 19, No.3. Townsend MS, Shilts MK, Styne DM, Allen L, Ontai L. Healthy Kids [Child obesity risk assessment tool, now 14 items reduced from 25, for low-income families with young children. Content includes diet, physical activity, screen time, sleep.] Design: M Reed. University of

    California Cooperative Extension. Copyright © Regents of the University of California. All rights reserved. April 2015. Shilts MK, Townsend MS, Ontai LL, Leavens LL and Davidson CA. Graphic Design by Reed ML. (2014, April 10) Healthy Kids. Retrieved from http://healthykids.ucdavis.edu/

    Parents have direct influence over young children’s physical and social environments and specifically their physical activity, eating, sleep, and lifestyle behaviors (American Academy of Pediatrics 2003). Yet, many families are practicing nutrition, parenting, and lifestyle behaviors that set young children on trajectories for unhealthy weight gain. Recognizing that parents directly influence their children’s physical, eating, and social environments, the Institute of Medicine (IOM) and the American Academy of Pediatrics [AAP] recommend the development of assessments targeting families’ modifiable environmental and behavioral factors associated with the risk of pediatric obesity (AAP 2003; IOM 2005). Consistent with the AAP recommendation, a comprehensive evidence-based literature review identified twelve modifiable determinants of pediatric obesity (Ontai et al 2009). Another review focused on the behaviors practiced by low-income families within each of these twelve identified determinants and the corresponding tools available (Townsend et al. 2009).

    Previous Research Cognitive interviews (n=77) with ethnically diverse low-income parents provided contextually rich qualitative data for instrument development, including how respondents interpreted text and photographs and their recommendations for changes to improve understanding, consistency of interpretation, and appeal by limited literacy readers. Respondents modified text for all questions, revised content for most photographs, identified unnecessary text for elimination and suggested visual content to replace text resulting in a new version provided support for the face validity of the tool, now called Healthy Kids, with low-income respondents [Townsend et al. 2015].

    BACKGROUND

    Recruitment

    Parent-child pairs were recruited at Head Start and WIC. Interviews for consent and data collection were conducted on site. A stipend of $10 was given to the parent at each interview session.

    Low-income parents (n=103) provided data about themselves and their young children. Longitudinal data collection included the 45-item Healthy Kids (HK) and child height/weight for BMI percentile and was repeated 24 months later. Of the 43 potential behavioral items, 14 were selected for the final model using random forests analysis and stepwise regression to predict BMI percentile.

    Anthropometry

    Two trained research assistants weighed each participant twice to the nearest 0.1 pound using the Seca Digital Medical Scale. Height was measured twice to the nearest 0.1 centimeter using the Perspective Enterprises stadiometer. BMI (kg/m2) was calculated as a continuous variable, using the average of the two measured weights (in kilograms) divided by the average of the two measured heights (meters squared). BMI percentile were then derived by using the Center for Disease Controls BMI Percentile Calculator for Children.

    Waist and hip circumference were measured twice to the nearest 0.1cm. Waist circumference was divided by height to calculate a ratio. Waist circumference was divided by hip circumference to calculate a second ratio.

    Healthy Kids

    45-item Healthy Kids tool reflects the parents’ control their child’s environment for calorie intake, vegetables, eating as a family, sleep, physical activity, and screen time while modelling corresponding healthful behaviors. The 45 items visually demonstrate 23 behaviors identified in previous evidence analysis.

    Random Forest Analysis and Stepwise Regression

    Random forest, an alternative statistical method to generalized linear models, was applied to the 45 items from the Healthy Kids tool. After generating 100s of RF trees, an importance plot determined the relative importance of each question by computing the average error when the particular question is omitted from a tree. This method avoided problems faced by stepwise regression in fitting large models. Stepwise regression was applied to the top 20 items that were most predictive of child overweight.

    METHODS

    Random Forest Analysis Random Forest results for BMI percentile, waist circumference: height, waist:hip circumference is shown in Table 1 for T6 (3 months from baseline) and T12 (24 months from baseline). The most predictive HK items are identified in the importance table (Figure 1).

    Stepwise Regression Analysis The R2 was .74 for the final model that included the HK items and BMI percentile compared to an R2 of .56 for BMI percentile alone. The partial F-test (F = 4.01, p