social marketing implementation: a way of · youth involvement items ga.2. to what extent do youth...
TRANSCRIPT
Funded by the Substance Abuse and Mental Health Services Administration (SAMHSA) through
the Child, Adolescent and Family Branch, Center for Mental Health Services
Kirstin Painter, PhD, SAMHSA Contracting Officer Representative
Emily Lichvar, PhD SAMHSA Alternate Contracting Officer Representative
Social Marketing Implementation: A Way of
Getting Youth Involved in Systems of Care
Monique Thornton, MPH; Nataly Johanson Tello; Sushama Rajapaksa, MA; Joselin Bravo;
Amanda Vithidkul, MPH; Chandria Jones, PhD, MPH
Disclaimer
The views, opinions, and content expressed in this presentation do not necessarily reflect the views, opinions, or policies of the Center for Mental Health Services (CMHS), the Substance Abuse and Mental Health Services Administration (SAMHSA), or the U.S. Department of Health and Human Services (HHS).
Focus of this Presentation
• Describe the extent to which social marketing-related mechanisms and strategies are being implemented by grantees
• Describe the effectiveness of these social marketing-related mechanisms and strategies
• Describe how a grantee’s level of implementation of social marketing-related mechanisms and strategies relates to youth involvement in that grant
Data Source
• The Self-Assessment of Implementation Survey (SAIS) is a data collection component of the CMHI SOC Expansion National Evaluation conducted by Westat
– Quantitative self-report measure of grantee implementation completed by respondents at programmatic and administrative levels from 34 FY2013 and FY2014 SOC expansion grantees
– Administered online in the second year of grant funding
SAIS Content Areas
• The SAIS covers the following content areas:– Barriers and facilitators to implementation – Governance– Management– Support of local service delivery– Geographic area covered by SOC– SOC principles: family-driven, youth-guided, individualized,
evidence-supported, culturally and linguistically competent, interagency/collaborative, coordination, accessible, community based, least restrictive
Social Marketing Items
Not planned
1
Planned but
not started
2
Somewhat
implemented
3
Significantly
implemented
4
Extensively
implemented
5
Don’t know
99
M.5.a. SOC sites use several strategies at the jurisdiction level to ensure access to
services: Social marketing of system of care
S.4.a. SOC sites use several jurisdiction-level strategies to support local service
systems in their efforts to reach underserved populations: Support of local social
marketing efforts
GA.5.a. Which of the following strategies are used to share information on SOC
implementation and expansion efforts with partner agencies and organizations across
the jurisdiction?: Social marketing efforts
Please select the response that best describes how each is being used in [your system of care].
Youth Involvement Items
GA.2. To what extent do youth organizations and/or representatives actively participate in planning,
implementation, and expansion activities across the jurisdiction (for example, are there areas with
little or no active youth representation)?
G.3.b. Overall, how involved have youth representatives been in the SOC governance at the
jurisdictional level in the past 6 months?
M.2.b. Overall, how involved have youth representatives been in SOC management at the
jurisdictional level in the past 6 months?
Please select the response that best describes how each is being used in [your system of care].
Not at all involved A little involved Moderately involved Extensively involved Don’t know
1 2 3 4 99
Not
active
Active in a small area
of the jurisdiction
Active in about half of
the jurisdiction
Active in many areas/most of
the jurisdiction
Active throughout the
jurisdiction
Don’t
know
1 2 3 4 5 6
Methods
• Data analyzed in SAS Statistical Software
• Data was cleaned; recoded as needed
• Missing data was excluded from analyses
• Analyses included:
– Descriptive statistics
– Pearson correlations
– Frequencies
– Odds ratios
SAIS Respondents
Family Reps, 10%Other Agency Reps, 9%
CMHI Project Directors
Family Reps
Youth Reps
MH Agency Reps
CW Agency Reps
JJ/Education Agency Reps
Other Agency Reps
Quality Care Monitors
Preliminary Results: Descriptives
Table 1. Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees: Descriptive Statistics (N = 182)
Variable Mean SD Range n (%)
Social marketing strategies used to share information with partner agencies and organizations
4.36 1.33 1-6 120 (66%)
Social marketing strategies used to ensure access to services 4.19 1.42 1-6 145 (79%)
Social marketing strategies used to support local service systems in their efforts to reach underserved populations
4.01 1.41 1-6 120 (66%)
Extent to which youth organizations and/or representatives actively participate in activities
3.16 1.23 1-5 147 (80%)
How involved youth representatives have been in the SOC governance at the jurisdictional level in the past 6 months
2.84 .99 1-4 138 (75%)
How involved youth representatives have been in SOC management at the jurisdictional level in the past 6 months
2.69 1.00 1-4 143 (78%)
Preliminary Results: Correlations
Table 2. Pearson Correlation Coefficients for Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees
Youth org/rep active participation in activities
Youth repinvolvement in SOC governance
Youth repinvolvement in SOC management
Social marketing strategies to ensure access to services
0.47979*n = 131
0.26018n = 116
0.30311n = 126
Social marketing strategies to support local service systems in their efforts to reach underserved populations
0.47474*n = 114
0.46725*n = 99
0.39408*n = 109
Social marketing strategies to share information with partner agencies and organizations
0.43346*n = 112
0.32330n = 99
0.37241*n = 110
n = the number of observations
*p<.0001
Preliminary Results: Odds Ratios
Table 3. Frequencies for Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees
Youth Involvement
Social Marketing Implementation
High Low Total
High68(44%)
36(23%)
104(67%)
Low21(13%)
31(20%)
52(33%)
Total89(57%)
67(43%)
156(100%)
Grantees that reported having high social marketing implementation were 1.79 times more likely to report high youth involvement when compared to grantees who reported low social marketing implementation.
Discussion
• The preliminary findings from these analyses align with findings from qualitative data analysis of stakeholder interviews with project directors and youth and family representatives from FY2013 and FY2014 System of Care (SOC) Expansion and Sustainability Implementation grantees.
Source: Thornton, M., Vithidkul, A., Jones, C., Jones, G., and Rosenblatt, A. (2017. March). Developing a
Conceptual Framework for Social Marketing within Children’s Mental Health Systems of Care (poster
presenter). Annual Children’s Mental Health Research & Policy Conference on Child, Adolescent, and
Young Adult Behavioral Health, Tampa, FL.
Discussion
A keyword search query was conducted in NVivo 11 on the stakeholder interviews. Thirty grantees (13 FY2013 and 17 FY2014) were identified, and 53 interviews were pulled into the query results.
Interviews were reviewed to create this descriptive model.
The highlighted components of the model represent key ways in which grantees were involving youth in their social marketing activities.
Limitations
• Limited data
• Missing data
• Possible confounding variables
• Self-report bias
Conclusions
• There is some relationship between the level of implementation of social marketing strategies and youth involvement in grants.
• There are several ways to involve youth in social marketing planning and implementation, which could act as a gateway to greater participation in grant management, governance, and expansion activities.
Next Steps
• Use network analysis to understand youth engagement in grantee implementation efforts in social marketing
• Examine the practice steps involved in implementing social marketing strategies
More on Youth Involvement
Symposium: Elevation, Engagement & Empowerment: Advancing Youth Voice in Evaluation
Symposium Chair: Abram Rosenblatt, PhD, Westat, Rockville, Maryland
Discussant: Dorothy Webman, DSW, Webman Associates, LLC, New York, New York
Tuesday, March 6, 2018
1:30 pm - 2:30 pm
Bayshore 5
Measure What You
Treasure: Engaging
Youth in Data
Collection
Glynis Jones, MSM; Chandria Jones, PhD,
Westat, Rockville, MD
Innovative Approaches
for Engaging Youth in
Systems of Care
Benedicta Osafo-Darko, MA; Chandria Jones,
PhD; Viola Samson, MD; Affoue A. Sara
Ayemonche, BS; Abram Rosenblatt, PhD,
Westat, Rockville, MD
Moving Forward: The
Next Phase of Youth
Voice in Evaluation
Brianne Masselli, Youth MOVE National,
Portland, ME