mhat evaluation report...mhat evaluation report 3 background schools are increasingly being called...

30
MHAT Evaluation Report Dr Melissa A Cortina Angelika Labno Contents Executive Summary ............................................................................................................. 2 Background.......................................................................................................................... 3 Evaluation Objectives and Methodology .............................................................................. 5 Analysis ............................................................................................................................ 5 Findings ............................................................................................................................... 6 Baseline and feedback surveys ........................................................................................ 6 Follow-up survey ............................................................................................................ 12 Training feedback ........................................................................................................... 17 Qualitative data............................................................................................................... 20 Online workshops (Post COVID-19) ............................................................................... 23 Discussion ......................................................................................................................... 25 Limitations ...................................................................................................................... 27 Conclusion and recommendations ..................................................................................... 28 References ........................................................................................................................ 29 Published 30 June 2020

Upload: others

Post on 16-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

Dr Melissa A Cortina Angelika Labno

Contents

Executive Summary ............................................................................................................. 2

Background .......................................................................................................................... 3

Evaluation Objectives and Methodology .............................................................................. 5

Analysis ............................................................................................................................ 5

Findings ............................................................................................................................... 6

Baseline and feedback surveys ........................................................................................ 6

Follow-up survey ............................................................................................................ 12

Training feedback ........................................................................................................... 17

Qualitative data ............................................................................................................... 20

Online workshops (Post COVID-19) ............................................................................... 23

Discussion ......................................................................................................................... 25

Limitations ...................................................................................................................... 27

Conclusion and recommendations ..................................................................................... 28

References ........................................................................................................................ 29

Published 30 June 2020

Page 2: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

2

Executive Summary

Mental Health Awareness Training (MHAT) is an evidence-based programme developed

by the Anna Freud National Centre for Children and Families and commissioned by the

Department for Health and Social Care. The one-day training delivered between

September 2019 and June 2020 aimed to provide knowledge, skills, and practical tools to

staff working in secondary schools and to promote and integrate mental health and

wellbeing across the whole school community. 120 sessions were delivered across

England, including 4 virtual workshops, to 1155 staff from 643 eligible secondary schools,

sixth form colleges, PRUs, and free schools.

Findings indicate that the programme successfully improved attendees' knowledge and

confidence in supporting student mental health and provided useful tools and resources to

enable staff to start to support a whole school approach to mental health in their setting.

The staff sampled had a high level of knowledge and confidence about supporting mental

health before the training, indicating that mental health may be moving higher up on the

public agenda. Despite these high levels, staff showed significant improvements across all

domains of knowledge and confidence. This improvement was substantiated by attendees'

qualitative feedback. School staff may need additional support with understanding what

services may be available locally and how they can promote protective factors in pupils,

which highlights the need for collaborative working and continued training for teachers,

respectively.

The trainings were extremely well-received, with over 99% of respondents indicating they

would recommend the programme.

'I feel far more knowledgeable about what we should be doing to support students and

staff in school.' - Leadership staff

'I had done a lot of training before but still learnt new things and increased confidence.' -

Teaching staff

MHAT and similar programmes may become increasingly important in the coming months

in light of the COVID-19 pandemic, as an increase in students with mental health

difficulties is anticipated. In addition, following the unprecedented amount of stress that

teachers and society have been under due to COVID-19, whole school approaches to

mental health that include both pupil and staff mental health will become increasingly

important. Lastly, a joined-up approach between local services and schools can help

facilitate this support.

Page 3: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

3

Background

Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two in five young people in England exhibit high levels of emotional problems, conduct problems, or hyperactivity (Deighton et al., 2019). In a climate of increasing prevalence of difficulties among children and young people, teachers often feel ill-equipped to do so (Kidger, Gunnell, Biddle, Campbell, & Donovan, 2009). A government-based initiative aimed to provide training to 1,000 schools to promote a whole school approach to mental health and wellbeing and upskill secondary school teachers with basic mental health knowledge.

Mental Health Awareness Training (MHAT), commissioned by the Department of Health and Social Care (DHSC), was developed in 2019 by clinicians at the Anna Freud National Centre for Children and Families (AFNCCF). AFNCCF were commissioned to deliver the final year of a three-year programme to make mental health awareness training available to eligible schools between September 2019 and March 2020. Schools were eligible if (1) they had not received Mental Health First Aid (MHFA) Training in 2017-2018, and (2) were identified by their Phase of Education to be secondary, middle deemed secondary, all through and eligible sixth form colleges, pupil referral units, free schools, and Secure Training Centres. This was based on the government database of all schools: https://get-information-schools.service.gov.uk/. The one-day training featured practical advice, support and resources for teachers to share with colleagues and implement in schools to help their pupils to develop good mental health practices. The course was free for up to two members of staff of eligible secondary schools, sixth form colleges, PRUs, and free schools.

Attendees also received a copy of the materials to help them share their knowledge with colleagues covering:

• General mental health and wellbeing knowledge

• Five steps to creating a wellbeing school: a framework for schools and colleges to

create a whole school approach to mental health and wellbeing

• How to support children and young people mental health and staff in a school

environment

• Spotting the early signs of a mental health problem

• Specialist services

• Resources, signposting, discussion, and networking

Between September 2019 and March 2020, 116 sessions were conducted across England. MHAT sessions were scheduled to run through the end of March, but the remaining eight workshops, which were scheduled from 17 March onwards, were cancelled due to COVID-19. In light of the early ending of face-to-face delivery, an additional four sessions were run virtually on 18 May, 19 May, 21 May, and 4 June 2020.

Page 4: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

4

The sessions were led by school outreach trainers who had an educational and/or clinical background and drew upon their lived experiences in the sessions. This report contains findings from the programme delivered as planned, as well as feedback from four additional online workshops.

Page 5: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

5

Evaluation Objectives and Methodology

The aim of the MHAT evaluation was to explore the implementation and impact of the training on participating staff and their schools over time. The evaluation Key Performance Indicator (KPI) for the training was that 70% of attendees would recommend the training to colleagues.

The study employed a mixed-methods design and ran from September 2019 to June 2020. All staff were invited to complete online surveys on attitudes related to supporting student and staff mental health (MH) at two time points (pre-training and nine weeks post-workshop attendance). The surveys asked about knowledge and awareness of MH issues; confidence in supporting children and young people; stigma and the school’s approach to MH; confidence in signposting support; as well as staff wellbeing. The post-training survey additionally asked about experiences of implementing learning; barriers to implementation; observations of impact; and feedback on resources. Items for the surveys were taken from surveys widely used in similar evaluations and bespoke items were created to address the programme goals. Attendees were also invited to complete a training feedback survey immediately following the workshop which asked about their perceptions of the training; changes in knowledge and confidence around MH; actions for the future; and barriers to implementing the actions. In addition, phone interviews were conducted to understand how the training has been cascaded to other staff; what actions had been taken or were planned; the impact of the training (on self and school); and detailed training feedback.

Analysis

Descriptive and inferential statistics were used to examine the questionnaire data. Open-ended questions were examined qualitatively. All interviews were transcribed and analysed using interpretative phenomenological analysis (IPA), which is concerned with examining experiential research questions (Smith, Flowers, & Larkin, 2009).

Recruit participating

staff

July 2019+

Baseline survey

Sep 2019 -Jan/Feb

2020

Training feedback

survey

Sept 2019 -March 2020

Phone Interviews

Dec 2019 or Feb 2020

Follow-up survey

Nov 2019 -April 2020

Online workshopsMay - June

2020

Final report

June 2020

Page 6: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

6

Findings

Baseline and feedback surveys

Participants

A total of 959 baseline surveys were collected between September 2019 and March

2020; however, after removing duplicates and blank surveys, 874 surveys were included in

the baseline analysis.

Of those that completed the baseline survey, 231 were leadership (27.4%), 131 were

teaching staff (teacher, lecturer; 15.6%), 433 were teaching support staff (teaching

assistant, learning mentor, pastoral support; 51.4%), and 42 indicated ‘other’

(administrative, premises, etc.; 5%); five participants preferred not to indicate (0.6%). The

majority of participants were female (83.6%), followed by male (15.8%), transgender

(0.1%), and 'prefer not to say' (0.5%). The sample was primarily White British (87.4%),

followed by White Other (3%), Black/British Caribbean (2.5%), and less than 2% for all

other, which varies slightly from the ethnicities in UK secondary schools. The breakdown

of ethnicities in UK secondary schools varies slightly: 76.1% is White British, 4.4% White

Other, 1.1% Black/British Caribbean, and 2.1% Indian (Gov.uk, 2020). Approximately half

of all participants worked in a school for more than 10 years: 30% worked for more than 15

years, 21% worked for 10-15 years, 15.4% worked for 4-6 years, 13.8% worked for 7-10

years, 13.1% worked for 1-3 years, and 6.7% worked for less than 1 year. 1 in 6 attendees

were their school's mental health lead (Table 1).

Table 1. Percentage of respondents serving as school mental health leads

Response choice Frequency Percentage

I am the Designated Mental Health Lead in my school

146 17.3

My school has a Designated Mental Health Lead

361 42.9

I am unsure if my school has a Designated Mental Health Lead

335 39.8

Following the workshops, 774 workshop feedback survey were collected between

September 2019 and March 2020. After removing duplicates, blank surveys and surveys

with less than two completed items, 735 surveys were included in the workshop feedback

analysis. This included responses from: 205 leadership (28.4%), 131 teaching staff

Page 7: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

7

(18.1%), 354 teaching support staff (49%), 29 'other' (4%); 3 preferred not to indicate

(0.4%) and 13 did not select a response.

Knowledge and self-efficacy

Eight items from the baseline survey were analysed to measure participants’ level of

knowledge and self-efficacy in supporting student mental health and varied by item (Error!

Reference source not found.). Nearly all participants felt they knew what mental health

support was available in school (92.6% 'strongly agree' or 'agree'). 82.7% ('strongly agree'

or 'agree') felt they knew the things they can do as staff to promote and support students'

wellbeing and 82.4% ('strongly agree' or 'agree') felt equipped to identify signs and

symptoms that may be linked to a mental health issue. Similarly, 82.2% ('strongly agree' or

'agree') felt aware of a range of risk factors and causes of mental health issues. Nearly

three-quarters of the sample felt they knew how to help children with mental health issues

access appropriate support. Rates of agreement were lower for the following three items:

61.2% ('strongly agree' or 'agree') felt they were knowledgeable about wide range of

mental health issues; 58.3% ('strongly agree' or 'agree') felt they knew how to provide

appropriate mental health support for all students; and 56% ('strongly agree' or 'agree') felt

they were aware of a range of protective factors for mental health issues.

Figure 1. Baselines rates (%) around knowledge and self-efficacy

relating to mental health

34.6%

13.7% 7.9% 9.3% 10.5% 7.9% 5.7% 5.4%

58.0%

69.0% 74.5% 72.9%62.4%

53.3% 52.6% 50.6%

7.1%17.1% 17.0% 17.3%

26.1%37.3% 40.0% 42.5%

0.3% 0.2% 0.7% 0.5% 0.9% 1.5% 1.7% 1.5%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Know MHsupport

available inschool

(n=873)

Know thingsI can do topromote

and supportwellbeing(n=871)

Equipped toidentify

signs andsymptoms

(n=873)

Aware ofrisk factors

(n=871)

Know howto helpchildren

access MHsupport(n=873)

Know widerange of MH

issues(n=872)

Know howto providesupport for

all pupils(n=873)

Aware ofprotective

factors(n=871)

Strongly agree Agree Disagree Strongly disagree

Page 8: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

8

Confidence supporting children's mental health

Four items from the baseline survey were analysed to measure participants’ level of

confidence in supporting student mental health. Rates of confidence varied at baseline

(Figure 1). In a sample of 867 participants, 84% felt 'quite' or 'very confident' talking to

young people about their mental health. 75.7% felt confident ('quite' or 'very confident')

identifying behaviours linked to a mental health difficulty and 72.9% felt confident ('quite' or

'very confident') supporting or managing young people's mental health. Participants were

least confident about promoting protective factors in young people, with 58.2% feeling

'quite' or 'very confident'.

Figure 1. Baseline confidence rates (%) relating to support students' mental

health (n=867)

Signposting support

Four items from the baseline survey were analysed to measure participants' confidence

around signposting local services and support for student mental health and wellbeing.

Participants did not have high confidence of signposting students to support or services in

the local area (Figure 2). Participants felt most confident advising students about specialist

support within their school/college (84.5% 'very' or 'quite'). Over three-quarters felt

confident advising students how to help themselves and 71.7% felt confident ('very' or

'quite') pointing students to websites about online help. The lowest confidence rates were

for advising students about specialist support available in the local area, with only 56.4%

indicating higher levels confidence and nearly 2 in 5 indicating that they were 'not very

confident'.

23.0%

9.7% 13.5%7.6%

61.0%

66.0% 59.4%

50.6%

15.5%23.9% 26.1%

40.0%

0.6% 0.5% 1.0% 1.7%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Talking to young peopleabout their MH

Identifying behaviourslinked to MH difficulty

Supporting/managingyoung people's MH

Promoting protectivefactors in young people

Very confident Quite confident Not very confident Not at all confident

Page 9: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

9

Figure 2. Baseline confidence (%) in signposting support (n = 851)

School environment

Four items assessed perceptions of the school environment. An additional two items

assessed the frequency with which staff talked to young people about their mental health

and wellbeing and whether their school had a mental health policy.

The majority of participants perceived a supportive school climate in relation to mental

health and wellbeing (Figure 3). Nearly all respondents felt their school ethos is positive

and supportive, with 93.2% agreeing to some extent. 87.5% disagreed that mental health

is not a school priority, suggesting that most schools prioritised mental health. This was

supported by the finding that nearly three-quarters of participants agreed mental health

and wellbeing are reflected in the school curriculum. However, 21% of participants still

perceived some stigma around mental health at school.

30.8%

13.6%19.6%

12.2%

53.7%

63.9% 52.1%

44.2%

14.7%21.3%

25.7%

39.6%

0.8% 1.2% 2.6% 4.0%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Specialist support inschool/college

How to help themselves Websites about onlinehelp

Specialist support in localarea

Very confident Quite confident Not very confident Not at all confident

Page 10: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

10

Figure 3. Baseline ratings (%) school climate items (n = 862)

When asked how frequently they speak to young people in their school about their mental

health and wellbeing, most participants reported doing so regularly: 48.6% said daily

(n=425), 33.4% said weekly (n=292), 8.8% said monthly (n=77), 6.9% said less than

monthly (n=60), and 1.5% said never (n=13).

Nearly 2 in 5 reported not knowing whether their school had a mental health policy in place

and 1 in 5 reported their school did not have a mental health policy (Figure 4). Of the one

third who reported their school had a mental health policy, the majority included a staff

mental health policy.

1.2%3.0% 9.5%

20.9%11.4%

18.0%

64.6%

72.3%

63.6%

62.8%

24.2%

6.6%

23.9%16.2%

1.6% 0.2%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

MH isn't a priority inschool

There is stigma aroundMH in school

MH & wellbeing arereflected in curriculum

Positive & supportiveschool ethos that

promotes wellbeing

Strongly Agree Agree Disagree Strongly Disagree

Page 11: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

11

Figure 4. Percentages of respondents whose school has a mental health policy

in place at baseline (n = 858)

Staff wellbeing

The school climate related to staff wellbeing was measured in the baseline survey with

four items. Staff felt they would be well supported in school, but the data suggests stigma

towards staff mental health persists (Figure 5). 86.1% agreed they would be well

supported if they approached their manager with concerns about their mental wellbeing.

However, rates of agreement were lower for school senior leadership teams taking active

steps to support staff's mental wellbeing (68.1%). Just over half felt staff mental health is a

school priority, and only 49.4% felt encouraged to speak openly about their mental

wellbeing in school.

Don't know, 42.3%

No, 19.6% 76.3% Includes staff wellbeing

5.7% Does not include staff

wellbeing

18% Don't know

Yes, 36.9%

Mental health policy

Don't know No Yes

Page 12: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

12

Figure 5. Ratings (%) relating to staff wellbeing in schools

Additionally, participants reported their level of wellbeing using the Short Warwick-

Edinburgh Mental Wellbeing Scale (SWEMWBS; Stewart-Brown et al., 2009). Higher

mean scores indicate higher levels of positive mental wellbeing. Scores are interpreted in

comparison to other population averages; English population averages on the SWEMWBS

range from 23.2 for women to 23.7 for men (Ng Fat, Scholes, Boniface, Mindell, & Stewart-

Brown, 2017). The average score for this study's sample was 22.84 (SD=3.46, n=819),

indicating a slightly lower level of wellbeing than the national average.

Follow-up survey

Participants

286 follow-up surveys were collected from November 2019 to April 2020, covering all

workshops leading up to 13 March. Surveys were sent approximately 9 weeks after the

training. After removing duplicates and blank surveys, 269 surveys were included in the

analysis. The sample was representative of the baseline population regarding percentages

of job roles apart from slightly higher rates of female respondents (88.3%) and those

working in a school for more than 15 years (35.2%).

Change in knowledge and self-efficacy

Paired sample t-tests were conducted to compare knowledge and self-efficacy at baseline and follow-up. The significance level was adjusted using the Bonferroni correction, which

27.5%

12.2% 7.0% 5.3%

58.5%

56.0%

48.0%44.0%

12.0%

28.2%

39.2%44.3%

2.0% 3.7% 5.8% 6.4%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Manager would supportmy concerns (n=861)

SLT actively supports staffmental wellbeing (n=861)

Staff MH is a schoolpriority (n=862)

Encouraged to speakopenly about mental

wellbeing (n=861)

Strongly Agree Agree Disagree Strongly disagree

Page 13: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

13

divides the significance level (0.05) by the number of comparisons (Armstrong, 2014). The adjusted significance level for the eight items was p = 0.00625.

There were significant differences between the two means on all eight items (Table 2). The results suggest there was an increase in knowledge and self-efficacy to support student mental health from baseline to the 9-week follow-up, although there are limitations to attributing the increase to the training.

Table 2. T-test results for knowledge and self-efficacy items

Items

Baseline Follow-up t

p M SD M SD

Know MH support available in school

1.72 .62 1.43 .52 7.42 .000*

Know things I can do to promote and support wellbeing

2.02 .55 1.42 .49 15.74 .000*

Equipped to identify signs and symptoms

2.09 .52 1.57 .50 14.80 .000*

Aware of risk factors

2.04 .51 1.50 .52 14.54 .000*

Know how to help children access MH support

2.16 .62 1.56 .52 14.90 .000*

Know wide range of MH issues

2.26 .62 1.65 .59 14.88 .000*

Know how to provide support for all pupils

2.38 .62 1.64 .58 16.48 .000*

Aware of protective factors

2.41 .62 1.62 .54 20.37 .000*

*p < 0.001. Note. Agreement to the items is measured on a 4-point scale in which 1

indicates strongly agree and 4 indicates strongly disagree.

Change in confidence

Paired sample t-tests were conducted to compare confidence at baseline and follow-up. The adjusted significance level for the four items was p = 0.0125.

There were significant differences between the two means for all four items (Table 3).

Page 14: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

14

The results suggest there was an increase in confidence talking with and supporting students' mental health and wellbeing from baseline to the 9-week follow-up, although as stated earlier, there are limitations to attributing the increase to the training.

Table 3. T-test results for confidence items, n=265

Items

Baseline Follow-up t

p value

M SD M SD

Talking to young people about their MH

1.9 .628 1.38 .51 13.77 .000*

Identifying behaviours linked to MH difficulty

2.14 .57 1.48 .52 16.89 .000*

Supporting/ managing young people's MH

2.14 .64 1.53 .52 14.97 .000*

Promoting protective factors in young people

2.35 .64 1.55 .56 17.37 .000*

*p < 0.001. Note. Confidence is measured on a 4-point scale in which 1 indicates very

confident and 4 indicates not at all confident.

Change in staff wellbeing

Participants completed the SWEMWBS measure again at follow-up. As stated earlier,

higher scores indicate greater wellbeing. The average score went up to 24.14, SD=3.89,

n=254. There was a statistically significant improvement in wellbeing from baseline

(M=23.15, SD=3.68) to follow-up (M=24.19, SD=3.91), t(243)=-5.198, p < 0.001, indicating

that participants had higher wellbeing at follow-up. This suggests an improvement in

wellbeing before the training and 9 weeks after attending training, although several things

could have improved wellbeing aside from the training.

Impact and actions post-training

To help attribute change to the training, the follow-up survey asked if the training improved

knowledge and confidence. 98.8% of participants (n=255) indicated that the training

improved their knowledge about children and young (CYP) mental health, and 98.1%

(n=253) said it improved both their awareness of the available sources of support and

Page 15: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

15

information for mental health issues and their confidence in talking to CYP about their

mental health and wellbeing.

87.2% of participants (n=257) felt the resources were 'very helpful' or 'moderately helpful',

9.3% (n=24) felt they were 'somewhat helpful', and the remaining 3.5% (n=9) chose 'not

very helpful'. Participants wrote what resources they had used, including: Anna Freud

resources (e.g. We All Have Mental Health assembly, On My Mind toolkit), 'Five Steps to

Mental Health and Wellbeing', Childline, Heads Together, MindEd, The Mix, Kooth,

Samaritans, Youth Wellbeing Directory, NSPCC, Papyrus, and Education Support

Partnership. Feedback on the resources was generally positive. Participants found them to

be easy to use, clear, concise, and up to date. The only exception to this was MindEd,

which one participant found difficult to navigate. In terms of how attendees shared or used

resources in their settings, a number of methods were reported. Whole-school tactics

involved publicly displaying information via posters, information boards, website

directories, forums, or booklets and leaflets. Information was also shared verbally via

assemblies, tutor sessions, workshops, training/inset days, and 1:1 or group sessions with

pupils. The most frequently used resources are shown in Figure 7. In addition to these,

one-quarter of attendees who responded to the follow-up survey (64 of 258 respondents)

indicated that they had used the 'Five Steps to Mental Health and Wellbeing'. Some of

these participants created an action plan for their school using the 'Five Steps' and several

others used it to focus on staff wellbeing initiatives. In some cases, guidance from the 'Five

Steps' was shared with students through whole-school events.

Figure 7. Resources accessed from the training

Note: Multiple resources could be selected.

195

94

86

85

77

70

38

35

30

28

0 20 40 60 80 100 120 140 160 180 200

AFC booklets on MH and wellbeing

MindEd

Schools in Mind

NSPCC website

On My Mind Website

Childline

Youth Wellbeing Directory

Education Support Partnership

The Mix helpline

Thrive Framework

Number of responses

Page 16: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

16

Sharing information & examples

Participants were asked whether they had shared knowledge or resources from the

training with a colleague; 87.2% (n=225) indicated 'yes' and 12.8% (n=33) indicated 'no'.

Participants reported sharing training information primarily through visuals or face-to-face

meetings. Some participants said they shared a copy of the training presentation with

colleagues via email or staff meeting while others presented a condensed version of

MHAT to staff or even the whole school. Information was cascaded in both formal and

informal discussions with staff, especially senior leadership, pastoral teams, wellbeing

staff, and heads of years. Others signposted resources from the training through handouts

and displays.

Examples of actions since training

Attendees were asked to plan what actions they wanted to take following the workshop. In

the follow-up survey, nine weeks after the workshop, participants described how they had

progressed with actions in their school since the training. Approximately one-third of

participants had not yet started on their action or progressed slowly. Many respondents

who shared their actions focused on a whole school approach to mental health and

wellbeing. For example, many had talked to senior leadership or pastoral staff about

auditing school resources, implemented mental health initiatives for students and staff,

signposted to parents/carers and developed a wellbeing policy. Others worked to raise

staff awareness and change the school culture by embedding resources in the school (e.g.

creating a desktop icon for signposting) and training staff on identifying behaviours and

signposting to services. Staff reported having more knowledge and confidence to support

students and parents, using more appropriate language around mental health, and setting

up school support such as LGBT+ groups or counselling. In more recent responses, staff

reported school closure due to COVID-19 disrupted their plans to share learning or

implement initiatives. They indicated that instead, they planned to use the time to revisit

the training materials and plan for the future. Another participant created an online forum

for vulnerable students to access.

The training was positively reviewed by many participants, with some calling for additional

training. Below are a few illustrative quotes from the survey:

'An incredibly informative, strategy led course that has allowed us to develop and shape

the way we focus on supporting the mental health of our staff and students. Couldn't

recommend it highly enough.' - Leadership role

'I found the course incredibly interesting and thought provoking. It was delivered in a way

that encouraged discussion and questioning, allowing all to participate.' - Designated

Mental Health Lead

Page 17: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

17

'I came home so much more confident in dealing with mental health.' - Teaching support

role

Training feedback

Immediate impacts of training

Immediately following the training, 735 attendees rated their previous levels of knowledge

and awareness of mental health issues and local resources, and confidence in talking with

students and supporting their mental health (Figure 8).

Figure 8. Self-reported levels of knowledge and confidence before training

Less than 15% of all respondents reported an 'excellent' level of knowledge or confidence

on all the items. 54% felt their level of knowledge of mental health issues was 'excellent' or

'very good', but only 35.4% felt knowledgeable ('excellent' or 'quite') about local resources.

Over half of respondents reported a high level of confidence ('excellent' or 'quite') talking

with students about their mental health, and 49.1% felt confident ('excellent' or 'quite') in

supporting student mental health.

Attendees were also asked to indicate to what extent they found the training helpful (n =

723) and to what extent the training improved their knowledge and confidence (n = 724). A

full breakdown of responses is shown in Figure 9.

0.5%4.8%

1.1% 1.6%

9.1%

26.1%

10.1% 12.9%

36.3%

33.7%

31.7%36.3%

43.4%

27.6%

42.3%37.4%

10.6% 7.8%14.8% 11.7%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Knowledge & awarenessof MH issues

Knowledge of localresources for MH

Confidence talking withstudents about MH

Confidence supportingstudent MH

Poor Fair Good Very Good Excellent

Page 18: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

18

Figure 9. Self-reported levels of improvement since the training

Most attendees (94.1%) found the training helpful ('a great deal' or 'quite a lot'). The

majority (89.1%) of attendees reported that the training had improved their knowledge and

awareness of CYP mental health 'a great deal' or 'quite a lot', and 86.7% felt the training

increased their knowledge of local resources available. Nearly 90% indicated that the

training had improved their confidence to support CYP mental health. Moreover, 99.03% of

attendees said they would recommend the training to colleagues, exceeding the KPI (70%

rating) by 29%.

Staff recommendation rate

99.03% Based on 724 attendees

Attendees were asked to write what they liked and disliked most about the workshop. The

main recurring responses were grouped and summarised. The main 'likes' were trainer,

delivery of presentation, content, atmosphere, and small group. Attendees thought it was

important that the trainer was knowledgeable and had relevant work experience, which

allowed them to understand school staff's unique challenges and barriers. They also

thought the presentation was well paced and was well balanced with time for questions

and discussions. The content was practical, informative, and accessible, and attendees

found the physical booklet of the presentation slides very useful. Attendees liked that the

Not at all, 0.4%

Not at all, 0.6%

Not at all, 0.6%

Not at all, 0.8%

A little, 0.3%

A little, 2.3%

A little, 3.0%

A little, 1.5%

5.1%8.0% 9.7% 7.7%

19.5%

26.9%32.2%

31.8%

74.7%

62.2%54.6% 58.1%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Find the training helpful Improve awareness andknowledge of CYP MH

Improve knowledge oflocal resources

Improve confidence tosupport CYP MH

Not at all A little A moderate amount Quite a lot A great deal

Page 19: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

19

atmosphere was informal and non-judgemental, and the small group size allowed them to

meaningfully interact, share best practice and network.

Nearly half of the survey responders said there was nothing they disliked about the training

(approximately 419 attendees). Of the 300 who listed aspects they disliked, common

responses were the amount of content (some felt there was too much, some felt there was

not enough), venue issues, trainer issues (some felt certain trainers could have facilitated

the group better), and the role play activity.

Covering a large amount of material meant that at times attendees found the presentation

too fast paced or that discussion time was limited. Some attendees felt they spent too

much time sitting down and could have used more breaks or activities to break up the day.

Others felt the content was too introductory and could have been more in-depth in areas

such as supporting low-level difficulties. Attendees described issues with commuting to the

venue, parking, temperature/light conditions in the venue, and lack of lunch provided.

Respondents occasionally noted issues with the trainer such as reading off slides, a slow

pace (usually in the afternoon), or not managing group dynamics well. Lastly, many

participants understood the value of the role play activity but personally do not enjoy it.

Trainers were regularly monitored and given feedback at the beginning of the programme

and then on an ad-hoc basis (e.g. when a new trainer started). Workshop feedback was

monitored on a weekly basis and any issues were immediately flagged for the project team

to address.

Figure 10. Ratings of the methods and quality of training presentation, n=724

Poor0.4%

Good2.6%

Very good24.2%

Excellent72.8%

Methods and Quality

Page 20: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

20

Qualitative data

Staff Interviews

Three individual interviews were conducted with staff members who attended the training.

The transcripts were analysed together using IPA in order to understand 'How do school

staff use their learning from a mental health training?' Analysis of the data resulted in three

main themes. The first theme describes each participant's role in the school and how it has

influenced their plan of action following the training. The second theme illustrates how

each participant involved the school's senior leadership team and pastoral staff and the

importance of having their buy-in. In the last theme, participants describe adopting a

whole-school approach to embedding learning from the training.

Theme 1: Ascribing relevance of the training to self and the school context

The three participants had different 'starting points' or backgrounds which influenced the

way they interpreted learnings from the training and their relevance for the school.

Staff 1: 'Molly' is the school’s Designated Safeguarding Lead and for the last 18 months,

the emotional wellbeing lead. Her school has been a trailblazer site for Mental Health

Support Teams (MHST) since the start of the school year, so all staff had undergone

training on identifying difficulties and making referrals. As a result, she feels the school is

already aware and open-minded about mental health and school leadership is supportive

of staff wellbeing. She credits the training with increasing her knowledge of resources and

giving her ideas on how to better support staff wellbeing but adds, 'What it has done for

me is it's reassured me that we do things quite well'.

Staff 2: 'Becky' was hired as a full-time mental health lead at the start of the academic

year. She was able to create her role from scratch, and she credits MHAT with giving her

the knowledge and confidence to plan a whole-school mental health and wellbeing

strategy. She made posters of her notes from the training (e.g. activity ideas and

resources) and hung them in front of her desk for easy referencing. She described MHAT

as a roadmap for her planning:

'It also gave me so many ideas on what you could do and so many things that you can

actually put into practice…[It’s] helped sort of guide me in making sure I’m covering

everything that needs to be covered'.

Staff 3: 'Katie' is a wellbeing mentor who has worked in the position for two and a half

years. Her role is split between direct work with students and whole-school work with

senior leadership. The MHAT training made her realise the need to do more strategic

work, but she acknowledged limitations due to working just two days a week. She has

Page 21: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

21

used the training to help her school transition from a targeted, intervention-based

approach to a whole-school approach that involves upskilling all staff.

Theme 2: Involving senior leadership and pastoral staff

All three participants mentioned involving senior leadership and pastoral staff, either

related to cascading the information or assisting with whole-school initiatives.

Staff 1: As Molly is part of the senior leadership team (SLT), she has authority to

implement initiatives unless they require more budget or time allocation. She has not felt

the need to involve other SLT in discussions yet, but she shared her learning with her

fellow wellbeing lead (who runs the student wellbeing service) and pastoral staff.

Staff 2: Becky updates all staff on her work at weekly meetings, which includes SLT, and

her line manager – the Designated Mental Health Lead – is also part of the leadership

team. By having these discussions, Becky feels SLT have recognised the importance of

her work and have 'embraced' a mental health focus for the school.

Staff 3: Katie held a Continuing Professional Development (CPD) session summarising

key points from MHAT with the school’s pastoral team, which includes the assistant

headteacher. They recognised the need for more whole-school work and have been

involved in developing a strategy with guidance from the 'Five Steps' Approach. The

assistant headteacher in particular has helped with developing a mental health policy for

students and staff and organising mental health CPD for all staff. At the end of her

interview, Katie stressed the importance of leadership buy-in:

'The difference in being able to roll out, um, mental health and wellbeing effectively in this

school - or in any school, actually - um, along with having the right person to do it, is you

have to have the buy-in from the leadership'.

Theme 3: A whole-school mentality to embedding learning

The actions participants took following the training were reflective of a whole-school

approach to improving the mental health and wellbeing of students and staff.

Staff 1: Molly’s school had already been undertaking a whole school approach to

supporting students’ mental health and wellbeing; Since becoming a trailblazer site, they

have instated a student wellbeing service and trained staff on recognising issues and

referrals. Molly plans to build on that by delivering more mental health training to all staff

using material from MHAT. Rather than implementing a radically new initiative, Molly has

focused on improving current support. For example, she replaced all student resources

with those from MHAT and the Anna Freud Centre website. The training also changed her

perspective on the school’s 'time-out' policy, which allows students to leave lessons when

Page 22: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

22

they feel anxious or upset and will work on ways to help keep students in the classroom.

Regarding staff wellbeing, she plans to make recommendations to the multi-academy trust

on new ways to support staff, such as conducting a staff wellbeing survey. Because she

has not been able to dedicate much time to these initiatives – or because they are set in

the future – she anticipates seeing change over time: 'There will definitely be impact made

by the learning that I had on this course'.

Staff 2: There was no whole-school approach to mental health in Becky’s school before

she attended MHAT. Since the training, she’s been able to implement several initiatives:

mental health assemblies and form sessions, whole school events (e.g. World Mental

Health Day), a student mental health ambassador programme, an LGBTQ+ group, and

posters with information and guidance around the school. Regarding staff wellbeing, ideas

Becky took from MHAT included a staff wellbeing session, writing staff thank-you cards,

and signposting to resources such as the free helpline hosted Education Support

Partnership and meditation app Headspace.

Having worked on whole-school efforts from a 'blank canvas', Becky has been able to see

a direct impact on students, teachers, and school climate. She says it has broken up some

stigma around mental health, with teachers and students discussing issues more openly

and frequently. An increase in referrals may be reflective of teachers being more aware of

issues and better at identifying and referring students who are struggling. In one example,

Becky describes when a Year 8 student approached her after the 'We all have mental

health' assembly:

'He said, "Oh, I’ve been struggling for a really long time but […] the assembly’s given me

the confidence to come and tell you that I’m not okay"'.

Staff 3: It is not clear how far along the school was in their whole-school approach before

Katie attended MHAT, but she attributes the prioritisation of whole-school efforts to the

training. The pastoral team started holding monthly CPD sessions dedicated to mental

health and wellbeing and creating a mental health policy is now a top priority for the year.

In an effort to maximise her impact in a part-time position, Katie has turned to upskilling

students and staff to carry out mental health work. Katie delivered a peer mentoring

training programme to students and set a goal to have 100 students supported via peer

mentors by the end of 2020. She also delivered mental health awareness sessions to

students in classrooms and developed brief intervention sessions for teachers to deliver.

Consequently, Katie perceives teachers to be more confident delivering mental health

presentations and students to be more comfortable talking about and seeking help for

issues. Eventually, Katie would like to offer mental wellbeing sessions for staff and other

forms of support, but her limited time tends to focus on students:

Page 23: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

23

'I think to do this effectively, you need a full-time person who’s purely working on mental

health and wellbeing in the school…and I guess that barrier is funding to that'.

Online workshops (Post COVID-19)

A modified online version of the course was created due to school closures precipitated by

COVID-19 from 17th March. Some of the available features of the platform were utilised to

maintain the interactivity of the live sessions. Four online sessions were booked for the

18th, 19th, 21st May and 4th June. These were delivered via Zoom by two trainers, a

teaching professional and clinician. 60 people attended the courses, and 58 completed a

modified version of the training day evaluation survey at the end of the session. Of those

that completed the survey, 58.6% were teaching support, 29.3% were leadership, 6.9%

were teaching staff, and 5.2% were other.

Figure 11. Levels of knowledge and confidence before training (Post COVID-19)

The sample was similar to the sample who received in-person training in terms of previous

levels of knowledge and confidence relating to mental health (Figure 11), except for

slightly lower confidence supporting student mental health (43.1% indicated 'excellent' or

'very good'). This may reflect staff's uncertainty with transitioning to supporting students

virtually.

Figure 12 depicts the extent to which staff found the training helpful and felt the training

improved their knowledge and confidence. About the same percentage of respondents

0.0%1.7% 1.7% 1.7%

12.1%

29.3%

15.5% 13.8%

36.2%

34.5%

25.9%41.4%

37.9%

29.3%

41.4%

32.8%

13.8%5.2%

15.5%10.3%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Knowledge & awarenessof MH issues

Knowledge of localresources for MH

Confidence talking withstudents about MH

Confidence supportingstudent MH

Poor Fair Good Very Good Excellent

Page 24: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

24

(96.6%) found the training helpful ('a great deal' or 'quite a lot'). A slightly lower percentage

(81.1%) felt the training had improved their knowledge and awareness of CYP mental

health 'a great deal' or 'quite a lot', and 91.4% felt the training increased their knowledge of

local resources. Three-quarters of the sample indicated the training improved their

confidence to support CYP mental health, down from 90% in the previous sample. It

appears that face-to-face training may be more effective at increasing staff confidence.

Nearly half of the sample indicated they would have preferred an in-person training, as it

would have been more interactive and a better networking opportunity, but many still felt

the training was informative and well-presented given the circumstances.

'Presenters used the Zoom platform efficiently to facilitate smaller group discussion and

feedback through the chat room'. - Teaching staff

'Thanks so much for the amount of work that has been put in to make this happen virtually.

It was brilliant. There is no substitute for being face to face though.' - Leadership staff

Despite the limitations of a virtual workshop, 67.2% respondents still rated the methods

and quality of the presentations as 'excellent', and 100% of attendees said they would

recommend the training to colleagues.

Figure 12. Levels of improvement since the training (Post COVID-19)

Not at all, 0.0%

Not at all, 0.0%

Not at all, 0.0%

Not at all, 0.0%

A little, 0.0%

A little, 3.4%

A little, 1.7%

A little, 3.4%

3.4%

15.5%6.9%

20.7%32.8%

41.4%

36.2%

41.4%

63.8%

39.7%

55.2%

34.5%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Find the training helpful Improve awareness andknowledge of CYP MH

Improve knowledge oflocal resources

Improve confidence tosupport CYP MH

Not at all A little A moderate amount Quite a lot A great deal

Page 25: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

25

Discussion

MHAT is a DHSC-funded national programme delivered by AFNCCF which aimed to

provide knowledge, skills and practical tools to staff working in secondary schools, to

promote and integrate mental health and wellbeing across the whole school community.

The training is grounded on a rigorous evidence base and took place across England in

over 20 locations between September 2019 and June 2020. It covered what the evidence

tells us about mental health difficulties in schools, spotting the early signs of a mental

health problem, and positive approaches to promoting mental health and wellbeing in the

whole school community. The evaluation looked at the extent to which the programme

achieved its aims in terms of school staff's knowledge and confidence in supporting

students and staff wellbeing, levels of stigma, signposting support, as well as staff

wellbeing. Attendees perceptions about the training were also examined.

The evaluation KPI for the project was that 70% of attendees would recommend the

training to colleagues. The final recommendation rating was 99.03% (n=724), exceeding

the goal by more than 29% and indicating that the training was very well received.

The results support previous findings that staff training programmes in mental health can

significantly improve their knowledge, awareness, self-efficacy, and confidence in

supporting and promoting student mental health (Langeveld et al., 2011, Anderson et al.,

2018). There were statistically significant increases in knowledge of mental health,

confidence in supporting students, and staff wellbeing despite the sample having relatively

high baseline levels of mental health knowledge and confidence. The high level of

knowledge of mental health in attendees is likely attributable to the fact that many of them

had mental health or wellbeing-related duties in school. A high proportion of staff (three-

quarters) felt confident talking to and supporting students and identifying behaviours

associated with mental health difficulties. While this sample may have had particularly high

levels of knowledge around mental health to start, which has the potential to leave little

room for improvement, an Australian study which found half to two-thirds of teachers felt

knowledgeable and efficacious about aspects of mental health promotion such as

identifying difficulties or supporting students yielded similar results (Askell-Williams &

Lawson, 2013). Following the implementation of a whole-school framework, the study

found significant increases in knowledge and self-efficacy (Askell-Williams & Lawson,

2013).

When it comes to mental health in schools, there may be capacity to upskill staff

regardless of their current level of mental health skills, particularly around knowledge of

protective factors for mental health, how to provide appropriate support to all pupils, and a

wide range of mental health issues. This is supported by this study's qualitative feedback,

which found some staff wanted to learn more advanced material. Teaching staff had lower

rates of agreement than leadership and teaching support, with 38.9% of teachers aware of

Page 26: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

26

protective factors ('strongly agree' or 'agree) and 42% knowing how to provide appropriate

support ('strongly' agree' or 'agree'). Over half of staff reported high baseline confidence

around advising students about specialist support in the local, indicating that there still is a

need for staff to have a better understanding of local specialist support, as this can be key

in supporting CYP.

At baseline, staff wellbeing (M = 22.84) was below the national average (which ranges

23.2-23.7), with less than half reporting they felt encouraged to speak openly about their

own mental wellbeing in school and 21% of staff perceiving some stigma around mental

health at school in general. A lower wellbeing score supports previous findings that

teachers are at increased risk of poor wellbeing compared to other professions (Kidger et

al., 2016, Stansfeld, Rasul, Head, & Singleton, 2011). However, at follow-up (nine-weeks

post training), staff's wellbeing rose to 24.14, which is above the national average. While

improving staff wellbeing was not a direct aim of the programme, it is possible that

improving staff's knowledge and confidence in supporting the mental health and wellbeing

of their students, and providing them tools to do so, reduced their stress and/or provided a

sense of agency, which may have subsequently improved their wellbeing. One study found

feeling unprepared to support pupils' mental health is a major source of job stress that can

subsequently raise teachers' risk of burnout or attrition (Ekornes, 2017). However, it was

not possible to test this relationship within this study's methodology.

Following the training, many staff reported taking actions centred around a whole school

approach to mental health and wellbeing. This involved: cascading information to all staff,

students, and sometimes parents/carers; upskilling staff to carry out mental health

workshops and refer students; spreading awareness via visuals around the school and

whole-school events/assemblies; and implementing new support and services, such as

wellbeing ambassadors, student counselling, and staff wellbeing committees. The whole

school approach adopted by staff, involving multiple members of the school community, is

positive as evidence has shown that staff felt the key to successfully promoting mental

health in school was making it a school priority and engaging leadership, staff, students,

and parents (Cefai & Askell-Williams, 2017).

Overall, Mental Health Awareness Training was very well received with 99.03% of

attendees indicating that they would recommend MHAT to colleagues and high ratings of

the methods and quality of presentation (72.8% rated it 'Excellent'). Attendees particularly

liked the high level of trainer expertise, the presentation delivery, content, the

informal/relaxed atmosphere, and the small group size. The high satisfaction with the

training is not surprising as the sessions targeted key components of effective continued

professional development (CPD): content focus, active learning, coherence (i.e. the

connection between CPD and reality of the school context), duration, and collective

participation (Main & Pendergast, 2015). Although some attendees reported disliking the

amount of content and role play, it is possible that the training would not have had the

same positive impact without the level of content and learning opportunities. Role play is

Page 27: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

27

considered an effective component of experiential learning for bridging an understanding

between policy and practice (Mogra, 2012).

The qualitative work provides context to the findings and provides examples of the

different ways that attendees benefited from and embedded learning from MHAT in their

school.

'The trainer…had practical knowledge of where some of the barriers are, where some of

the difficulties are…she understood how stretched services are, both in terms of mental

health services and schools. And so I think the way she delivered it, it was very realistic

because, you know, it was from a viewpoint that really took into account the context

that schools are actually working in' - Staff 3, wellbeing mentor, from an interview

Limitations

This evaluation had a number of limitations that are worth noting. It was not possible to

statistically attribute improvements in knowledge, confidence, and staff wellbeing to the

training because there was no control group and other confounding factors were not

controlled for. However, in the follow-up survey, 98.8% of participants (n=255) 'strongly

agreed' or 'agreed' that the training improved their knowledge about CYP mental health,

and 98.1% (n=253) felt it improved their confidence in talking to CYP about their mental

health and wellbeing. The sample had a high baseline level of mental health knowledge

and confidence, which may not be representative of the general population of secondary

school teachers. However, with mental health and wellbeing increasingly on the agenda,

and recent policy placing more emphasis on the role of schools in supporting mental

health, schools are paying more attention to health and wellbeing and trying to equip staff

to the best of their ability (DoH & DfE, 2017). Schools may have offered staff training

related to the rollout of trailblazer sites, mental health support teams, and designated

mental health leads, which may contribute to this increased knowledge and confidence.

In addition, the sample was not entirely representative of the general UK school

population, which may limit generalisability of the findings. Nonetheless, the findings of the

impact of the training within the sample are resoundingly positive and support the use of

MHAT to provide secondary teachers with increased knowledge and confidence in

supporting mental health and wellbeing and promoting a whole school approach to do so.

The study was not a trial and therefore there was no control group to elucidate whether

these findings would have been the same after controlling for other contextual factors.

Page 28: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

28

Conclusion and recommendations

MHAT was a successful and well-received programme, exceeding the KPI of a 70%

recommendation rating to over 99%, that improved staff's knowledge and confidence

around mental health and provided practical skills and resources in which to better support

children and young people. The programme upskilled staff and helped lay the foundations

for future work building on a whole school approach, which is crucial to support CYP in a

sustainable way. Importantly, this evaluation found that online trainings are feasible and

maintain a high recommendation rating. While it is not suggested that online workshops

should replace face-to-face workshops, a flexible format would allow staff in hard to reach

locations or with limited resources to benefit from the training.

Based on these findings, it is essential that schools continue to embed the training and

support staff to take actions following the training, especially with the pandemic posing

new challenges for young people in terms of education, transition, wellbeing, and post-

school plans. A joined-up approach between local services and schools can facilitate this

support. Another option for supporting staff is creating a networking group for mental

health/wellbeing leads to share best practices and continue learning from each other.

Targeted communications for school leaders and mental health staff can offer guidance

and advice and serve as a continuation of the training, especially as many had expressed

an interest in more advanced training. A version of MHAT for primary schools should be

considered as a proactive approach to supporting pupil mental health. Some learnings

from this evaluation that could boost engagement include budgeting for lunch, giving staff

the option to attend the training virtually, and considering an alternative activity for role

play. Endorsement from the DHSC and Department of Education (e.g. advertising via their

respective channels) would also encourage engagement.

Page 29: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

29

References

Anderson, M., Werner-Seidler, A., King, C., Gayed, A., Harvey, S., & O’Dea, B. (2018).

Mental Health Training Programs for Secondary School Teachers: A Systematic

Review. School Mental Health, 11(3), 489-508. doi: 10.1007/s12310-018-9291-2

Armstrong, R. (2014). When to use the Bonferroni correction. Ophthalmic and

Physiological Optics, 34(5), 502-508. doi: 10.1111/opo.12131

Askell-Williams, H., & Lawson, M. (2013). Teachers’ knowledge and confidence for promoting positive mental health in primary school communities. Asia-Pacific Journal of Teacher Education, 41(2), 126-143. doi: 10.1080/1359866x.2013.777023

Cefai C., Askell-Williams H. (2017) School Staff’ Perspectives on Mental Health Promotion and Wellbeing in School. In: Cefai C., Cooper P. (eds) Mental Health Promotion in Schools. SensePublishers, Rotterdam

Deighton, J., Lereya, S., Casey, P., Patalay, P., Humphrey, N., & Wolpert, M. (2019). Prevalence of mental health problems in schools: poverty and other risk factors among 28 000 adolescents in England. British Journal of Psychiatry, 215(3), 565-567. doi: 10.1192/bjp.2019.19

Department for Education. (2020). School workforce in England: November 2018.

Retrieved from https://www.ethnicity-facts-figures.service.gov.uk/workforce-and-

business/workforce-diversity/school-teacher-workforce/latest

Department of Health and Department for Education. (2017). Transforming children and young people’s mental health provision: a green paper. Retrieved from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/664855/Transforming_children_and_young_people_s_mental_health_provision.pdf

Ekornes, S. (2017). Teacher stress related to student mental health promotion: the match between perceived demands and competence to help students with mental health problems. Scandinavian Journal of Educational Research, 61(3), 333–353. https://doi.org/10.1080/00313831.2016.1147068

Kidger, J., Brockman, R., Tilling, K., Campbell, R., Ford, T., & Araya, R. et al. (2016). Teachers' wellbeing and depressive symptoms, and associated risk factors: A large cross sectional study in English secondary schools. Journal of Affective Disorders, 192, 76-82. doi: 10.1016/j.jad.2015.11.054

Kidger, J., Gunnell, D., Biddle, L., Campbell, R., & Donovan, J. (2009). Part and parcel of teaching? Secondary school staff’s views on supporting student emotional health and well‐being. British Educational Research Journal, 36(6), 919-935. doi: 10.1080/01411920903249308

Page 30: MHAT Evaluation Report...MHAT Evaluation Report 3 Background Schools are increasingly being called upon to support the mental health and wellbeing of their pupils. An estimated two

MHAT Evaluation Report

30

Langeveld, J., Joa, I., Larsen, T., Rennan, J., Cosmovici, E., & Johannessen, J. (2011). Teachers' awareness for psychotic symptoms in secondary school: the effects of an early detection programme and information campaign. Early Intervention in Psychiatry, 5(2), 115-121. doi: 10.1111/j.1751-7893.2010.00248.x

Main, K., & Pendergast, D. (2015). Core Features of Effective Continuing Professional

Development for the Middle Years: A Tool for Reflection. RMLE Online, 38(10), 1-18. doi:

10.1080/19404476.2015.11658177

Mogra, I. (2012). Role play in teacher education: is there still a place for it? Teacher

Education Network Journal, 4(3), 4-15.

Ng Fat, L., Scholes, S., Boniface, S., Mindell, J., & Stewart-Brown, S. (2017). Evaluating

and establishing national norms for mental wellbeing using the short Warwick-Edinburgh

Mental Well-being Scale (SWEMWBS): findings from the Health Survey for

England. Quality of life research: an international journal of quality of life aspects of

treatment, care and rehabilitation, 26(5), 1129–1144. https://doi.org/10.1007/s11136-016-

1454-8

Smith, J. A., Larkin, M., & Flowers, P. (2009). Interpretative Phenomenological Analysis:

Theory, method and research. London: Sage.

Stansfeld, S., Rasul, F., Head, J., & Singleton, N. (2011). Occupation and mental health in a national UK survey. Social Psychiatry and Psychiatric Epidemiology, 46(2), 101-110. doi: 10.1007/s00127-009-0173-7

Stewart-Brown, S., Tennant, A., Tennant, R., Platt, S., Parkinson, J., & Weich, S. (2009).

Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS):

a Rasch analysis using data from the Scottish Health Education Population Survey. Health

Qual Life Outcomes 7, 15. https://doi.org/10.1186/1477-7525-7-15