educational environment: assessment from the ceeso …

1
EDUCATIONAL ENVIRONMENT: ASSESSMENT FROM THE CEESO PARIS STUDENTS Muriel Bois-Fiaty 1 , Paul Quesnay 1,2 (dir.) 1 CEESO Paris 2 PhDs, LEPS EA 3412, University Paris 13 LabSET, University of Liège INTRODUCTION The educational environment (EE) 1,2 is defined as everything that happens physically and psychologically in the classroom, the institution and is essential to academic outcomes 3 . It is subject to a multitude of factors, incliuding : the premises in which the courses take place, the facilities for clinical learning, the content and form of the curriculum, the motivation and pedagogical skills of the teachers 1,4,5 , the quality of feedback, the organisation of timetables, the quality of relations between the various actors 1,6,7,8 . Regarding literature in medical education, the most frequently used tool to assess the EE is the Dundee Ready Educational Environment Measure (DREEM) 9,10,11 . Analyzing the perception of osteopathic students of the EE would help to better understand the difficulties they encounter and identify areas in need for further improvement. The present study aims to assessing the perception of the educational environment by CEESO Paris students using the DREEM. MATERIAL AND METHODS The Dundee Ready Education Environment Measure 11 contains 50 items divided in five categories: perceptions of the teachings, teachers, atmosphere, social self-perception and academic self-perception. Items are scored using a 5 points Likert- type scale ranging from strongly agree (4) to strongly disagree (0). Survey: The DREEM questionnaire was completed in october 2018 by the 2nd, 3rd, 4th, and 5th-year students from CEESO Paris. Age, sex, physical activity, year repetition, promotion, student job, school career, daily travel time of the students were also asked. Interpretation : Using the DREEM authorsguide, the mean scores were interpreted with: Overall mean scores : 0-50 very poor ; 51-100 plenty of problems ; 101-150 more positive than negative ; 151-200 excellent. Item mean scores of 2 or less indicate problem areas, of 3 or over indicate real positive points; score between 2 and 3 are aspects of the environment that could be enhanced. Analysis: ANOVA 1 was used, followed by a comparison of mean scores with Student 3 test, to reveal potential statistically significative differences between the different groups of students. RESULTS 132,7 32 30 21 32 18 133 34 31 21 33 18 133 31 28 21 32 17 130 32 29 23 32 18 147 35 32 25 36 20 0 20 40 60 80 100 120 140 160 Global Teaching Teachers Academic self perception Atmosphere Social self perception AIOT 2011 CEESO 2011 BSO 2011 VU 2013 CEESO 2018 DISCUSSION 0,0 0,5 1,0 1,5 2,0 2,5 3,0 50 items of DREEM classified by mean score 2 low mean score items (< 2) - Support system for stressed students - Well managed timetables 11 high mean score items (> 3) -Stimulating Teaching - Competent teachers - Comptences development - Efficient preparation for the osteopathic profession The global score of the 2018 CEESO Paris survey (132,72/200) is more positive than negative 12,13 . It is comparable to the scores obtained in previous surveys 14,15 . The Accademia Italiana Osteopatia Tradizionale (AIOT) obtained in 2011 a higher mean score (147). However this score may be due to the small class size in AIOT (12 students), which provide a tutorial-like learning. Score by items The schedule management and the support system for stressed students are the two items which appeared to be problematic in the present survey. The support of stressed students is an item that appears to be problematic in both large and small structures. One area for improvement is the implementation of tutorials or a supervisor independent of the administration for students at higher risk. The survey highlighted some areas of concerns -support system for stressed students and well managed timetables- which were not problematic in the compared studies 14,15 . It also highlighted significative factors influencing the mean scores negatively, such as working a student job, year repetition, and/or a lack of physical activity. The survey revealed quite a few positive points such as stimulating teachings, competent teachers, a overall effective preparation for a career in osteopathy. CONCLUSION The present study revealed that the educational environment at CEESO Paris appeared to be more positive than negative for the students. The figures obtained in this survey are comparable to those obtained in other studies in Europe (comparison between AIOT Italy, BSO UK, and CEESO Paris France) and Australia (VU, Melbourne). It would be interesting to continue the study over several years and to compare other schools in order to have a better vision of the perception of the educational environment of osteopathy training in France and abroad, using DREEM but also using qualitative methods. REFERENCES 1 Genn, J.M., 2001a. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education-a unifying perspective. 2 Sue Roff, S.M., 2001. What is educational climate? 3 Mushtaq, R., Ansar, A., Bibi, A., Ramzan, M., Munir, A., Zaheer, A., Ahmad, A., Barlas, A., 2017. Quality Of Educational Environment At Wah Medical College: Assessment By Using Dundee Ready Educational Environment Measure. 4 Genn, J.M., 2001b. AMEE Medical Education Guide No. 23 (Part 2): Curriculum, environment, climate, quality and change in medical education - a unifying perspective. 5 Hutchinson, L., 2003. Educational environment. 6 Edgren, G., Haffling, A.-C., Jakobsson, U., McAleer, S., Danielsen, N., 2010. Comparing the educational environment (as measured by DREEM) at two different stages of curriculum reform. 7 Schönrock-Adema, J., Bouwkamp-Timmer, T., van Hell, E.A., Cohen-Schotanus, J., 2012. Key elements in assessing the educational environment: where is the theory? 8 Dunne, F., McAleer, S., Roff, S., 2006. Assessment of the undergraduate medical education environment in a large UK medical school. 9 Roff, S., McAleer, S., Harden, R.M., Al-Qahtani, M., Ahmed, A.U., Deza, H., Groenen, G., Primparyon, P., 1997. Development and validation of the Dundee Ready Education Environment Measure (DREEM). 10 Brown, T., Williams, B., Lynch, M., 2011. The Australian DREEM: evaluating student perceptions of academic learning environments within eight health science courses. 11 Roff, S., 2005. The Dundee Ready Educational Environment Measure (DREEM)--a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. 12 McAleer, S., Roff, S., 2001. A practical guide to using the Dundee Ready Education Environment Measure (DREEM) 13 Lai, N., Nalliah, S., Jutti, R., Hla, Y., Lim, V., 2009. The Educational Environment and Self- perceived Clinical Competence of Senior Medical Students in a Malaysian Medical School 15. 14 Vaughan, B., Carter, A., Macfarlane, C., Morrison, T., 2014. The DREEM, part 1: measurement of the educational environment in an osteopathy teaching program. 15 Luciani, E., Cerritelli, F., Waters, M., Zegarra-Parodi, R., 2014. Osteopathic student satisfaction and preparedness to practice: A comparative study. SCORE COMPARISON BETWEEN SCHOOLS Global 132,72/200 Perception of teaching 32/48 Perception of teachers 30/44 Academic self- perception 21/32 Perception of atmosphere 32/48 Social self- perception 18/28 CEESO 2018 SCORES 133 of the 188 students from 2 nd , 3 rd , 4 th and 5 th years completed the questionnaire (70.75 % response rate).

Upload: others

Post on 31-Oct-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EDUCATIONAL ENVIRONMENT: ASSESSMENT FROM THE CEESO …

EDUCATIONAL ENVIRONMENT: ASSESSMENT FROM THE CEESO PARIS STUDENTS Muriel Bois-Fiaty1, Paul Quesnay1,2 (dir.) 1 CEESO Paris 2 PhDs, LEPS EA 3412, University Paris 13 – LabSET, University of Liège

INTRODUCTION

The educational environment (EE)1,2 is defined as

everything that happens physically and

psychologically in the classroom, the institution and is

essential to academic outcomes3. It is subject to a

multitude of factors, incliuding : the premises in

which the courses take place, the facilities for clinical

learning, the content and form of the curriculum, the

motivation and pedagogical skills of the teachers1,4,5,

the quality of feedback, the organisation of

timetables, the quality of relations between the

various actors1,6,7,8. Regarding literature in medical

education, the most frequently used tool to assess

the EE is the Dundee Ready Educational Environment

Measure (DREEM)9,10,11. Analyzing the perception of

osteopathic students of the EE would help to better

understand the difficulties they encounter and

identify areas in need for further improvement.

The present study aims to assessing the perception of

the educational environment by CEESO Paris students

using the DREEM.

MATERIAL AND METHODS

The Dundee Ready Education Environment

Measure11 contains 50 items divided in five

categories: perceptions of the teachings, teachers,

atmosphere, social self-perception and academic

self-perception.

Items are scored using a 5 points Likert- type scale

ranging from strongly agree (4) to strongly disagree

(0).

Survey: The DREEM questionnaire was completed in

october 2018 by the 2nd, 3rd, 4th, and 5th-year

students from CEESO Paris. Age, sex, physical activity,

year repetition, promotion, student job, school

career, daily travel time of the students were also

asked.

Interpretation : Using the DREEM authors’ guide, the

mean scores were interpreted with:

Overall mean scores : 0-50 very poor ; 51-100 plenty

of problems ; 101-150 more positive than negative ;

151-200 excellent.

Item mean scores of 2 or less indicate problem areas,

of 3 or over indicate real positive points; score

between 2 and 3 are aspects of the environment that

could be enhanced.

Analysis: ANOVA 1 was used, followed by a

comparison of mean scores with Student 3 test, to

reveal potential statistically significative differences

between the different groups of students.

RESULTS

132,7

32

30

21

32

18

133

34

31

21

33

18

133

31

28

21

32

17

130

32

29

23

32

18

147

35

32

25

36

20

0 20 40 60 80 100 120 140 160

Global

Teaching

Teachers

Academic self perception

Atmosphere

Social self perception

AIOT 2011 CEESO 2011 BSO 2011 VU 2013 CEESO 2018

DISCUSSION

0,0 0,5 1,0 1,5 2,0 2,5 3,0 3,5 4,0

50 items of DREEM classified by mean score

2 low mean score items (< 2)

- Support system for stressed students

- Well managed timetables

11 high mean score items (> 3)

-Stimulating Teaching

- Competent teachers

- Comptences development

- Efficient preparation for the osteopathic

profession

The global score of the 2018 CEESO Paris survey

(132,72/200) is more positive than negative12,13. It is

comparable to the scores obtained in previous

surveys14,15. The Accademia Italiana Osteopatia

Tradizionale (AIOT) obtained in 2011 a higher mean score

(147). However this score may be due to the small class

size in AIOT (12 students), which provide a tutorial-like

learning.

Score by items

The schedule management and the support system for

stressed students are the two items which appeared to

be problematic in the present survey.

The support of stressed students is an item that appears

to be problematic in both large and small structures. One

area for improvement is the implementation of tutorials

or a supervisor independent of the administration for

students at higher risk.

The survey highlighted some areas of concerns -support

system for stressed students and well managed

timetables- which were not problematic in the compared

studies14,15. It also highlighted significative factors

influencing the mean scores negatively, such as working a

student job, year repetition, and/or a lack of physical

activity. The survey revealed quite a few positive points

such as stimulating teachings, competent teachers, a

overall effective preparation for a career in osteopathy.

CONCLUSION

The present study revealed that the educational

environment at CEESO Paris appeared to be more positive

than negative for the students. The figures obtained in

this survey are comparable to those obtained in other

studies in Europe (comparison between AIOT Italy, BSO

UK, and CEESO Paris France) and Australia (VU,

Melbourne).

It would be interesting to continue the study over several

years and to compare other schools in order to have a

better vision of the perception of the educational

environment of osteopathy training in France and abroad,

using DREEM but also using qualitative methods.

REFERENCES 1 Genn, J.M., 2001a. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education-a unifying perspective. 2 Sue Roff, S.M., 2001. What is educational climate? 3 Mushtaq, R., Ansar, A., Bibi, A., Ramzan, M., Munir, A., Zaheer, A., Ahmad, A., Barlas, A., 2017. Quality Of Educational Environment At Wah Medical College: Assessment By Using Dundee Ready Educational Environment Measure. 4 Genn, J.M., 2001b. AMEE Medical Education Guide No. 23 (Part 2): Curriculum, environment, climate, quality and change in medical education - a unifying perspective. 5 Hutchinson, L., 2003. Educational environment. 6 Edgren, G., Haffling, A.-C., Jakobsson, U., McAleer, S., Danielsen, N., 2010. Comparing the educational environment (as measured by DREEM) at two different stages of curriculum reform. 7 Schönrock-Adema, J., Bouwkamp-Timmer, T., van Hell, E.A., Cohen-Schotanus, J., 2012. Key elements in assessing the educational environment: where is the theory? 8 Dunne, F., McAleer, S., Roff, S., 2006. Assessment of the undergraduate medical education environment in a large UK medical school. 9 Roff, S., McAleer, S., Harden, R.M., Al-Qahtani, M., Ahmed, A.U., Deza, H., Groenen, G., Primparyon, P., 1997. Development and validation of the Dundee Ready Education Environment Measure (DREEM). 10 Brown, T., Williams, B., Lynch, M., 2011. The Australian DREEM: evaluating student perceptions of academic learning environments within eight health science courses. 11 Roff, S., 2005. The Dundee Ready Educational Environment Measure (DREEM)--a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. 12 McAleer, S., Roff, S., 2001. A practical guide to using the Dundee Ready Education Environment Measure (DREEM) 13 Lai, N., Nalliah, S., Jutti, R., Hla, Y., Lim, V., 2009. The Educational Environment and Self- perceived Clinical Competence of Senior Medical Students in a Malaysian Medical School 15. 14 Vaughan, B., Carter, A., Macfarlane, C., Morrison, T., 2014. The DREEM, part 1: measurement of the educational environment in an osteopathy teaching program. 15 Luciani, E., Cerritelli, F., Waters, M., Zegarra-Parodi, R., 2014. Osteopathic student satisfaction and preparedness to practice: A comparative study.

SCORE COMPARISON BETWEEN SCHOOLS

Global 132,72/200

Perception of teaching 32/48

Perception of teachers 30/44

Academic self-perception

21/32

Perception of atmosphere

32/48

Social self-perception

18/28

CEESO 2018 SCORES

133 of the 188 students from 2nd, 3rd, 4th and 5th years completed the questionnaire (70.75 % response rate).