results of the 2010-2011 pilot fitness assessment training and looking ahead to statewide...

Legislation and DOE Rules S.H.A.P.E. partnership Selection of fitness assessments 2010-2011 fitness assessment training pilot Evaluation of fitness assessment training

and testing Looking ahead to 2011-2012 Q&A

Overview

2

Beginning in 2011 an annual fitness assessment in grades 1-12 (Pre + post optional)

All classes taught by a certified physical education teacher

Individual results communicated to parents or guardians

Aggregate results reported to DOE

Georgia Official Code (20-2-777)

3

At least minimum amount of physical education instruction provided:-- Elementary: 90 clock hours/year-- MS H/PE instruction provided-- HS 1 semester Health/1 semester Personal Fitness

Recognition

Georgia Official Code (20-2-777), con’t

4

• Governor's Office

• Georgia Department of Education

• Georgia Department of Public Health

• Maternal and Child Health, Division of Public Health

• Children’s Healthcare of Atlanta

• Atlanta Falcons Youth Foundation (AFYF)

• The Arthur M. Blank Family Foundation

• The Atlanta Braves Foundation

Student Health and Physical Education (S.H.A.P.E.) Partners

5

Selects five components of FITNESSGRAM®

Determines requirements for each grade re: assessments

Plans to implement pilot training in five counties 2010-2011

Decides to conduct evaluation of the pilot training

DOE Fitness Advisory Committee

6

Combines both an educational assessment and a reporting software program

Designed to promote lifelong physical activity

Based on the latest research on children’s fitness

Health related

Uses criterion-referenced standards

FITNESSGRAM®

7

PACER /Mile Run – Aerobic Capacity

Curl-Ups – Muscular Strength and Endurance

900 Push-Ups – Muscular Strength and Endurance

Back-Saver Sit and Reach - Flexibility

Height and Weight – To Calculate Body Composition as BMI

Fitness Assessment Components

8

GA DOE Fitness Assessment and Reporting Requirements

9

Fall of 2010 Designed and coordinated by

HealthMPowers Eight hours, in one day Used three certified FG trainers Trained 290 teachers in four counties: --Bibb, Hall, White, Gwinnett, Lowndes

(selected but completed testing early)

2010-2011 Pilot FITNESSGRAM® Training

10

Level 1– Trained by certified trainers

Level 2– Trained fully by Level 1’s

Level 3—Untrained (e.g. substitute teacher, parent)

2010-2011 FITNESSGRAM® Training

11

Information about the Fitness Assessment Program

FITNESSGRAM® testing training

Fitness testing

Data entry accuracy and management

Preparing and distributing FITNESSGRAM® reports

Scope of the Evaluation of the Pilot

12

“Ticket out the Door” (comment slips after the training sessions)

Observations of teachers conducting fitness testing

Analysis of time to administer FITNESSGRAM®

Teacher item responses on surveys (after completing testing)

Teacher comments on surveys (after completing testing)

Evaluation of Pilot FITNESSGRAM®

Testing Training

13

The teachers were very complimentary about the design of the training materials and the quality of the instructors:

“Seeing the tests in practice. Hearing a thorough explanation of each test”

“Seeing the tests on video then actually doing them to make sure we were accurate”

“Mistakes to look for were outlined. Helpful hints to teach tests to kids”

“Ticket out the Door”

14

The teachers expressed some challenges, including:

“Pre/post test all students in 9 weeks. It will reduce instructional time”

“Getting the students to buy into the testing. Being serious about doing their best”

“Getting ‘old timers’ to get on board”

“Ticket Out The Door”

15

A trained observer and certified FITNESSGRAM® test administrator observed 22 teachers administering different combinations of the testing components between December of 2010 and May of 2011. The observations were made at 4 elementary schools, 4 middle schools, and 2 high schools.

The purpose was to check teachers’ adherence to FG protocols taught in the training sessions.

Observations of Teachers Conducting Fitness Testing

16


Test component# of items

on checklist

Mean percent correct and

includedLow % -- High

%

Push Ups

7 77.6% 28.6% -- 100%

PACER

6 73.8% 28.6% -- 100%

Back Saver Sit & Reach

9 66.7% 44.4% -- 100%

Curl Ups

11 56.4%* 9.1% -- 81.8%

*This mean would be 68.1% without the very low score of 9.1% by a Level 3 tester17


Percent Correct

and Included

Level 1

74.5%

Level 2

47.5%

Level 3*

33.3%

*Only one Level 3 tester was observed

18

Reliability observations checked for differences between scores recorded by teachers/volunteers/students and those recorded by independent, trained recorders. The trained observers’ counts would be made strictly according to each test’s protocol, and then recorded along with the count made by the teacher, volunteer, or student who was assigned that responsibility.

We conducted 296 observations and comparisons across all components of the FITNESSGRAM® test.


19


Test component Difference (%)

Push-Ups 45.0

Curl Ups 40.7

Sit and Reach 33.3

PACER 4.9

Height 0.3

Weight 0.3

20

During the on-site observations, one of the trained observers recorded the start/stop times for each group of tested children, and noted how many students were being tested at that time. From that, it was possible to calculate a time estimate for testing a (hypothetical) group of 30 students in the same physical education class.

It should be noted that the number of students to be tested at one time in each test was based on the recommendations of a trained and highly experienced certified FITNESSGRAM® trainer.

Analysis of Time to Administer FITNESSGRAM®

21

Test Test at once Time ~Total TimePACER 6 15:00 mins 75 mins Sit & Reach 1 2:45 mins 80 mins Height & Weight 1 1:00 mins 30 mins Push Ups 4 2:30 mins 20 mins Curl Ups 4 2:30 mins 20 mins

The total estimated time to properly test those 30 students is 225 minutes, almost 4 hours of class time.


22


Scenarios:

PE for 1 day/week for 30 mins: 8 classes/8 weeks ~20% of annual PE

PE for 2 days/week for 30 mins: 8 classes/4weeks ~10% of annual PE

PE for 3 days/week for 30 mins. 8 classes/~3 weeks ~7% of annual PE

PE for 5 days/week (9 weeks) for 45 mins: 5 classes/1 week ~11% of 9 weeks

23


Tim

e

Accuracy

24

The FITNESSGRAM® training was well-organized and effectively presented:

Strongly agree 52%

Agree 40%

Teacher Item Responses on Surveys

(After Testing)

25

I feel well-prepared to test the students at my school using the FITNESSGRAM® assessments:

Strongly agree 51%

Agree 37%

Teacher Item Responses on Surveys

(After Testing)

26

The teachers still expressed that the training was beneficial and effective, but after testing they again expressed concerns about time and other constraints:

“It is very time consuming. It's hard doing the testing by yourself.”

“I don’t feel I can trust students to watch for form breaks and give accurate scores on those [sit and reach, curl ups, push up], so it is taking quite a long time to get those done.”

Teacher Comments on Surveys(After Testing)

27

To provide an extensive information campaign so teachers can better understand why they are conducting the fitness tests.

To provide suggestions for teachers who have to test large numbers of students at one time, such as how to conduct the test and how to keep the other students occupied.

To urge teachers to re-familiarize themselves with the instruction checklist prior to administering each of the tests and have it with them during the testing.

Selected Recommendations from the Pilot

28

To urge teachers not to exceed the recommended number of students taking a test at the same time, based on their level of experience with FG.

To urge teachers not to use students in elementary grades to count and record scores for other students.

To develop an on-line “booster” training module to refresh teachers’ memory right before testing.

To require that the training of Level 2 and Level 3 testers be documented for compliance with level 1 training.

Selected Recommendations from the Pilot

29

-- June - December 2011: Training ~2,500 teachers trained for testing (Level 1)

-- November - December 2011: Import student information into FITNESSGRAM®

-- January 2012 - February 2012: Practice testing/pretesting (optional)

-- March 1 - May 5 2012: Implement assessment; record and report scores

-- May 1 – June 15 2012: Schools deliver student reports to parents

-- October 2012 : The first Georgia Report to the Governor

2011-2012 Timeline

30

Training is scheduled for 150 local systems Provide information for IT and student information

representatives from local systems Student information imported into FG 9.0 Teachers trained via webinar on how to enter student

assessment data ( December 2011 – January 2012) Data entry, and reporting available after January 1,

2012 Data collection will be done via a secure web based

location using Fitnessgram 9.0

2011-2012 Statewide Implementation

31

Equipment for assessment:-- Sit and Reach Box-- Scale-- Height Measure Strip-- FG Kit (additional items needed to test)

Data and reporting:-- FG 9.0 web based program -- Licensing-- Data Collection Space


32

Funding has been secured to develop an e-learning module to help improve teacher observation. Proposed 4 parts:

1. Tutorial of correct performance

2. Tutorial of common form breaks

3. Game/Activity to evaluate form breaks of a single

execution (sit and reach, curl ups and push ups)

4. Game/Activity to evaluate correct execution in a

series of 10 (curl ups and push ups)


33

FERPA:The parties will safeguard the confidentiality of the student data as required by the Federal Family Educational Rights and Privacy Act (FERPA) and other applicable laws and regulations. No release of data, reports, information, or output of any kind based on the data will include any information that could be identifiable or linked to a specific person.


34

FITNESSGRAM® Georgia (http://www.fitnessgram.net/Georgia/)

FITNESSGRAM® (http://www.fitnessgram.net/home/)

The S.H.A.P.E partnership (http://georgiashape.org/)

Georgia Department of Education – Health and Physical Education (http://www.doe.k12.ga.us/ci_services.aspx?PageReq=CIServHealthPhys

) Website includes all materials provided in the training manual. (e.g. all training PPTs, all communication pieces including sample letters, newsletters, frequently asked questions, information for school websites, tips for success from the field, fitness testing one pagers and station cards, and more.

Resources

35

Therese McGuireProgram Specialist

Health and Physical EducationGeorgia Department of Education

[email protected]

DOE Contact

36

Time for Questions

37

results of the 2010-2011 pilot fitness assessment training and looking ahead to statewide...

Documents