review: psychomotor assessments process (how to) vs product (outcome) value of reliability/validity...

37
Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different judges’ perspectives Central-tendency: extremes Ability: general, innate trait (overarm throw) Skill: specific, learned capacity (vb spike)

Upload: bennett-gregory

Post on 27-Dec-2015

226 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Review: Psychomotor Assessments

• Process (how to) vs Product (outcome)

• Value of reliability/validity• Rater errors

• Halo Effect: bias • “Standard” Error: different judges’ perspectives• Central-tendency: extremes

• Ability: general, innate trait (overarm throw)

• Skill: specific, learned capacity (vb spike)

Page 2: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

• Develop well-constructed rating scales:• State objectives in terms of observable behavior• Select traits that determine success• Define selected traits in observable behavior• Select and develop the rating instrument• Define degrees of success• Test and revise the rating scale• Use the scale in an actual testing situation

Page 3: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Physical Fitness and Activity Assessment in Youth

HPER 3150Dr. Ayers

Page 4: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Physical Activity and Learning

Thomas Jefferson

“Exercise and recreation . . . are as necessary as reading. I will rather say

more necessary, because health is worth more than learning.”

So what? Role of PA/PE in schools/life?

Page 5: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Children are not “little adults”

Child’s score on aerobic fitness test does not predict endurance activity performance

What DOES matter is the developmentof lifelong, regular PA patterns

Relationship BetweenPhysical Activity and Fitness

Page 6: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Skill-Related Fitness

Health-Related

Fitness

Agility

Coordination

Reaction time

Balance

Speed

Power

Aerobic fitness

Muscular strength/endurance

Flexibility

Body composition

Page 7: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

National Fitness Studies

• Dr. Hans Kraus study (1954):• 42% of American children passed the assessment, while

• 92% of European school children passed the assessment

• President Eisenhower was shocked and established the President’s Council on Youth Fitness (1956)

• Contemporary relevance: http://www.redorbit.com/news/health/1637795/obesity_in_the_military_on_the_rise/

Page 8: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Are American Children and Youth Fit?

Passing Rates on Youth Fitness Tests

Corbin & Pangrazi (RQES, 1992)

Strong et al. (2005)

Page 9: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

AMA quotes

• “Inadequate physical education programs must be strengthened . . . .”

• “There is need . . . . to widen physical education offerings . . . . which contribute to . . . . well-being”

• “Every pupil should . . . . [be exposed] to physical education which promotes understanding of the significance of physical education in maintaining health.”

1967

Page 10: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Secretary of Health and Human Services

“Schools and universities need to reintroduce daily, quality physical activity as a key component of a

comprehensive education.”

1996

Page 11: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

1996

Publication of

Physical Activity HealthA Report of the Surgeon General

Page 12: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Full Report - 278 PagesExecutive Summary

Page 13: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

% Young People Reporting NO Vigorous or Moderate Activity During Any of the Past 7 Days

0

5

10

15

20

25

30

12 13 14 15 16 17 18 19 20 21

MalesFemales

AgeU.S. Surgeon General’s Report, 1996

%

Page 14: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Healthy People 2010

Shape of the Nation 2006

F as in Fat Report 2007

Other Prominent National Reports

Page 15: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

63

25

52 56

28

010

2030

405060

7080

90100

Vigorous Moderate Strength Enrolled inPE

Daily PE

Perc

en

tFigure 12.2

Physical activity in grades 9 through 12in the United States

Grunbaum et al., MMWR, May 21, 2003

Page 16: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Percentage of High School Students Who Attended Physical Education Classes Daily*

National Youth Risk Behavior Surveys, 1991 – 2007

* 5 days in an average week when they were in school.1 Decreased 1991-1995, no change 1995-2007, p < .05

41.6

34.3

25.4 27.4 29.1 30.3133.028.4

32.2

0

20

40

60

80

100

1991 1993 1995 1997 1999 2001 2003 2005 2007

Pe

rce

nt

Page 17: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

http://www.cdc.gov/nchs/data/nhis/earlyrelease/200812_07.pdf

Proportion of Adults Engagingin Regular Physical Activity

Page 18: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Why PA Decreases Over Time

Lack of time

Too competitive

Not fun anymore

Page 19: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Percent Overweight or ObeseGirls

05

101520253035404550

6 7 8 9 10 11 12

America

Sweden

Australia

Vincent, Pangrazi et al., MSSE, 2003

Page 20: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Percent Overweight or ObeseBoys

05

101520253035404550

6 7 8 9 10 11 12

America

Sweden

Australia

Vincent, Pangrazi et al., MSSE, 2003

Page 21: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Norm- Versus Criterion-Referenced Standards

• Norm-Referenced Standards (original PPFT)

Compare students to their peers

• Criterion-Referenced Standards (Fitnessgram)

Compare students to a health criterion

Page 22: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Review: Youth Fitness I• Relationship of fitness/activity to life

• Two types of fitness• Health-related Skill-related

• Relationship between age and physical activity

• Reasons for decreasing PA with age

• Norm- & Criterion-referenced standards

Page 23: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Youth Fitness Testing Batteries

FITNESSGRAM: http://www.fitnessgram.net/home/

The President's Challenge: www.fitness.gov

Eurofit

Page 24: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

FITNESSGRAM

PACER

Skinfolds*

Curl-Up

Trunk Lift

Push-Ups

Page 25: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Printed with permission from the Cooper Institute, Dallas, Texas.

Page 26: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

President’s Challenge

Physical Fitness Test Itemscurl-ups or partial curl-upsshuttle runendurance run/walkpull-ups or flexed arm hangV-sit

Health Fitness Testpartial curl-upsone-mile run/walkv-sit (or sit and reach)right angle push-ups (or pull-ups)Body Mass Index

Page 27: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Physical activity is a __________PROCESS

PHYSICAL FITNESS

Fill in the Blank

that leads to the product,

_______________________

Page 28: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Enhancing Reliable and Valid Fitness Test Results with Children

• Attain adequate knowledge of test descriptions

• Give proper demonstrations and instructions

• Develop good student and teacher preparation through adequate practice trials

• Conduct reliability studies

Page 29: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Special Children

Brockport Physical Fitness Test Items

See Table 12-12

Page 30: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Measuring Physical Activity in Youth

• Physical activity improves the overall health of children

• Physically inactive children tend to become inactive adults with higher risks for chronic diseases

• Physically active children tend to become active adults with lower risks for chronic diseases

Page 31: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Accelerometers

Page 32: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Pedometers

Page 33: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

ACTIVITYGRAM Physical Activity Questions Based on the CDC’s Youth Risk Factor Behavior Survey

Aerobic Activity Question:On how many of the past 7 days did you participate in physical activityfor a total of 30-60 minutes, or more, over the course of a day?This includes moderate activities (walking, slow bicycling, or outdoor play)as well as vigorous activities (jogging, active games or active sports such asbasketball, tennis or soccer) (0,1,2,3,4,5,6,7 days) Strength Activity Question:On how many of the past 7 days did you do exercises to strengthenor tone your muscles? This includes exercises such as push-ups, sit-upsor weight lifting. (0,1,2,3,4,5,6,7 days)

Flexibility Activity Question:On how many of the past 7 days did you do stretching exercises toloosen up or relax your muscles? This includes exercises such astoe touches, knee bending, or leg stretching. (0,1,2,3,4,5,6,7 days)

Page 34: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Figure 12.10ACTIVITYGRAM logging chart

Page 35: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Printed with permission from the Cooper Institute, Dallas, Texas.

Page 36: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Printed with permission from the Cooper Institute, Dallas, Texas.

Page 37: Review: Psychomotor Assessments Process (how to) vs Product (outcome) Value of reliability/validity Rater errors Halo Effect: bias “Standard” Error: different

Tell a friend one thing you learned TODAY that you will use as a professional