the learning behaviors scale p. a. mcdermott, l. f. green, j. m. francis, & d. h. stott

29
The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Upload: helen-franklin

Post on 26-Dec-2015

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

The Learning Behaviors Scale

P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Page 2: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Description of the LBS I

• 29 items, each presenting a specific learning-related behavior

• Observer is required to indicate whether behavior Most often applies, Sometimes applies, or Does not apply.

• Some items indicate positive learning behaviors and others indicate negative behaviors to reduce response sets.

Page 3: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

LBS Description II

• The 29 items provide 4 subscale scores:– Competence Motivation (8 items)– Attitude Toward Learning (9 items)– Attention/Persistence (7 items)– Strategy/Flexibility (7 items)

• Subscales allow for targeted intervention

• You can also obtain a global LBS score

Page 4: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

CONTEXT FOR DEVELOPMENT I

• Knowing that a student is “bright” or “not as bright” does not fully explain performance

• Knowing a student’s intellectual capacity provides limited information for intervention

• What do you do when faced with a “bright” student who is not doing well?

Page 5: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Context for Development II

• There are behaviors associated with learning. What behaviors do you think are associated with learning?

• Some of them are as follows:– Listening attentively

– Participating in classroom activities

– Accepting correction

– Sticking to tasks until completed

– Working to please teacher

Page 6: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Context for Development III

• There is evidence that these learning behaviors are teachable.

• Idiographic data is useful in this arena, but time-consuming to gather

• We did not have good nomothetic data on learning behaviors.

• However, we know that school teachers are relatively accurate, reliable, unobtrusive, cost-beneficial observers of classroom behavior, when they have had ample opportunity to observe.

Page 7: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Context For Development IV

• In light of the previous information, the authors of the LBS set out to develop a scale to measure learning behaviors reliably and validly in 5 - 17 year olds, using teacher observation.

• The research work on the LBS started in the mid 1980s and the scale was published in 1999.

Page 8: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Preliminary Research

• Examined– Reliability of subscale scores and total score in

small samples.

– Validity of subscale and total scores in small samples.

– Created scale that worked well.

Page 9: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

US Standardization

• Sample– 1,500 students, 750 males and 750 females 5 to

17 years old– Used 1992 U.S. Census to obtain demographics– Blocking for sex, age, grade in school– Stratified random sampling by race, class,

family structure, community size, and geographic region

Page 10: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Final Norm Sample

• Race: 67.7% White, 15.9% Hispanic, 12.1% African American, 4.3% other groups.

• Family: 76.6% with two parents or guardians, 21.3% single mom, 2.1% single dad.

• Representation by SES based on parent education, and exceptionality

• Final selection was randomly selected from those who gave consent, restricted only by stratification quotas and ≤ 2 students per teacher.

Page 11: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Test Retest Reliability (n = 77)

• Competence Motivation .92

• Attitude Toward Learning .91

• Attention/Persistence .92

• Strategy/Flexibility .93

Page 12: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Inter Rater Reliability (n = 72)

• Competence Motivation .83

• Attitude Toward Learning .83

• Attention/Persistence .83

• Strategy/Flexibility .83

Page 13: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Internal Consistency I

LBS Factors Male Female

Competence Motivation .85 .85

Attitude To Learning .87 .80

Attention/ Persistence .85 .80

Strategy/ Flexibility .76 .70

Page 14: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Internal Consistency II

LBS Factors 5-11 (n =817) 12-17 (n = 683)

Competence Motivation .85 .85

Attitude To Learning .83 .86

Attention/ Persistence .85 .84

Strategy/ Flexibility .74 .76

Page 15: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Validity Coefficients

CM AL AP SF Ability .39 .22 .27 .10 Read .35 .21 .25 .12 Math .36 .22 .23 .08 T Read .52 .47 .51 .26 ADHD -.50 -.53 -.70 -.63 Avoid. -.34 -.49 -.31 -.09

Page 16: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

T & T Sample

• The LBS was completed on all 700 students in the sample, with no rater missing more than 2 items.

• The distribution was skewed toward the higher end--that is, most students were rated as having learning behaviors in the normal range.

Page 17: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Factor Analyses

• As is recommended, we used factor analysis to look at the structural validity of the LBS in the T & T sample.

• We used multiple criteria to determine how many factors would work best.

• The goal was to find a factor structure that was generalizable across the whole sample, as well as the gender subgroups.

Page 18: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Factor Analyses 2

• In the US, the LBS is made up of four factors.• We ran five factor, four-factor, three-factor, and

two-factor models.• The only structure that generalized from the whole

sample across gender groups was the two-factor one (see p. 8 in manual and note pattern coefficients).

Page 19: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Factor Analyses 3

• Factor I consists of 18 items and is labeled Attitude Toward Learning (AL). The items on this factor made up the Competence Motivation, Attention-Persistence, and Attitude Toward Learning subscales in the U.S. structure.

• Factor II, labeled Strategy Flexibility, consisted of the 7 SF items in the U.S. norming, but of 9 items in Trinidad.

• The AL and SF factors have two items in common (10 & 14).

Page 20: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Table 2.1

Pattern Coefficients for the LBS Factors

Abbreviated LBS ItemsI

Attitude Toward LearningII

Strategy Flexibility

No. Total Females Males Total Females Males

1 Responds in a manner that shows attention .551 .535 .556 -.057 -.038 -.064

2 Says task is too hardEf

.476 .401 .558 .239 .270 .188

3 Is reluctant to tackle a new task .588 .564 .614 .137 .205 .065

4 Sticks to a task .365 .365 .348 .068 .062 .090

5 Adopts a don’t care attitude to success .586 .536 .623 .285 .287 .284

6 Seems to take refuge in incompetence .629 .581 .670 .212 .207 .210

7 Follows peculiar or inflexible procedures .109 .088 .154 .442 .443 .409

8 Shows little desire to please you .491 .350 .592 .225 .322 .140

9 Is unwilling to accept help .241 .104 .355 .232 .342 .129

10 Responds without taking sufficient time .333 .341 .329 .329 .313 .350

11 Cooperates in class activities .654 .577 .718 -.034 .018 -.097

12 Bursts into tears .147 .030 .241 .124 .237 .027

13 Has enterprising ideas which don’t workout

-.149 -.146 -.152 .470 .415 .520

14 Is distracted too easily .428 .354 .491 .363 .437 .291

15 Fidgets, squirms, leaves seat .232 .055 .353 .486 .574 .422

16 Gets aggressive or hostile .077 .037 .111 .547 .591 .515

17 Is very hesitant about giving an answer .611 .678 .597 -.055 -.092 -.035

18 Shows little determination to complete tasks .642 .517 .739 .242 .330 .164

19 Uses headaches or other pains as an excuse .161 .095 .218 .418 .530 .318

20 Is willing to be helped .334 .202 .430 .012 .014 .014

21 Is too lacking in energy to be interested .393 .400 .393 .145 .137 .146

22 Relies on personal charm .056 .076 .040 .421 .478 .373

23 Invents silly ways of going about tasks .035 -.006 .088 .651 .592 .681

24 Doesn’t work well if in a bad mood .112 .026 .173 .444 .503 .405

25 Shows a lively interest in learning .693 .657 .718 -.048 -.134 .043

26 Tries hard but concentration soon fades .325 .357 .304 .244 .287 .211

27 Carries out tasks according to own ideas .020 .043 .026 .520 .462 .553

28 Accepts new tasks without fear .679 .582 .759 -.089 -.112 -.057

29 Delays answering .470 .520 .449 .123 .142 .101

Page 21: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Attitude Toward Learning ItemsResponds in a manner that shows attentionSays task is too hard without making much effort to attempt itEfIs reluctant to tackle a new task

Sticks to a task with no more than minor distractions

Adopts a don’t care attitude to success or failure

Seems to take refuge in dullness or incompetence

Shows little desire to please youResponds without taking sufficient time to look at problem or work out a solution

Cooperates in class activities sensibly

Is distracted too easily by what is going on in the classroom, or seeks distractions

Is very hesitant about giving an answer

Shows little determination to complete a task, gives up easily

Is willing to be helped when a task proves too difficult

Is too lacking in energy to be interested in anything or to make much effort

Shows a lively interest in learning activities

Tries hard but concentration soon fades and performance deteriorates

Accepts new tasks without fear or resistance

Delays answering in the hope of picking up a hint

Page 22: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Strategy FlexibilityFollows peculiar or inflexible procedures in tackling tasks

Responds without taking sufficient time to look a problem or work out a solution

Has enterprising ideas which often don’t work out

Is distracted too easily by what is going on in the classroom, or seeks distractions

Fidgets, squirms, leaves seat unnecessarily

Gets aggressive or hostile when frustrated or when work is corrected

Uses headaches or other pains as an excuse for evading learning tasksRelies on personal charm to get others to find solutions to problems

Invents silly ways of going about tasks

Doesn’t work well if in a bad mood

Carries out tasks according to own ideas rather than in the accepted way

Page 23: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Let’s look at reliability estimates for the T & T scores

Table 2.2

Reliability of LBS Subscale Scores

Sample

AttitudeTowardLearning

StrategyFlexibility

TotalScore

Total .90 .81 .91Boys .91 .81 .92Girls .89 .81 .90African .91 .83 .92East Indian .90 .77 .90M ixed .89 .81 .90Infant 1 .89 .75 .90Infant 2 .91 .82 .92Standard 1 .90 .83 .91Standard 2 .91 .79 .91Standard 3 .92 .78 .91Standard 4 .87 .77 .88Standard 5 .90 .86 .92

Page 24: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Reliability and Validity Evidence

• Reliability estimates for scores on the total scale were consistently high across all subgroups.

• Reliability estimates for subscale scores were very high for Factor 1 and moderate for Factor II.

• No reliability estimates fell below .75. • There were no statistically significant differences

between genders, among ethnic groups, or among grade levels.

Page 25: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Administration

• Speak to teacher who has seen students for at least 6 school weeks or 30 days.

• Ask teacher to rate the student as accurately as possible.

• Let the teacher know that this information will help in your assessment of the student.

• Teacher should rate all responses.• Will require 5 to 10 minutes to complete.

Page 26: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Scoring

• Use scoring template to complete raw score for each dimension.

• Raw scores for Factor 1 (AL) range from 0 to 36.• Raw scores for Factor II (SF) range from 0 to 18.• Raw scores on Total Scale range from 0 to 54.• Put raw scores in boxes on Score Summary sheet.• Convert raw scores to %tiles using table on p. 10.• Always double check your scoring.

Page 27: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Interpretation I

• Scores on the LBS should be only one part of a broader psychoeducational evaluation.

• Higher scores represent the presence of more learning behaviors.

• Students who obtain scores at or above the 40th percentile are displaying learning behaviors at or above the average range.

Page 28: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Interpretation II

• Students whose learning behaviors are between the 20th and 40th percentiles are students who may benefit from interventions aimed at increasing their learning behaviors in general.

• Students whose scores fall below the 20th percentile are manifesting deficits in learning behaviors and may benefit from immediate interventions.

Page 29: The Learning Behaviors Scale P. A. McDermott, L. F. Green, J. M. Francis, & D. H. Stott

Let’s Practice