single - case, quasi-experiment, and development research © 2012 the mcgraw-hill companies, inc
TRANSCRIPT
SINGLE-CASE, QUASI-EXPERIMENT, AND DEVELOPMENT RESEARCH
© 2012 The McGraw-Hill Companies, Inc.
Describe single case experimental designs and discuss reasons to use this design
Describe the five types of evaluations involved in program evaluation research Needs assessment Program assessment Process evaluation Outcome evaluation Efficiency assessment
© 2012 The McGraw-Hill Companies, Inc.
Describe the one-group posttest-only design Describe the one-group pretest-posttest design
and the associated threats to internal validity that may occur History Maturation Testing Instrument decay Regression toward the mean
© 2012 The McGraw-Hill Companies, Inc.
Describe the nonequivalent control group design and nonequivalent control group pretest-posttest design, and discuss the advantages of having a control group
Distinguish between the interrupted time series design and control series design
© 2012 The McGraw-Hill Companies, Inc.
Describe cross-sectional, longitudinal, and sequential research designs, including the advantages and disadvantages of each design
Define cohort effect
© 2012 The McGraw-Hill Companies, Inc.
Single Case Experimental Designs (formerly called single-subject designs) Measured from baseline period to treatment periods
Reversal or withdrawal design Called an ABA design Baseline (A) Treatment (B) Baseline (A)
The use of praise as a treatment to measure the improvement of a child’s school performance
Measure test scores give regimen of praise for correct homework problems measure test scores
© 2012 The McGraw-Hill Companies, Inc.
© 2012 The McGraw-Hill Companies, Inc.
Multiple Baseline Designs Change is observer under multiple circumstances The manipulation is introduced at different times Determines that the manipulation caused change
Replications in Single Case Designs
© 2012 The McGraw-Hill Companies, Inc.
© 2012 The McGraw-Hill Companies, Inc.
© 2012 The McGraw-Hill Companies, Inc.
NEEDS ASSESSMENT
PROGRAM THEORY ASSESSMENT
PROCESS EVALUATION
OUTCOME EVALUATION
EFFICIENCY ASSESSMENT
Used when control features of experimental designs cannot be achieved For example, the independent variable cannot be
manipulated Internal validity may be affected
© 2012 The McGraw-Hill Companies, Inc.
Threats to internal validity in quasi-experimental designs include: History Maturation Testing Instrument Decay Regression Toward the Mean
© 2012 The McGraw-Hill Companies, Inc.
One-Group Posttest-Only Design
© 2012 The McGraw-Hill Companies, Inc.
Nonequivalent Control Group Design
© 2012 The McGraw-Hill Companies, Inc.
One-Group Pretest-Posttest Design
© 2012 The McGraw-Hill Companies, Inc.
Nonequivalent Control Group Pretest-Posttest Design
© 2012 The McGraw-Hill Companies, Inc.
Interrupted Time Series Design Examines the dependent variable over an extended period
of time, both before and after the IV is implemented Interpretation problems (possible regression to the mean)
Control Series Design Improves interrupted time series design by finding an
appropriate “control group” Involves finding a similar population that did not receive a
particular manipulation Limited because this is not a true “control group”
© 2012 The McGraw-Hill Companies, Inc.
Cross-Sectional Method – persons of different ages measured at the same point in time
Longitudinal Method – same group is observed at different times (as they age)
Sequential Method – combination of 1 and 2
© 2012 The McGraw-Hill Companies, Inc.
© 2012 The McGraw-Hill Companies, Inc.
Cross Sectional Method
Year of Birth (cohort) Time 1: 2005
Group 1 1950 55 years old
Group 2 1945 60 years old
Group 3 1940 65 years old
© 2012 The McGraw-Hill Companies, Inc.
Longitudinal Method
Year of Birth (cohort)
Time 1: 2005
Time 2: 2010
Time 3: 2015
Group 1: 1950 55 yr 60 yr 65 yr
© 2012 The McGraw-Hill Companies, Inc.
Sequential Method
Year of Birth (cohort)
Time 1: 2005
Time 2: 2010
Time 3: 2015
Group 1: 1950 55 yr 60 yr 65 yr
Group 2: 1940 65 yr 70 yr 75 yr
Comparison of Longitudinal and Cross-Sectional Methods Strengths:
- Can attribute changes to development- Can examine variables at a later time
Weaknesses:- Expensive- Difficult- Morality- As a hybrid, the sequential method shares virtues of
both methods
© 2012 The McGraw-Hill Companies, Inc.