experimental comparison of inquiry and direct instruction in science
DESCRIPTION
Experimental Comparison of Inquiry and Direct Instruction in Science. Funded by the National Science Foundation’s Interagency Education Research Initiative (IERI/NSF 04-553) Award #0437655. The opinions expressed in this report are the sole responsibility of the researchers. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/1.jpg)
Experimental Comparison of Experimental Comparison of
Inquiry and Direct Instruction in Inquiry and Direct Instruction in ScienceScience
Funded by the National Science Foundation’s Interagency Education Research Initiative (IERI/NSF 04-553) Award #0437655
Dr. William CobernDr. William CobernDepartment of Biological Department of Biological SciencesSciences
Dr. David Schuster Dr. David Schuster andand Betty Betty AdamsAdamsDepartment of PhysicsDepartment of Physics
The opinions expressed in this report are the sole responsibility of the researchers
![Page 2: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/2.jpg)
Background to the StudyBackground to the Study
Inquiry-based or direct instruction in science?
Long-standing educational and political debates
Pendulum swings
Direct Prevalent in past
Inquiry National Science Education Standards
Constructivism?
A theory of learning – either way
![Page 3: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/3.jpg)
We know about• Experientially-based √• Active-engagement √
But these can occur in both Inquiry and Direct
Both can be ‘hands-on’ and ‘minds-on’ if so designed.
Research Evidence?Research Evidence?
![Page 4: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/4.jpg)
Our QuestionOur Question Is NOT
whether active-engagement experiential-based learning of science is more effective than passive non-experiential learning
But IS whether an inquiry approach or a direct approach to experientially-based instruction is more effective for science concept development
…when both approaches are expertly designed and well executed
This is the question our research addressed.
![Page 5: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/5.jpg)
Inquiry-based Science InstructionInquiry-based Science Instruction
There are now many inquiry-based curricula and lessons
Their evaluations show these to be ‘successful.’
But compared to what?
Assumption is that the merit/superiority of inquiry science instruction is well-established
However, meta-analysis of many such studies (Educational Development Council, 2007) found
Not sufficiently unconfounded to draw the inferences
Research rigor has declined from 1984 - 2002
![Page 6: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/6.jpg)
Threats to Validity of StudiesThreats to Validity of Studies
• Few controlled comparative studies
• Pitted against poor or nebulous ‘traditional’ instruction
• Few use randomized assignments or quasi-experimental controls for differences
• Evaluations not independent of developers or researchers
• Insufficient specification to allow replication
• Fidelity: implementation not compared to intended instruction
![Page 7: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/7.jpg)
Direct InstructionDirect Instruction
• Well-designed direct instruction
• Some relevant work:
• Kirschner et.al. – Why mimimally-guided instruction does not work
• Klahr & Nigam – ‘Direct’ vs. ‘discovery’
• Ausubel – Issue is meaningful learning vs. rote learning
![Page 8: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/8.jpg)
Instructional ContextInstructional Context
5 experienced middle school science teachers
8th grade students responding to flyers sent home by school district offices
2 week voluntary summer program with students randomly assigned to treatment group
In-class instruction only; intrinsic motivation
![Page 9: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/9.jpg)
Tenets
Specificity
Fidelity
Objectivity
Transparency
Research Research FrameworkFramework
![Page 10: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/10.jpg)
Specificity
Inquiry or Direct?Inquiry or Direct?
![Page 11: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/11.jpg)
Specific about…Specific about…
A. The meanings of Inquiry and Direct
B. The nature and design of instructional
units
C. The assessment
![Page 12: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/12.jpg)
A.A. What do we What do we meanmean byby ‘Inquiry’ and ‘Direct’ ‘Inquiry’ and ‘Direct’ Instruction?Instruction?
Single-word descriptors are vague, ambiguous and open to (mis)interpretation Such as “inquiry, direct, discovery,
didactic, conventional/traditional, lecture, active-engagement, hands-on …”
We need to specify models for each mode
![Page 13: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/13.jpg)
1. Model of Guided-Inquiry 1. Model of Guided-Inquiry Science InstructionScience Instruction
PHASE DESCRIPTIONExploration Observing phenomena, posing questions,
exploring, investigating … (Science-in-the-making)
Concept Formation
Guided formation of relevant concepts. Formulation of principles, laws or models
Concept Application
Applying the concepts and principles to new situations. To solve problems, explain and predict.
The Learning Cycle
Karplus Cycle
![Page 14: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/14.jpg)
Karplus Cycle DiagramKarplus Cycle Diagram
Epistemology: Exploration leads to concept formation Inductive aspects
(Note: 5-E Learning Cycle has Karplus at its heart)
![Page 15: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/15.jpg)
2. Model of Direct 2. Model of Direct InstructionInstruction
Epistemology:Presentation then illustration/confirmationDeductive
PHASE DESCRIPTION
Concept Presentation
Presentation/reception of facts, concepts, laws etc. Ready-made-science. Explanation & clarification
Illustration & Confirmation
Illustrate with examples, demonstrations.Verification experiments.
Concept Application
Applying the concepts and principles to new situations. To solve problems, explain and predict.
The Direct-Active Cycle
![Page 16: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/16.jpg)
No Caricatures or No Caricatures or Straw-man ComparisonsStraw-man Comparisons
Direct caricature: Pure didactic presentation
with passive reception/absorption
Inquiry caricature: Open discovery (unguided chaos)
Hands-on alone does not make it inquiry
![Page 17: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/17.jpg)
Lessons as CompositesLessons as Composites
Lessons have many constituent parts
All lessons are composites
Never 100% inquiry or direct throughout
To attempt this would be poor instruction generally
![Page 18: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/18.jpg)
The essential difference?The essential difference?
What then is the essential difference between Inquiry and Direct?
“How students come to the concept”
Through exploration or are they told upfront?
This is the Active Agent that differs between modes
Lessons may have other Common Constituents
![Page 19: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/19.jpg)
‘‘Active Agent’Active Agent’Example from Dynamics
How do students come to the force-motion law?
i. By exploring system behavior and proposing a law, OR
ii. By being given the law and confirming system behavior.
Added value, beyond just content knowledge?
Besides acquiring knowledge of the law, what else do students learn or gain, in one mode or the other?
![Page 20: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/20.jpg)
B.B. THE INSTRUCTIONAL THE INSTRUCTIONAL UNITSUNITS
The heart of the study – Two important science topics
– Significant conceptual development sequence
Each written in Inquiry and Direct modes
Student and teacher booklets for each
![Page 21: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/21.jpg)
![Page 22: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/22.jpg)
![Page 23: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/23.jpg)
Two Approaches (Two Approaches (InquiryInquiry//DirectDirect))
Essential Similarities Content
Objectives/goals
Equipment/materials
Practice problems
Assessment
Essential Differences
SequenceEvidence before claimsClaims before evidence
Teacher’s roleAsks… Tells…
Student’s experience … finds out … confirms
![Page 24: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/24.jpg)
INQUIRY (investigative approach)
Exploration
Guided Concept Development
Application
Student learns by experiencing scientific inquiry, guided toward developing and applying scientific concepts & laws
(based on Karplus Learning Cycle)
DIRECT (confirmatory approach)
Delivery/Explanation
Verification
Application
Student learns by receiving, verifying, and applying scientific concepts & laws
InquiryInquiry andand Direct Direct Instructional Instructional ModelsModels
![Page 25: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/25.jpg)
C.C. THE ASSESSMENT THE ASSESSMENTNature and quality of assessment is crucial
The project data depends on it
Tests understanding of the main science concepts
Problem-based Ability to apply concepts in (relatively) new
situations Bloom taxonomy levels 2 and 3 Conceptual MCQ form ‘Assessment as curriculum’ - examples as
indication
![Page 26: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/26.jpg)
Assessment: examplesPrediction question
Amy is pushing on a wagon containing some packages. The wagon has good wheels so that friction is very small and the floor is level.
If Amy keeps pushing continuously, with a constant pushing force, and friction can be ignored, then the wagon will…
A. not move. B. move with a constant speed. C. speed up steadily. D. slow down.
How confident are you of your answer? i. Very confident. ii. Somewhat confident. iii. Not confident at all
Why?
![Page 27: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/27.jpg)
14. An ice skater first gets up to speed, then stands on one skate and keeps going steadily across the ice without any apparent effort. The reason for her keeping moving like this without effort is that…
A. the ice must be sloping slightly downwards. B. the air is pushing her forward. C. this is the natural behavior of objects with
no net force on them. D. the force that got her moving is still acting on her.
How sure are you of your answer? i. Very sure. ii. Somewhat sure. iii. Just my best guess.
Assessment: examplesExplanation question
![Page 28: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/28.jpg)
6a. The diagram below shows the earth relative to the light coming from the sun at a particular time of the year.
At this particular time of the year, what season(s) will be occurring in the northern and southern hemisphere? Circle A, B, C, or D.
Answers Northern Hemisphere
Southern Hemisphere
A Summer Summer
B Summer Winter
C Winter Winter
D Winter Summer
![Page 29: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/29.jpg)
Assessment instrumentsAssessment instruments
22-question set for each topic unit 2 to 4 questions on each central
concept Identical Pre- and Post-tests Ascertain gain
![Page 30: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/30.jpg)
“Prepare and Verify”PrepareMonitor Evaluate
FidelityFidelity
![Page 31: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/31.jpg)
• Teachers blind to the assessments — no teaching to the (known) test
• Independent evaluators marked the assessments blind to student group assignments
• Independent observers rated teaching: to nature and degree of inquiry or direct
ObjectivityObjectivity
![Page 32: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/32.jpg)
Transparency of research: We make available details of what the research involved, thus facilitating possible replication.
Our work is made available in detail at http://www.wmich.edu/way2go/
TransparencyTransparency
![Page 33: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/33.jpg)
AnalysisAnalysis
Data aggregated over 2 years of trials (2007, 2008)
N=180 students (72 Direct, 108 Inquiry… to date)
Pre- and Post- assessments yielding each student’s raw percentage gain scores
Student gain scores normalized
Comparisons of both raw and normalized gain scores across various groups (modes of instruction, teachers) (t-test, ANOVA, α=.05)
![Page 34: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/34.jpg)
Findings Findings (Example of raw % (Example of raw % gains)gains)
Total 07-08 LIGHT gain 13.6%, SD=15.3, is statistically significant (t(179)=11.934, p< .001), with an effect size (Cohen’s d) of .69(effect size of 1.4 for normalized gain)
Gain 14.1%, SD=16.4, is statistically significant (t(107)=8.925, p< .001), effect size (Cohen’s d) .67 Total 07-08 DYNAMICS gain 9.7%,
SD=13.5, is statistically significant (t(179)=9.655, p< .001), with an effect size (Cohen’s d) of .54 (effect size of 1 for normalized gain)
![Page 35: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/35.jpg)
Findings Findings (Light Unit (Light Unit Summary)Summary)
![Page 36: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/36.jpg)
Findings Findings (Dynamics Unit (Dynamics Unit Summary)Summary)
![Page 37: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/37.jpg)
FindingsFindingsLIGHT Unit – Two Trials (2007, 2008)
Direct vs. Inquiry normalized gain mean difference of 3.8%
was not statistically significant (t(178)=.755, p=.451)
(std. error diff. 5.1, effect size Cohen’s d=.12)
Ann (Direct) and Tom (Inquiry) had a mean difference in raw gain of 7.6%, which was statistically significant (t(73)=2.132, p=.036), but the mean difference between their normalized gain scores was not (t(73)=1.857, p=.067)
DYNAMICS Unit – Two Trials (2007, 2008)
Direct vs. Inquiry mean difference of 3.1%was not statistically significant (t(178)=.717,
p=.474) (std. error diff. 4.4, effect size Cohen’s d=.11)
![Page 38: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/38.jpg)
ConclusionsConclusions• Given natural class and teacher variation in
realistic classroom situations, good inquiry and direct instruction led to similar understanding of science concepts and principles in comparable times.
• Thus advocacy of either method cannot be based on science content acquisition alone.
• Inquiry-based instruction offers significant potential advantages for science education by modeling scientific inquiry during concept learning: these concomitant benefits would need to be studied in research for that purpose.
• However for science concept understanding, expertly designed instructional units, sound active-engagement lessons, and good teaching are as important as whether a lesson is cast as inquiry or direct.
![Page 39: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/39.jpg)
http://www.wmich.edu/way2go/
Funded by the National Science Foundation’s Interagency Education Research Initiative (IERI/NSF 04-553) Award #0437655
The opinions expressed in this report are the sole responsibility of the researchers.
![Page 40: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/40.jpg)
Controlled comparative study Controlled comparative study Treatment and control groupsTreatment and control groupsActual classroom situationsActual classroom situations
![Page 41: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/41.jpg)
![Page 42: Experimental Comparison of Inquiry and Direct Instruction in Science](https://reader036.vdocuments.site/reader036/viewer/2022062721/568136ce550346895d9e6a55/html5/thumbnails/42.jpg)
General Design ConsiderationsGeneral Design Considerations
Substance
Coherent development
Conceptual
Challenging
Experiential
Standards
Learning objectives
Clear main focus
‘Hands-on / minds-on’
Engagement
Reinforcing examples
Application
Reflection
Length?