a multi-pronged approach to embedded assessment: research...
TRANSCRIPT
![Page 1: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/1.jpg)
A Multi-Pronged Approach to Embedded Assessment: Research and Evaluation in the GRADUATE Project
Len Annetta, Ph.D.North Carolina State University
Karen Peterman, Ph.D.Independent Evaluation
Consultant
Thursday, February 25, 2010
![Page 2: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/2.jpg)
GRADUATE
•Impact NC graduation requirement
•4 P’s
•Game based learning through construction
•Adventure Lab
Thursday, February 25, 2010
![Page 3: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/3.jpg)
Summary of GRADUATE Evaluation Goals
★Determine the extent to which the program:
• Prepares teachers to lead students in project-based learning
• Improves students’ knowledge, skills, attitudes and interest in relevant careers
★Document:
• Characteristics of student participants
• Students’ differential success with graduation projects
• Ways in which student characteristics are related to student outcomes
Thursday, February 25, 2010
![Page 4: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/4.jpg)
Snapshot of GRADUATE Methodology
• Pre-post comparison group design
• Survey, assessment, observation, and embedded assessment measures
• Teachers and students
• Data will be used for both research and evaluation purposes
Thursday, February 25, 2010
![Page 5: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/5.jpg)
Documenting Student Characteristics
•Basic demographic characteristics
•Science attitudes and experiences
•Science and technology self-efficacy
•Use of technology and games
•Computer skills
•Mental rotation and visualization abilities
•Self-perceived strengths and weaknesses with 21st Century Skills
•Career Interests
N=69 treatment and N=58 comparison group students
Thursday, February 25, 2010
![Page 6: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/6.jpg)
Example of Research within the Evaluation
• Research Question: How do spatial reasoning and mental rotation skills influence the quality of student Serious Game creation?
• Shepard & Paper Folding
• Correlate results to game rubric results
Thursday, February 25, 2010
![Page 7: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/7.jpg)
Student Products as Embedded Assessments
•NC Graduation Project rubrics: research paper, product, portfolio, and presentation
•Collaborate with teachers to create portfolio components that can serve needs of both students and the evaluation
Thursday, February 25, 2010
![Page 8: A Multi-Pronged Approach to Embedded Assessment: Research ...stelar.edc.org/.../Research_GRADUATE_A_Multi_Pronged_Approach.pdf · A Multi-Pronged Approach to Embedded Assessment:](https://reader031.vdocuments.site/reader031/viewer/2022022514/5af64e4d7f8b9a74448f59a4/html5/thumbnails/8.jpg)
!
Using Technology to Record Embedded Assessment Data
Developers:•Decision points in game•Time spent editing•# transitions between edit and play mode
Players:•Science content in the
game•Use of science skill in the
game to advance play
Thursday, February 25, 2010