angelita chapter 12
TRANSCRIPT
BY: ANGELITA BROOKS
Designing and Conducting Summative Evaluations
Background
Summative assessments are used to evaluate student learning at the end of a unit or course and often determine course grades, or at least carry great value towards that determination. Summative assessment tools most commonly utilized are mid-term or end-of-term exams to determine the level at which students achieved the expectations for their learning as prescribed by the instructor and to identify instructional areas that may need additional attention.
Objectives
Define the purpose of summative evaluationDescribe the two phase of summative evaluation and the
decision resulting from each phaseDesign a summative evaluation to examine organizational
benefits of instructional that have been implementedContrast formative and summative evaluation by purpose
and design
Summative Evaluation
What is a Summative Evaluation
Summative evaluation is used to evaluate the effectiveness of a unit or instructional program. Teachers use summative evaluation to decide if students gained knowledge from what they have been taught. Types of summative evaluations include unit tests and statewide tests.
Two Phase of Summative Evaluation
Expert Judgement: determine whether currently used instruction or other candidate instruction has potential for meeting organization’s define instructional needs.
Field trial documents the effectiveness of promising instructions with target group members in the intended setting.
Expert Judgement Phase
Purpose:Do the materials have the potential for meeting this
organization’s needs?1. Congruence Analysis2. Content Analysis3. Design Analysis4. Feasibility Analysis5. Current User Analysis
Expert Judgment Phase
Congruence Analysis The expert judgment phase consists of performing a congruence
analysis consisting of a content analysis, design analysis, utility and feasibility analysis, and current user analysis. As each phase is conducted a no, no go, decision is made. If no, then the materials are sent back with feedback for further design and development. This phase is conducted with the instructional designer, the subject matter experts and often an external reviewer. Target learners are not involved in this stage of evaluation.
Expert Judgment Phase
Content AnalysisDuring this activity, an identified expert
is used to judge materials for accuracy and completeness to determine if they are inline with organization stated goals.
Expert Judgment Phase
Design AnalysisThe design analysis is an evaluation
of the adequacy of the components of the components of the instructional strategy included in the candidate material.
Expert Judgment Phase
Feasibility AnalysisFactors such as the availability of learners guide
or syllabus and an instructor’s manual are taking into consideration during this activity.
Expert Judgment Phase
Current User AnalysisThis final analysis seek to get information
about candidates materials from other organizations that are experience in using them.
Field Trail Phase
The purpose of the field trial phase of summative evaluation is to determine the effectiveness of instruction with the target group in the intended setting (Dick & Carey, 1996). There are two parts to the field trial phase: outcomes analysis and management analysis. The outcomes analysis reviews the impact of the instruction on the learner, the job and the organization. Management analysis assesses "instructor and supervisor attitudes related to learner performance, implementation feasibility, and costs" (p. 323).
Fileld Trail Phase
Purpose:Are the materials effective with target learners in the
prescribed setting?Outcome Analysis:1. Impact on Learner2. Impact on Job3. Impact on Organization
Field Trail Phase
The Main Purpose of a Summative Evaluation
Summative evaluation provides information on the product'sefficacy ( it's ability to do what it was designed to do). Forexample, did the learners learn what they were supposed tolearn after using the instructional module. In a sense, it lets thelearner know "how they did," but more importantly, bylooking at how the learner's did, it helps you know whether theproduct teaches what it is supposed to teach.
Comparison of Formative & Summative Evaluation
Reference
https://www.csn.edu/PDFFiles/academics/Resource%20Development%20and%20Assessment/Assessment/Summative_vs_%20FormativeEvaluation.pdf
SUMMARY (Change Agent)
As a change agent, evaluating goals and determine the worth or merit in an educational setting is very important. Well-designed evaluations also provide information that can help explain the findings that are observed. In these days of reform, educators are continually faced with the challenges of evaluating their innovations and determining whether progress is being made or stated goals have, in fact, been reached. A change agent should use common sense and their professional practice to ensure they make affective changes. The goal should be to provide an ongoing source of information that can aid decision making at various steps along the way.
The End
Angelita Brooks