ddms: updates and discussion
DESCRIPTION
DDMs: Updates and Discussion. MVSA Ron Noble - ESE October 16, 2013. The Educator Evaluation Framework. Exemplary Proficient Needs Improvement Unsatisfactory. High Moderate Low. Everyone earns two ratings. Summative Performance Rating. Student Impact Rating. Two Ratings. - PowerPoint PPT PresentationTRANSCRIPT
Massachusetts Department of Elementary & Secondary Education
The Educator Evaluation Framework
ExemplaryProficient
Needs ImprovementUnsatisfactory
HighModerate
Low
SummativePerformance
Rating
Student Impact Rating
Everyone earns two ratings
2
Massachusetts Department of Elementary & Secondary Education
3
Two Ratings
Summativ
e Ratin
g Unsatisfactory Improvement Plan
Needs Improvement Directed Growth Plan
Exemplary
Self-Directed Growth Plan
Proficient
1-yr Self-Directed Growth Plan 2-yr Self-Directed Growth Plan
Low Moderate High
Rating of Impact on Student Learning
Massachusetts Department of Elementary & Secondary Education
4
Student Impact Rating
Evaluators must assign a rating based on trends (at least 2 years) and patterns (at least 2 measures)
Options:
Statewide growth measure(s) must be used, where available
District-determined Measure(s) of student learning comparable across grade or subject district-wide.
Massachusetts Department of Elementary & Secondary Education
5
Student Impact Rating – 2 examples
Year Measure Student Results
Year 1 MCAS SGP, grade 8 English language arts Low growth
Year 1 Writing assessment Moderate growth
Year 2 MCAS SGP, grade 8 English language arts Moderate growth
Year 2 Portfolio assessment Moderate growth
Year Measure Student Results
Year 1 MCAS SGP, grade 8 English language arts High growth
Year 1 Writing assessment Moderate growth
Year 2 MCAS SGP, grade 8 English language arts High growth
Year 2 Writing assessment Moderate growth
Year 2 Portfolio assessment Moderate growth
Massachusetts Department of Elementary & Secondary Education
6
Definition“Measures of student learning, growth, and achievement related to the
Massachusetts Curriculum Frameworks, Massachusetts Vocational
Technical Education Frameworks, or other relevant frameworks, that are
comparable across grade or subject level district-wide. These measures
may include, but shall not be limited to: portfolios, approved commercial
assessments and district-developed pre and post unit and course
assessments, and capstone projects.” 603 CMR 35.02
Student Measures Aligned to Frameworks Comparable Across District Expansive Definition of
Acceptable Measures
Massachusetts Department of Elementary & Secondary Education
7
SY 2013-2014 DDM Milestones
Date Action
September 2013
• Example DDMs released: http://www.doe.mass.edu/edeval/ddm/example/.
• All districts and RTTT charter schools submit list of DDMs to pilot during the 2013-2014 year. Template available here: http://www.doe.mass.edu/edeval/ddm/.
Sept. 2013 – June 2014 • All districts and RTTT charter schools pilot DDMs
June 2014• All districts and RTTT charter schools submit final plans, including
any extension requests, for implementing DDMs during the 2014-15 school year*.
*ESE will release the June 2014 submission template and DDM implementation extension request form in December 2013..
Massachusetts Department of Elementary & Secondary Education
8
DDM Implementation Timeline
August 15th – Commissioner’s Memorandum Extension requests will be coupled with June
2014 submissions
One-year extension of DDM implementation for particular grade(s)/subject(s) or course(s) for which the district has not yet identified DDMs.
Blanket extensions will not be granted.
Use judiciously - not all districts will need an extension
Not a pause button.
Massachusetts Department of Elementary & Secondary Education
9
DDM Key Questions
Is the measure aligned to content? Does it assess what the educators intend to
teach and what’s most important for students to learn?
Is the measure informative? Do the results tell educators whether
students are making the desired progress, falling short, or excelling?
Do the results provide valuable information to schools and districts about their educators?
Massachusetts Department of Elementary & Secondary Education
10
Refining your Pilot DDMs Districts will employ a variety of approaches to
identify pilot DDMs (e.g., build, borrow, buy). Key considerations:
1. How well does the assessment measure growth?
2. Is there a common administration protocol?3. Is there a common scoring process?4. How do results correspond to low,
moderate, of high growth?5. Is the assessment comparable to other
DDMs? Use the DDM Key Questions and these
considerations to strengthen your assessments during the pilot year.
Massachusetts Department of Elementary & Secondary Education
11
ResourcesAvailable Now: Technical Guide B DDMs and Assessment Literacy Webinar Series Technical Assistance and Networking Sessions Core Course Objectives and Example DDMs
Coming Soon Model Contract Language DDM Pilot Plan Cohorts Using Current Assessments Guidance
(Curriculum Summit)
Massachusetts Department of Elementary & Secondary Education
12
Example Assessments 150 assessments that provide over 800 options
for different grades/subjects and courses. More complete open source assessments
coming! We need your help! Please submit:
Assessment directions, materials, items and prompts Scoring resources (rubrics, answer keys) Other information (steps for administration, lesson plans,
examples of how results are used)
To submit your examples, complete the survey and upload your materials at https://www.smartsheet.com/b/form?EQBCT=52e3762ac7954f93aa40cc879bc38855
WestEd's DDM submission help line at (415) 615-3127. (10:00 a.m. and 7:00 p.m. EST.)
12
Massachusetts Department of Elementary & Secondary Education
13
Example Assessments Key features of
each option are described in a one-page summary.
Each one-pager includes a link for additional information.
Massachusetts Department of Elementary & Secondary Education
14
Ongoing Work with WestEd
1. Continued collection and evaluation of locally-developed assessments.
2. Evaluation of all collected assessments for additional grade/subject and course coverage, specifically to expand the collection of Example DDMs in the minimum pilot areas.
3. Analyze new information submitted by assessment developers and make appropriate revisions to one-page summaries.
4. Execute a scope of work that will yield Example DDMs in the CVTE program areas
Massachusetts Department of Elementary & Secondary Education
15
Using Current Assessments Presentation
Guidance Document: Using Current Assessments in DDMs
Curriculum Summit November 6th and 7th
Content Three steps for bringing together multiple
assessments from across the year to measure growth
Two concrete examples of this process using the Curriculum Embedded Performance Assessments (CEPAs) from the Model Curriculum Units (MCUs)
Massachusetts Department of Elementary & Secondary Education
16
DDMs: 4 Key Messages1. DDMs are part of a multidimensional
framework. Decisions about an educator’s impact or
effectiveness will never be based of the results of a single DDM.
2. Focus is on students, not just educators DDMs must yield information that will be useful to
educators in improving student outcomes.
3. This is about building capacity. DDMs provide districts a good reason to consider
ways to refine and improve existing assessment practices.
4. Teachers have the necessary skills to lead the process of identifying DDMs – You can do this!
Many districts will have success leveraging teacher-developed assessments to develop DDMs.