Maryvale

Regents Science

Data Rollout

Reviewing Current Assessment Reviewing Current Assessment DataData

• Initial reactions

• Where do you believe your students were MOST successful when compared to Erie 1?

• Where do you believe they struggled The MOST when compared to Erie 1?

Top 5 Color Top 5 Color GreenGreen

Top 5 Color Top 5 Color RedRed

Findings and DiscussionFindings and Discussion• Look at the LIKE SCHOOL data and the test…yellow’s as

well…• Discussion: WHY? Green? Yellow? Red?• Perceptions/Data?• Incorrect responses – distracters, non-exemplars,

guess??• Findings regarding last year’s assessment:

1. Based on our findings with last year’s assessment…now let’s look at the last couple of years and see if we can find trends in the questions they are asking from each PI and gaps in “trended” areas.

2. WHY? Look at our Curriculum (specifically for Gaps). Is it spiraled? Are we teaching what they need to learn? And then, HOW are we teaching it?

Look at Trend and Gap Data

• Pick 3-5 PI’s where there is trend data, recent Q’s asked, AND gaps.

• Use Deconstruction Template to Deconstruct the PI AND the Q’s for:

Content – Standard 4

Skills –Standard 1,2,6,7 (skills)Skills –Standard 1,2,6,7 (skills)

Cognitive Load

HOTS

1. Based on our findings with last year’s assessment AND trend and gap data, let’s come up with a plan.

2. Summary and Findings:

3. Action Plan:

Day 2

Defining a Purpose

• Why would we use common formative assessments?

• What are the benefits?

• What are the potential pitfalls?

• How do we approach beginning this work?

The Power of Common Formative

AssessmentsWhy are we doing this?

Common Formative Assessment allows teachers to assume full control over

curriculum, instruction, and assessment decisions.

These decision are made by teams of teachers who come

together as a professional learning community.

Teachers collaborate to build assessments that are valued by all and that serve

students well.

Common Formative Assessments promote consistency across consistency across grade levels and provide for grade levels and provide for scaffolding between them.scaffolding between them.

Using CFAs leads to real instructional change.

Classrooms literally become laboratories and the findings

guide our decisions.

Using CFAs provides educators Using CFAs provides educators with multiple measures of with multiple measures of

assessment.assessment.

Relying on standardized test data is not enough.

We must study trends, content, AND skills and respond in ways that make

sense.

Common Reasons for Implementation

CFAs are used to…

• align curriculum• align practices• measure progress• improve scores• enhance professional relationships and promote

collaboration

Which reason do you value most? Why?

The Foundational Premise of Positive Change?

People are more important than scores.

Conversation and Collaboration?

These are the most important elementsthe most important elements of the work.

Without these pieces, the initiative will fail.

Professional Learning Communities:Using Data and CFAs to Inform Instruction

• Explore and deconstruct longitudinal data to define what is most important and needs.

• Common Formative Assessment

• Collaborative Scoring/Findings

* Use of Multiple Measures of Formative Assessments or include in CFA’s*

Using Formative Assessments• Deconstruct Longitudinal Data to Define Needs.• Administer a COMMON FORMATIVE ASSESSMENT

(diagnostic), which is aligned to data needs and looks, in construct, like the state assessment.

• Collaboratively score and draw findings.• Teach accordingly, and USE MULTIPLE MEASURES OF

FORMATIVE ASSESSMENT aligned to defined areas of need.

• Collaboratively score and draw findings.• Teach accordingly.• Administer a COMMON FORMATIVE ASSESSMENT

(post-test), which is aligned to data needs and looks, in construct, like the state assessment.

• Collaboratively score and draw findings. Did scores improve pre/post?

Inch by inch it's a cinch, yard by yard it is

hard!"

1. Deconstructing the test items -- what vocabulary words and skills are in each item.

2. What vocabulary and skills are written in the core curricula major understanding?

3. How is this concept being taught (steps, focus, activities)

4. The assessment questions must be “written” ALIGNED to the rigor of BOTH the content AND skills (use bloom’s wheel). Assessment types may be combined if more than one skill or concept is being evaluated.

Content/Concepts– the “what” in the curriculum. It is what teachers teach, what students learn, and the subjects or topics studied.

Skills –it is how students demonstrate their understanding of the content. Skills require action verbs such as analyze, dissect, interpret, perform, and evaluate.

Assessments – the evaluation tool used to determine whether students learned the content and can use the skills taught in the classroom

Gap Standard Content (VOCABULARY)

Skill Assessment

How can they be written?• Selected response --multiple choice;

t/f; matching• Constructed response—short answer;

open response; extended response (rubric)

• PERFORMANCE TASKS (rubric)

Use pages 41-62 as a resource

• ProcessProcess not product – a “scientific not product – a “scientific experiment”experiment”

• Aligning the Curriculum: The Science. Jan Jacob. Erie 1 BOCES, West Seneca, New York. Oct. 2005.

• Bernhardt, Victoria.1998. Data Analysis for Comprehensive Schoolwide Improvement. Larchmont, NY: Eye on Education.

• English, Fenwick (2001). Deep Curriculum Alignment. Lanham, MD: Scarecrow Education

• Formative Assessment Building. Larry Ainsworth. Erie 1 BOCES, West Seneca, New York. Sept. 2007.

• Martin-Kniep, Giselle. 2005. Assessment Liasons Program. Albany, NY.

• Nussbaum-Beach, Sheryl. “9 Principles for Implementation: The Big Shift.” (Weblog Entry). 21st Century Learning Collaborative. 28 March 2008. (http://21stcenturylearning.typepad.com/blog/2008/03/10-principles-f.html).

• Popham, W. James (2008). Transformative Assessment. Alexandria, VA: Association for Supervision and Curriculum Development.

REFERENCES

Day 2

• Discussion

• What worked?

• What NEEDS work?

• Where are you?

• Where do you see yourself by the end of today? Quarter 1? Semester 1? End of the year?

Checking for Alignment

• Do/does the question align to the skill/content/both?• Are any of our questions NOT aligned?• Does the assessment match or go above the rigor of the

gapped questions/standard?• Do the assessment items use the same terms that

appear in the standards as opposed to more “student friendly” wording?

• Do the assessment items align or resemble the formatting of the state assessment?

• Are we addressing too many gapped areas/vocabulary/power standards in this assessment?

• What do we need to change/modify?

• Is there a range of low-level and high-level thinking and problem solving skills?

• When will we implement this?• How will we score this? RUBRIC? • How will we use the data to inform our

instruction?• What other types of assessments might

we consider using within the unit or as an additional CFA?

More Thoughts and Implementation Plan