transitional the assessment is your district ready? celebrating 25 years!11988 - 2013
Post on 25-Dec-2015
215 Views
Preview:
TRANSCRIPT
Celebrating 25 Years! 1
Transitional THE Assessment
Is Your District Ready?
1988 - 2013
Celebrating 25 Years! 2
Objectives for the day
• Participants will– Understand who and what will be tested– Understand differences in KSDE and CETE
resources– Find KITE, log in, and create tests– Download KITE Client software– Understand and use new technology Enhanced
Resources
1988 - 2013
Celebrating 25 Years! 3
Norms for the day
• Cell Phones on vibrate• Consideration of each other’s needs and level
of understanding• Keep the conversation positive• Post all unanswered questions in the Parking
Lot
1988 - 2013
Celebrating 25 Years! 4
What Color is your Car?
Get into groups of like car colored people
Introduce your selves
What common characteristics do you find in your group? Why do you drive the color car you do?
1988 - 2013
Celebrating 25 Years! 5
What your car color says about you
Dealing with the “cars” in the lot…
1988 - 2013
Celebrating 25 Years! 6
First the Basics
• Math and Reading 3-8 grades and 11th graders who do not have a banked score.
• CETE would appreciate all 10,11,and 12 grades to test for data quality reasons.– Only banked scores will be used for accountability
• Science Grades 4, 7 and OTL with both sections by their 11th grade year
• History / Government – No Test• Writing, local recommended but not required1988 - 2013
Celebrating 25 Years! 7
Resources
• KSDE– http://
ksde.org/Agency/DivisionofLearningServices/CareerStandardsandAssessmentServices/CSASHome/Assessments.aspx
• CETE– www.ksassessments.org
• SWPRSC– Presentation Handouts
1988 - 2013
Celebrating 25 Years! 8
The New CETE Summative• College Ready Standards;• deliver the test via computer, both desktop/laptop and iPads;• include technology- enhanced items, built using templates similar to those used for
SBAC;• include only machine- scorable items;• map every item to an SBAC assessment “claim,” which will be the unit for reporting
subscores;• contain items that have all been written to the SBAC “targets,” which represent the
ways in which students may be expected to learn and demonstrate their knowledge—by integrating skills and concepts across standards, rather than by tapping only isolated skills within one standard;
• use the SBAC blueprint as a guideline for determining which standards to emphasize;• include multiple forms;• match the SBAC style guide with few exceptions; and• merge SBAC allowable accommodations with the Kansas accommodations policy to
provide further computer based accommodations to students.‐
1988 - 2013
Celebrating 25 Years! 9
Technology Enhanced Items
• CETE has developed about 40 technology enhanced templates
• They are used to assess a concept not easily assessed through multiple choice.– Interactive and engaging– Provide a better measure of a construct– Assess existing construct more efficiently
• Practice TEI assessment can be assessed now for formative use
1988 - 2013
Celebrating 25 Years! 10
Technology Enhanced Items
1988 - 2013
Celebrating 25 Years! 11
Technology Enhanced Items
1988 - 2013
Celebrating 25 Years! 12
Technology Enhanced Items
1988 - 2013
Celebrating 25 Years! 13
Reporting
• Not immediate this year because of cut scores will need to be set after all tests are completed.
• Students will only receive proficiency category.• Scores will be reported on the claims at the
school level.
1988 - 2013
Celebrating 25 Years! 14
English Language Arts
• Between 52 and 60 items total• Two sessions– Reading and writing on each section
• Item types include:– Selected response– Multiple selected response– Technology response
1988 - 2013
Celebrating 25 Years! 15
English Language Arts
• Claim 1– Literacy and informational texts– Items are related to texts– All claim 1 targets are included• Targets 1-7 Literacy• Targets 8-14 Informational
1988 - 2013
Celebrating 25 Years! 16
English Language Arts
• Claim 2 – Writing– Stand alone (not text – based)– Only some targets are included• Targets 1/3/6: Write/Revise Brief Texts• Target 8: Language and Vocabulary Use• Target 9: Edit/Clarify
1988 - 2013
Celebrating 25 Years! 17
English Language Arts
• Not Included on 2013/2014 assessment:– Claim 3 – Speaking / Listening– Claim 4 – Research– Constructed response tasks– Performance tasks
• Additional coverage of the KCCRS will be included in future assessments
1988 - 2013
Math Transitional Assessment
• Around 60 items total• Two sections• Item types include:– Selected response– Multiple select response– Technology enhanced– Numeric entry
Math Transitional Assessment
• Smarter Balanced Claims– Claim 1: Concepts and Procedures– Does the student know how to DO the math?– Focus: Mathematical Content Standards
Math Transitional Assessment
• Grades 3-8– Targets for claim 1 are the clusters– “Major” or “additional supporting”– Greater focus on ‘major” and less on “additional /
supporting”– Students will see at least 1 item from every
cluster in their grade level
Math Transitional Assessment
• High School– Targets only 16 clusters for Claim 1– “Major” or “additional / supporting”– Greater focus on ‘major” and less on “additional /
supporting”– Students will see at least 1 item from every
cluster in their grade level
Math Transitional Assessment
• All Grade Levels– All claim 1 targets– Claim 1 targets from previous grades
• Special note for HS: SBAC specifies any standard can be assessed in these claims. However CETE has only used the targeted Claim 1 standards or those from the lower grades.
Math Transitional Assessment
• Calculator Use– 3-5 no calculator– 6-HS Calculator active and inactive subsections• On the calculator active subsection, special
mathematical tools (e.g., abacus or large button calculators) are permitted for students in their IEP.
• Not included on 2013-2014 assessment:– Constructed response tasks– Performance tasks
Accessibility
• Tools are available to all students all of the time. Tools include:– Highlighter– Striker– Eraser– Calculator on calculator portions of math tests– Periodic table on high school physical science test– Screen magnification
• Tools do not change how the content is delivered or how the student responds
Personal Needs and Preferences
• The PNP allows teachers to identify students special needs and drives the delivery of accommodations
• The PNP is accessed in the Student Record in Educational Portal
• The PNP includes:– Display enhancements: how resources are to be presented
and structured.– Language Brail: how content is communicated to the learner– Audio Environment Supports: how content is audibly
delivered and testing environment adapted to fit the learner’s needs
Available Accommodations
• Text to speech will be available for students requiring audio presentation of items and directions
• Braille, large print, and print booklets will be available in electronic files– Brail booklets will be delivered as braille-ready
files (BRFs) for download to an embosser; graphics will be delivered as PDFs
– Print booklets will be available as PDFs
Celebrating 25 Years! 27
KITEKansas Interactive Testing Engine
• Access at www.ksassessments.org• Access to the state summative• Access to Kwiet (writing test)• Access to Career Pathways (CTE)• Access to Dynamic Learning Maps (The old
Alternative)• Access to Formative Tools• Access to old NCLB data
1988 - 2013
Celebrating 25 Years! 28
Things that have to happen before you can use KITE
• First – Superintendent must complete his/her EDCS Report in the authenticated applications at KSDE
• Second – the district data steward must complete a STCO submission to KIDS
• Third – KSDE sends the data to CETE every night
• Assign Roles
1988 - 2013
Celebrating 25 Years! 29
Hardwar Issues
• Works on PC, Mac, and IPad devices.– Download the KITE Client
• May have it up for Chrome• IPad– Go to Safari– Type in tde.cete.us/TDE/login.html
1988 - 2013
Celebrating 25 Years! 30
Formative Assessments
• www.ksasessments.org• Hover over “For Educators”• Click on Formative Assessment Tools• Explore the Language Arts and Mathematics
offerings– At your table, ½ commit to ELA research and ½ commit
to Math research– Read material– Report to shoulder partner high lights– Share reports with the rest of the table
1988 - 2013
Celebrating 25 Years! 31
The Portal
• Educator.cete.us• Sign in using your school e-mail address as
username.• (First Time)Click on forgot password.• Check you school e-mail account for instructions to reset your account.
1988 - 2013
Celebrating 25 Years! 32
Navigating KITE
1988 - 2013
Celebrating 25 Years! 33
Navigating KITETest Management
1988 - 2013
Celebrating 25 Years! 34
Navigating KITEAdding a new test
1988 - 2013
Celebrating 25 Years! 35
Navigating KITE
1988 - 2013
Celebrating 25 Years! 36
Navigating KITE
1988 - 2013
Celebrating 25 Years! 37
Navigating KITE
1988 - 2013
Celebrating 25 Years! 38
Navigating KITE
1988 - 2013
• Select the test you want and then click “Next”
Celebrating 25 Years! 39
Adding Students
• Click on the Students Tab
1988 - 2013
Celebrating 25 Years! 40
Adding Students
• Click on the Students Tab
1988 - 2013
Celebrating 25 Years! 41
Adding Students
• Click on the Students Tab
1988 - 2013
Celebrating 25 Years! 42
Naming the test
1988 - 2013
Celebrating 25 Years! 43
Naming the test
1988 - 2013
Celebrating 25 Years! 44
Print your tickets
1988 - 2013
Celebrating 25 Years! 451988 - 2013
Celebrating 25 Years! 46
KITE Client
• This is needed for students to access their KITE Portal
• Go to www.ksassessments .org• Hover over “For Educators” and click on KITE• Down load the client onto your computer
1988 - 2013
Celebrating 25 Years! 47
Warning
• Tickets– Same ticket information for all tests– Students could take the test at home– Students could take some else’s test– IPad users could pop out of the test to look up
information• If this should happen there is an SC code for
this
1988 - 2013
Celebrating 25 Years! 48
Lets Practice
• Open a web browser• Go to educator.cete.us and log in• Click on Test management• Search for “Practice for Technology-Enhanced
Items”• Click the radio button and then click next• Select some 3 or 4 random students• Print your tickets
1988 - 2013
Celebrating 25 Years! 49
Lets Practice
• Launch your KITE Client• Log in with the ticket information as a student• Experience the joys of Technology Enhanced
Items
1988 - 2013
Celebrating 25 Years! 501988 - 2013
Celebrating 25 Years! 51
Next Generation Assessments in Kansas
Marianne PerieCETE
January 22, 2014Presented at KAAC in Topeka
And USA in Wichita
1988 - 2013
Celebrating 25 Years! 52
Everything is changingSmarter Balanced Assessment Consortium (SBAC)Wiser Harmonious Assessment of Kansas (WHAK)(We (CETE)are taking suggestions on naming this new assessment!)
1988 - 2013
Celebrating 25 Years! 53
But how much is changing, really?
• Transition assessment in Spring 2014 is the same as we have always planned.
• Spring of 2015, when we would have had SBAC for the first time, we will have an enhanced Kansas assessment.
• By Spring of 2016, we will be very close to where we would have been with SBAC with difference due to choices made in Kansas.
1988 - 2013
Celebrating 25 Years! 54
Spring 2014
• Transition Assessment– Delivered on KITE– Aligned with Kansas College and Career Ready
Standards for math, reading, and writing conversations– Follows similar blueprint to SBAC– Machine-scorable items only– No performance task
- No writing prompt - No listening items
1988 - 2013
Celebrating 25 Years! 55
New Development in 2014-2015
• The transitional test will serve as the backbone for the new Kansas College and Career Ready Assessment
• Enhancements– Listening section– Writing prompt– Math performance tasks
1988 - 2013
Celebrating 25 Years! 56
Spring 2015
• The core machine-scorable part of the test will be parallel to what was administered in 2014, but we will refresh the item pool.
• We will field test the enhancements.• Accountability for 2015 will be based on the core
portion of the test.• Schools and districts will receive feedback on the
field-test portions to help gauge students readiness on the full set of standards.
1988 - 2013
Celebrating 25 Years! 57
Summer 2015
• After analyzing the field-test items, we will create the best form possible that includes all features of our future assessment.
• We will set new achievement standards (cut scores and performances level descriptors) based on that form.
• Using those new cute scores, we will set new AMOs and communicate the new targets to schools and districts.
1988 - 2013
Celebrating 25 Years! 58
Spring 2016
• Now we have a fully enhanced test that covers all of the Kansas College and Career Ready Standards.
• We should also have sufficient numbers of items to make the test adaptive this year as well.
1988 - 2013
Celebrating 25 Years! 59
Adaptivity
• The test will be adaptive to allow students to be measured on items close to their ability level.
• We are considering stage adaptivity rather than item adaptivity that SBAC uses.
• Benefits– More reliable estimates– Targets assessment to student level
1988 - 2013
Celebrating 25 Years! 60
Special Education
• Adaptivity should help students who used to take the KAMM. They will be assessed on grade-level, but with easy items.
• Many tools are available to all students (e.g., highlighter, notes, calculator)
• Accomodations are available electronically (striker, contrast, auto font)
• TTS is available in a new and improved voice this year.
1988 - 2013
Celebrating 25 Years! 61
Kansas Fingerprints
• We want Kansas educator and stakeholder fingerprints all over these new assessments– Teachers
- Design decisions- Item writing- Item reviewing- Rangefinding- Scoring
1988 - 2013
Celebrating 25 Years! 62
Kansas Stakeholders
• Administrators – Support teacher involvement– Voice in report decisions– Cross-content development
• Kansas Board of Regents– High school-we want to ensure that test truly
predict college readiness– Will be involved in design and review of
assessments and setting cut scores
1988 - 2013
Celebrating 25 Years! 63
Full Kansas Assessment Program
• Summative assessment• O ELA (complete in 2016)
– Math (complete in 2016)– History/ government (complete in 2017)– Science (complete in 2017)
• Formative Tools– Really more like sample items now– Developing capacity for teachers to build test forms using items
pool– In 2016, we can start building true formative, instructionally-
embedded test. • Will include science and H/G
1988 - 2013
Celebrating 25 Years! 64
Things to Consider
• Essay– Covers both ELA and Science or
History/Government standards– Students in grades 4,7, and 11 would only need to
write one essay aligned to both History/government and literacy standards
– Two rubrics provide two scores- one for each test– Same idea for science
1988 - 2013
Celebrating 25 Years! 65
HS Example
Students watch “I have a dream” and read an essay by Malcolm X. They are then asked to write an essay comparing and contrasting the two approaches to the civil rights movement. They may be asked to define and give examples of civil disobedience and discuss its efficacy.
1988 - 2013
Celebrating 25 Years! 66
Writing Standards (G11)
• Write information/explanatory texts, including the narration of historical events, scientific procedures/ experiments, or technical processes.a. Introduce a topic clearly, previewing what is to follow; organize ideas, concepts, and information, using strategies such as definition, classification, comparison/ contrast, and cause/effect; including formatting (e.g., headings), graphics (e.g., charts, tables), and multimedia when useful to aiding comprehension.b. Develop the topic with relevant facts, definitions, concrete details, quotations, or other information and examples.c. Use appropriate transitions to create cohesion and clarify the relationships among ideas and concepts. d. Use precise language and domain-specific vocabulary to inform about or explain the topic.e. Establish and maintain a formal style and objective tone.f. Provide a concluding statement or section that follows from and supports the information and explanation presented.
1988 - 2013
Celebrating 25 Years! 67
Kansas History/Government Standards
• High school: Civil rights, social change• Standard #3: Societies are shaped by beliefs, ideas,
and diversity.– 3.1 The student will recognize and evaluate significant
beliefs, contributions, and ideas of the many diverse peoples and groups and their impact on individuals, communities, states, and nations.
– 3.2 The student will draw conclusions about significant beliefs, contributions, and ideas, analyzing the origins and context under which these competing ideals were reached and the multiple perspectives from which they came.
1988 - 2013
Celebrating 25 Years! 68
Things to consider (1)
• Adaptivity in writing prompt and performance task.– SBAC planned to have writing prompts and
performance tasks written to three different levels of difficulty. The first part of the test would determine which writing prompt/performance task the student received.
– Should we do the same? Would two levels be sufficient?
1988 - 2013
Celebrating 25 Years! 69
Things to consider (2)
• Scoring– With a writing prompt and math performance
task, we will have student responses that need to be scored by hand.
– We would like teachers to be involved in scoring.– What is the best model?
1988 - 2013
Celebrating 25 Years! 70
Scoring Models
• Fully distributed scoring– Teachers score on the computer using KITE. An
independent activity.• School or regional based scoring – Teachers score as a group and enter scores later.
• Scoring center– Only a few teachers come to Lawrence for several
days to score all student papers.
1988 - 2013
Celebrating 25 Years! 71
Things to consider (3)
• Weighting the essay and performance task– What are your thoughts as to how much weight the
essay should have on the ELA score or the math performance task should have on the math test?
• MC items are worth one point each. TE items can be worth up to 3 points each.– Math core is worth 60 points. – ELA core is worth 57-71 points, depending on the
grade.
1988 - 2013
Celebrating 25 Years! 72
Things to consider (4)
• Listening requires headphones and additional caching
• Districts and schools will need to purchase headphones for every student or ask students to bring in their own (think ear buds)
• Streaming audio will put a huge load on the system, so you will need to work with IT to prepare for that in 2014-2015.
• How can KSDE and CETE help you prepare for this load?
1988 - 2013
Celebrating 25 Years! 73
Things to consider (5)
• USED required three: Proficient, one above and one below
• SBAC has four; PARCC has five• Kansas had traditionally used five• Considering four:– Academic warning– Approaching standard– Meeting Standard– Exceeding standard
• Would other levels be useful? Where and Why?1988 - 2013
Celebrating 25 Years! 74
Discussion topics
• Double counting essays• Scoring• Weighting the essay and math performance
task• Streaming audio-bandwidth and caching
issues• Number of performance levels
1988 - 2013
top related