2014 caaspp interpreting and using results september 2014 webcast

Download 2014 CAASPP Interpreting and Using Results September 2014 Webcast

Post on 18-Dec-2015

212 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

  • Slide 1
  • 2014 CAASPP Interpreting and Using Results September 2014 Webcast
  • Slide 2
  • Objectives Workshop participants will be able to: Describe the purposes of CAASPP reports Interpret CAASPP results Explain key statistics Compare and contrast types of reports Identify proper uses of reports 2014 Post-Test Workshop 2
  • Slide 3
  • Whats New? Results and Statistical Analysis Using Results Summary and Internet Reports Data CDs Individual Student Reports Early Assessment Program Agenda 2014 Post-Test Workshop 3
  • Slide 4
  • Results are available for only those California Assessment of Student Performance and Progress (CAASPP) content areas administered. Results for the Early Assessment Program (EAP) for students in grade eleven who took these tests are not reported by the CAASPP Program. Percent tested data are not reported for the Standards-based Tests in Spanish (STS). Enrollment datanumber and percentageare not reported for the STS. Post-Test Guide (PTG) 23 Whats New in 2014 2014 Post-Test Workshop 4
  • Slide 5
  • 5 Since there were no CAASPP end-of-course (EOC) tests administered, there is no Student Master List Summary EOC report. Electronic reporting, formerly Quick-turnaround Reporting, is now offered for all remaining paper-pencil tests. Files have been available since August 8. EAP results are part of electronic reporting. Handscoring of tests is not offered in 2014. PTG 23 Whats New in 2014
  • Slide 6
  • Report progress toward proficiency on the states academic content standards Notify where improvement needed To help students achievement To improve educational programs Results: Purposes of CAASPP Reports PTG 4 2014 Post-Test Workshop 6
  • Slide 7
  • State goal: All students score at proficient or above 350 or higher scale score CST for Science CMA For Science STS for RLA CAPA proficient: 35 or higher scale score Results: Performance Levels PTG 713 2014 Post-Test Workshop 7
  • Slide 8
  • Advanced Basic cut score CST for Science: 300 CMA for Science: 300 STS for RLA: 300 CAPA: 30 Below basic Far below basic For each testing program, cut points vary for advanced and below basic by Subject Grade Results: Other Performance Levels 2014 Post-Test Workshop 8 PTG 7 13; Appendix B
  • Slide 9
  • Scale scores allow the same score to mean the same thing across test versions within grade and content area. Scale scores account for differences in difficulty. Scale score ranges by program are: CST for Science, CMA for Science, STS for RLA: 150600 for each grade and subject CAPA: 1560 for each level and subject PTG 713 2014 Post-Test Workshop 9 Results: Scale Scores
  • Slide 10
  • 2014 Post-Test Workshop 10 Psychometric procedure Adjusts for test difficulty from year to year (form to form) Additional information in the technical reports on the CDE Technical Reports and Studies Web page at http://www.cde.ca.gov/ta/tg/sr/technicalrpts.asp http://www.cde.ca.gov/ta/tg/sr/technicalrpts.asp Results: Equating PTG 7
  • Slide 11
  • Three to six clusters for each subject. May be useful as indicators of individual or group strengths and weaknesses. But... reporting clusters should be interpreted with caution. Results: Reporting Clusters (Content Area) PTG 813; Appendix A 2014 Post-Test Workshop 11
  • Slide 12
  • Cluster percent correct available for CSTs for Science, CMA for Science, STS for RLA. Clusters are based on small numbers of items; therefore, may not be reliable or generalized. Clusters are NOT equated from year to year. You should not compare reporting cluster percent correct from year to year. Results: Reporting Clusters Cautions PTG 813; Appendix A 2014 Post-Test Workshop 12
  • Slide 13
  • Compare to percent-correct range of proficient students statewide PTG 813; Appendix A 2014 Post-Test Workshop 13 Interpreting Reporting Clusters or Content Areas in the Same Year
  • Slide 14
  • 2014 CST Reporting Clusters: Number of Questions and Average Percent Correct PTG Appendix A 14 2014 Post-Test Workshop
  • Slide 15
  • ExamplesInterpreting Reporting Clusters for the CST for Science PTG 9 2014 Post-Test Workshop 15
  • Slide 16
  • For instructional decisions in conjunction with other data CAPA ELA and mathematics in grade ten used in adequate yearly progress (AYP) calculations Using Results PTG 2, 4 2014 Post-Test Workshop 16
  • Slide 17
  • Mean scale score Same content and grade, varying years Percent in each performance level Same content by grade across years Year-to-Year Comparisons Do Compare CSTs: Same Grade and Same Content Area PTG 1013 2014 Post-Test Workshop 17
  • Slide 18
  • Percentage of students scoring at PROFICIENT and above For a given grade and subject, e.g., percent proficient and above for grade 5 science in 2013 and 2014 For a given subject and aggregated grades, e.g., percent proficient and above for grades 5, 8, and 10 science in 2013 and 2014 Across grades and a subject, e.g., percent proficient and above in all courses and all grades Year-to-Year Comparisons Do Compare CSTs: Percent Proficient and Advanced PTG 1013 2014 Post-Test Workshop 18
  • Slide 19
  • Individual scale scores or statistics based on scale scores for different grades or content areas Subjects by grade are independently scaled Different content standards are measured in different grades Cohorts across grades Across tests Scale scores to percent correct scores CAPA to years prior to 2009, because of new standard setting that year Year-to-Year Comparisons Dont Compare PTG 1013 2014 Post-Test Workshop 19
  • Slide 20
  • 2014 Post-Test Workshop 20 ExampleUsing CST Results to Compare Grade Results from Year to Year PTG 10 20 2014 Post-Test Workshop
  • Slide 21
  • What are they? Student Master List Summary Subgroup Summary Report emphasis: CSTs for Science Criterion-referenced tests Progress is measured in percent of students scoring proficient and advanced Back of reports provides guide to abbreviations and score codes Aggregate (Summary) Reports PTG 1639 2014 Post-Test Workshop 21
  • Slide 22
  • Tests are as follows: CSTs, CMA for Science: Grades 5, 8, and 10 CAPA for ELA and Mathematics: Grades 211; Levels IV CAPA for Science: Grades 5, 8, and 10; Level I, IIIV STS for RLA: Grades 211 # and % at each performance level Mean scale score Reporting cluster: Mean percent correct (except CAPA ) Student Master List Summary PTG 1618; PTG 2225 2014 Post-Test Workshop 22
  • Slide 23
  • Grade 5 Example Student Master List Summary PTG 25 2014 Post-Test Workshop 23
  • Slide 24
  • Student Master List Summary Basic Statistics PTG 2325 2014 Post-Test Workshop 24
  • Slide 25
  • For the content area: Number of multiple-choice answer documents submitted minus the number of answer documents marked to indicate that the student enrolled after the first day and was subsequently tested minus Documents marked as Student enrolled after the first day of testing and was given this test Does not apply to the STS Who Counts? Number Enrolled PTG 2225 25 2014 Post-Test Workshop
  • Slide 26
  • For the content area, number of students who responded to any questions on the test or whose answer documents were marked to indicate that the student tested but marked no answers (special condition Z). Not included: A = Students absent E = Not tested due to significant medical emergency P = Parent/guardian exemptions T = Enrolled first day, not tested, tested at previous school Students with inconsistent grades NonEnglish learners who took the STS Who Counts? Number Tested PTG 2225 2014 Post-Test Workshop 26
  • Slide 27
  • Number Valid Scores For the subject, number of students tested at grade level who received a score for the test. Not included: Incomplete tests Modified tests NonEnglish learners who took the STS Inconsistent grades Percent Valid Scores For the subject, number of valid scores divided by the number of students tested. Who Counts? Number and Percent Valid Scores PTG 2425 2014 Post-Test Workshop 27
  • Slide 28
  • All tests taken, including those taken with modifications, that result in a score Not included: Incomplete tests NonEnglish learners who took the STS Inconsistent grades Who Counts? Number Tested with Scores PTG 2425 2014 Post-Test Workshop 28
  • Slide 29
  • Student Master List Summary Performance Levels PTG 2325 2014 Post-Test Workshop 29
  • Slide 30
  • All CSTs for Science; CMA for Science; CAPA for ELA, Mathematics, and Science; STS for RLA Advanced, proficient, basic, below basic All valid scores falling in the performance level Far below basic All valid scores falling in the performance level CSTs for Science and STS for RLA taken with modifications in aggregate reporting Who Counts? Performance Levels PTG 2239 2014 Post-Test Workshop 30
  • Slide 31
  • Average of valid scale scores Can be used to compare results for the same content/grade across years Who Counts? Mean Scale Scores PTG 2425 2014 Post-Test Workshop 31
  • Slide 32
  • Compare to: Average percent correct range for students statewide who scored proficient on the total test (See the Post-Test Guide, Appendix A.) Student Master List Summary: Reporting Clusters PTG 25 32 20

Recommended

View more >