2014 caaspp interpreting and using results

Download 2014 CAASPP Interpreting and Using Results

Post on 31-Dec-2015

41 views

Category:

Documents

0 download

Embed Size (px)

DESCRIPTION

2014 CAASPP Interpreting and Using Results. September 2014 Webcast. Objectives. Workshop participants will be able to: Describe the purposes of CAASPP reports Interpret CAASPP results Explain key statistics Compare and contrast types of reports Identify proper uses of reports. - PowerPoint PPT Presentation

TRANSCRIPT

  • 2014 CAASPPInterpreting and Using Results September 2014Webcast

    2014 Post-Test Workshop*

    ObjectivesWorkshop participants will be able to:Describe the purposes of CAASPP reportsInterpret CAASPP resultsExplain key statisticsCompare and contrast types of reportsIdentify proper uses of reports2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Whats New?Results and Statistical AnalysisUsing ResultsSummary and Internet ReportsData CDsIndividual Student ReportsEarly Assessment ProgramAgenda2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Results are available for only those California Assessment of Student Performance and Progress (CAASPP) content areas administered.Results for the Early Assessment Program (EAP) for students in grade eleven who took these tests are not reported by the CAASPP Program.Percent tested data are not reported for the Standards-based Tests in Spanish (STS).Enrollment datanumber and percentageare not reported for the STS.

    Post-Test Guide (PTG) 23Whats New in 20142014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Since there were no CAASPP end-of-course (EOC) tests administered, there is no Student Master List Summary EOC report.Electronic reporting, formerly Quick-turnaround Reporting, is now offered for all remaining paper-pencil tests. Files have been available since August 8.EAP results are part of electronic reporting.Handscoring of tests is not offered in 2014.

    PTG 23Whats New in 2014

    2014 Post-Test Workshop*

    Report progress toward proficiency on the states academic content standardsNotify where improvement neededTo help students achievementTo improve educational programsResults: Purposes of CAASPP ReportsPTG 42014 Post-Test Workshop*

    2014 Post-Test Workshop*

    State goal: All students score at proficient or above 350 or higher scale scoreCST for Science CMA For Science STS for RLACAPA proficient: 35 or higher scale score

    Results: Performance LevelsPTG 7132014 Post-Test Workshop*

    2014 Post-Test Workshop*

    AdvancedBasic cut scoreCST for Science: 300 CMA for Science: 300STS for RLA: 300CAPA: 30Below basicFar below basicFor each testing program, cut points vary for advanced and below basic by SubjectGrade

    Results: Other Performance Levels2014 Post-Test Workshop*PTG 7 13;Appendix B

    2014 Post-Test Workshop*

    Scale scores allow the same score to mean the same thing across test versions within grade and content area.Scale scores account for differences in difficulty.Scale score ranges by program are:CST for Science, CMA for Science, STS for RLA: 150600 for each grade and subjectCAPA: 1560 for each level and subject

    PTG 7132014 Post-Test Workshop*Results: Scale Scores

    2014 Post-Test Workshop*

    Psychometric procedure Adjusts for test difficulty from year to year (form to form)Additional information in the technical reports on the CDE Technical Reports and Studies Web page at http://www.cde.ca.gov/ta/tg/sr/technicalrpts.aspResults: EquatingPTG 7

    2014 Post-Test Workshop*

    Three to six clusters for each subject.

    May be useful as indicators of individual or group strengths and weaknesses.But. . . reporting clusters should be interpreted with caution.Results: Reporting Clusters (Content Area)PTG 813;Appendix A2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Cluster percent correct available for CSTs for Science, CMA for Science, STS for RLA.Clusters are based on small numbers of items; therefore, may not be reliable or generalized.Clusters are NOT equated from year to year.You should not compare reporting cluster percent correct from year to year.Results: Reporting ClustersCautionsPTG 813;Appendix A2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Compare to percent-correct range of proficient students statewide

    PTG 813;Appendix A2014 Post-Test Workshop*Interpreting Reporting Clusters or Content Areas in the Same Year

    2014 Post-Test Workshop*

    2014 CST Reporting Clusters:Number of Questions and Average Percent CorrectPTG Appendix A*2014 Post-Test Workshop

    2014 Post-Test Workshop*

    ExamplesInterpreting Reporting Clusters for the CST for SciencePTG 92014 Post-Test Workshop*

    2014 Post-Test Workshop*

    For instructional decisions in conjunction with other dataCAPA ELA and mathematics in grade ten used in adequate yearly progress (AYP) calculationsUsing ResultsPTG 2, 42014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Mean scale score Same content and grade, varying yearsPercent in each performance levelSame content by grade across yearsYear-to-Year ComparisonsDo Compare CSTs: Same Grade and Same Content AreaPTG 10132014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Percentage of students scoring at PROFICIENT and aboveFor a given grade and subject, e.g., percent proficient and above for grade 5 science in 2013 and 2014For a given subject and aggregated grades, e.g., percent proficient and above for grades 5, 8, and 10 science in 2013 and 2014Across grades and a subject, e.g., percent proficient and above in all courses and all gradesYear-to-Year ComparisonsDo Compare CSTs: Percent Proficient and AdvancedPTG 10132014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Individual scale scores or statistics based on scale scores for different grades or content areasSubjects by grade are independently scaled Different content standards are measured in different gradesCohorts across gradesAcross testsScale scores to percent correct scores CAPA to years prior to 2009, because of new standard setting that year

    Year-to-Year ComparisonsDont ComparePTG 10132014 Post-Test Workshop*

    2014 Post-Test Workshop*

    ExampleUsing CST Results to Compare Grade Results from Year to YearPTG 10*2014 Post-Test Workshop

    2014 Post-Test Workshop*

    What are they?Student Master List SummarySubgroup SummaryReport emphasis: CSTs for Science Criterion-referenced testsProgress is measured in percent of students scoring proficient and advancedBack of reports provides guide to abbreviations and score codes

    Aggregate (Summary) ReportsPTG 16392014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Tests are as follows:CSTs, CMA for Science: Grades 5, 8, and 10CAPA for ELA and Mathematics: Grades 211; Levels IVCAPA for Science: Grades 5, 8, and 10; Level I, IIIVSTS for RLA: Grades 211 # and % at each performance levelMean scale scoreReporting cluster: Mean percent correct (except CAPA)Student Master List SummaryPTG 1618;PTG 22252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Grade 5 ExampleStudent Master List SummaryPTG 252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Student Master List SummaryBasic StatisticsPTG 2325 2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    For the content area:Number of multiple-choice answer documents submitted minus the number of answer documents marked to indicate that the student enrolled after the first day and was subsequently tested minusDocuments marked as Student enrolled after the first day of testing and was given this testDoes not apply to the STS

    Who Counts? Number EnrolledPTG 2225*2014 Post-Test Workshop

    2014 Post-Test Workshop*

    For the content area, number of students who responded to any questions on the test or whose answer documents were marked to indicate that the student tested but marked no answers (special condition Z). Not included:A = Students absentE = Not tested due to significant medical emergencyP = Parent/guardian exemptionsT = Enrolled first day, not tested, tested at previous schoolStudents with inconsistent gradesNonEnglish learners who took the STSWho Counts? Number TestedPTG 22252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Number Valid ScoresFor the subject, number of students tested at grade level who received a score for the test.Not included:Incomplete testsModified testsNonEnglish learners who took the STSInconsistent gradesPercent Valid ScoresFor the subject, number of valid scores divided by the number of students tested.Who Counts? Number and Percent Valid ScoresPTG 24252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    All tests taken, including those taken with modifications, that result in a score Not included:Incomplete testsNonEnglish learners who took the STSInconsistent gradesWho Counts? Number Tested with ScoresPTG 24252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Student Master List SummaryPerformance LevelsPTG 23252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    All CSTs for Science; CMA for Science; CAPA for ELA, Mathematics, and Science; STS for RLAAdvanced, proficient, basic, below basicAll valid scores falling in the performance level Far below basicAll valid scores falling in the performance level CSTs for Science and STS for RLA taken with modifications in aggregate reportingWho Counts? Performance LevelsPTG 22392014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Average of valid scale scoresCan be used to compare results for the same content/grade across years

    Who Counts? Mean Scale ScoresPTG 24252014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Compare to:Average percent correct range for students statewide who scored proficient on the total test (See the Post-Test Guide, Appendix A.)Student Master List Summary: Reporting ClustersPTG 25*2014 Post-Test Workshop

    2014 Post-Test Workshop*

    Disability statusBased on disability status for CST, CMA, STSCAPA: each disability typeEconomic statusBased on NSLP eligibility or parent education levelGenderEnglish proficiencyEthnicityEthnicity for Economic Status (only for CSTs, CMA, and CAPA)Subgroup Summary:CSTs, CMA, CAPA, and STSPTG 2639 2014 Post-Test Workshop*

    2014 Post-Test Workshop*

    Subgroup Summary:Ethnicity for Economic StatusPTG 392014 Post-Test Workshop*