ensuring equitable access to excellent educators
TRANSCRIPT
ENSURING EQUITABLE ACCESS
TO EXCELLENT EDUCATORS
Understanding theData Files
December 9, 2014
BACKGROUND
1. Guidance: Frequently Asked QuestionsWebinar: November 17, 2014
2. Educator Equity Profiles (2011-12 data)a.Compare teacher characteristics in high & low poverty and in high & low minority schools b.Statewide analysisc.Deeper look at districts and locales that drive statewide gapsWebinar: December 2, 2014
3. Data files 1.Data limited to sources available to the Department 2.Includes data underlying Educator Equity Profiles, plus moreThis webinar (December 9, 2014)
RESOURCES SHARED WITH STATES
3
STATE PLANS
State Plans to Ensure Equitable Access to Excellent Educators are due June 1, 2015
SEAs creating State Plans will use data to:• Define key terms• Identify equity gaps• Inform a root cause analysis, explaining why
equity gaps exist• Monitor and publicly report on progress in
eliminating gaps
ROLE OF DATA ANALYSIS
4
Using Data to Develop State Plans
IDENTIFY POTENTIAL DATA SOURCESQUESTIONS TO CONSIDER
Which data to use? • SEA should use most recent available data • Department will not require a particular data source;
use of the data file sent to SEAs in November is entirely optional
• The Department has several potentially useful data sources: – EDFacts - Annual data submitted by States – Civil Rights Data Collection - Biennial data submitted by LEAs– Common Core of Data - Detailed demographic data
Can data sources be merged across systems? What are the challenges to do so? How would this impact results?
Who has access to the data? Who will be assembling the data? Who will be running analyses? 6
DEFINE KEY TERMSLIST OF TERMS
Key Terms to be defined in State Plans• Inexperienced teacher
– The Department encourages an SEA to define as teachers who are in their first year of practice because research demonstrates that the greatest increase in educator effectiveness occurs after one year on the job.
• Unqualified teacher – SEAs may choose to define as teachers who have been rated
ineffective by educator evaluation and support systems.
• Out-of-field teacher• Minority Student• Poor student• Any other key terms used by the SEA such as
“excellent educator,” “effective educator,” or “highly effective educator.”
7
DEFINE KEY TERMSSTUDENTS FROM LOW INCOME FAMILIES
Identifying students from low-income families• Community Eligibility Provision may reduce utility of
Free and Reduced Price Lunch (FRPL) data as poverty indicator
• Consider whether there are better measures, possibly including:– Children ages 5-17 in poverty;– Children in families receiving assistance under the TANF
program; or– Children eligible to receive medical assistance under the
Medicaid program.
8
DEFINE KEY TERMSQUESTIONS TO CONSIDER
Which additional metrics or indictors of educator quality – beyond those required key terms – are important?• SEA may also choose to consider, for instance, access
to teachers rated as highly effective; teacher turnover rates; or principal quality.
• These terms also need to be defined, if used.
Are there other student subgroups that are important to include in your State Plan? Students with disabilities? English Learners?• These terms also need to be defined, if used.
9
IDENTIFY EQUITY GAPS
Equity Gap:
The difference between the rate at which low-income students or students of color are taught by excellent educators and the rate at which their peers are taught by excellent educators.
Note: The Department recognizes that not all SEAs will have access to student-level data; an SEA may choose to use school-level data to identify the relevant equity gaps.
Example: – The proportion of first year teachers in our highest poverty
quartile schools is X percentage points higher than in our lowest poverty quartile schools.
10
IDENTIFY EQUITY GAPSQUESTIONS TO CONSIDER
What is the level of observation?• What analyses are possible with student-level data
that are not possible with school-level data, and what student-level data are available?
What is the level of analysis? How will the analysis aggregate data?
• Within schools?• Across schools/within districts?• Across districts?
11
CONDUCT A ROOT CAUSE ANALYSISQUESTIONS TO CONSIDER
Root Cause Analysis:• A process of determining and explaining the
underlying causes of equity gaps
Consider how quantitative data can be used to develop and refine hypotheses
Example:• Data analysis suggests two possible root causes: high
rates of principal turnover in high poverty schools and lower teacher salaries in high poverty schools
• Stakeholder engagement provides additional information: teachers report the lack of stable, high quality school leadership is the primary reason teachers leave
• Further data analysis suggests that principal turnover is worst in high poverty schools in rural areas
12
MONITOR AND REPORT PROGRESSQUESTIONS TO CONSIDER
What are long-term goals for eliminating equity gaps?
What are annual targets toward meeting those goals?
How will you visualize and present data to measure progress over time?
Example:• Monitor and report progress on all indicators for high
and low poverty schools– Percent of first year teachers (equity gap in question)– Principal turnover rates (root cause / leading indicator)– Teacher salary (root cause / leading indicator)
13
About the Data Files
DATA FILES: OVERVIEW
Convenience• This data files merge a variety of sources of data and may
be useful as you define key terms, identify equity gaps, conduct a root cause analysis, and plan for progress monitoring and reporting.
• Use of this data file is optional.• Some SEAs will rely on this data, others will have better
data.
Transparency• Gives SEAs access to data underlying Educator Equity
Profiles – including CRDC data which many SEAs do not otherwise have.
• Opportunity to identify discrepancies in data reported to SEAs and to Department, and to work with LEAs to address.
• Allows SEAs to run additional analyses to inform State Plans by using, for example, different definitions of “minority.”
WHY THE DEPARTMENT CREATED AND SHARED THE FILES
15
DATA AND DOCUMENTATION
Data (state-specific)• Includes all elements used to create the Educator
Equity Profiles, plus all 2011-12 CRDC data.
Data Overview• Review the data overview document to learn more
about the data sources and documentation for those sources
Data Codebook• Review the codebook to identify the data elements of
interest– Use the “variable category” column to filter based on the
different categories of variables– Use the CRDC question code field to link back to the CRDC
table layout document (referenced in the data overview document)
DATA RESOURCES SENT TO STATES
16
DATA SOURCES AND ELEMENTSEDUCATOR EQUITY PROFILES DATA
School Identifiers•CCD and CRDC school IDs•LEA ID•State IDs•Source
Comparable Wage Index(CWI)•LEA-level CWI•State-level CWI
Common Core of Data(CCD)•Enrollment overall •Enrollment by race/ethnicity•Free/Reduced price lunch eligibility•School urbanicity•School type•School operating status
EDFacts•Elementary classes taught by Highly Qualified Teachers•Secondary classes taught by Highly Qualified Teachers
Civil Rights Data Collection(CRDC)•Teacher Experience•Teacher Absenteeism•Teacher Certification •Teacher Salary
17
DATA SOURCES AND ELEMENTS2011–12 CIVIL RIGHTS DATA COLLECTION
Enrollment & School Characteristics•Overall Enrollment•Prekindergarten•IDEA and Section 504•Interscholastic Athletics•Single Sex ClassesCollege & Career Readiness•Geometry: courses & enrollment•Algebra II: courses & enrollment•Other Advanced Mathematics: courses & enrollment•Calculus: courses & enrollment•Biology: courses & enrollment•Chemistry: courses & enrollment•Physics: courses & enrollment•AP: Courses, Test-taking, and Test-Passing•IB Enrollment•SAT/ACT*
Staffing & Resources•Teacher Experience•Teacher Absenteeism•Teacher Certification •School Counselors•School-level Expenditures
Pathways to College & Career•Early Childhood Education•Gifted & Talented•Algebra I Enrollment and Passing by grade 7 or 8, 9 or 10, and 11 or 12•Student Retention by grade
Discipline, Bullying & Harassment, Restraint & Seclusion•Corporal punishment•Suspensions: in-school and out-of-school •Expulsions: with & without ed. services, zero tolerance•Referrals to law enforcement & school-related arrests•Students subjected to and instances of mechanical restraint, physical restraint, and seclusion•Bullying and harassment on the basis of sex, national origin, and disability 18
FILE LAYOUT
Data File
Data Codebook
19
UNIVERSE OF SCHOOLS
The data file includes all schools that were either in the CCD or in the CRDC. The universe of schools required to report is different across these data collections. All schools in the file have either a value in the combokey (CRDC ID) field or the ncessch (NCES ID) field.• Most schools have a value in both fields, and they are the
same• Some charter schools have unique CRDC LEA IDs, even
though they match to an NCES ID• Some schools in CRDC match to more than one NCES school
– For these CRDC schools, the value in the ncessch_crdc field specifies the school’s matching NCES ID
20
SCHOOL IDENTIFICATION NUMBERS
DATA DETAILS
The elements that were reported directly to the Department are:• Elementary classes: hq381, nhq381, total381• Secondary classes: hq383, nhq383, total383
The file also contains three “derived” values (hq, nhq, and hqtotal), which are simple sums of the respective elementary and secondary class counts
21
EDFACTS
DATA DETAILS
Following FERPA guidelines, CRDC data are rounded to protect the privacy of individual student data• Student counts are rounded to the mid point in groups
of three. For example: i. 1, 2, 3 Rounded to 2ii. 4, 5, 6 Rounded to 5iii.7, 8, 9 Rounded to 8
• This privacy protection method may inflate total counts for CRDC data elements in which there are prevalent cases of schools reporting only one student (e.g., one student retained is rounded to two students retained).
22
CIVIL RIGHTS DATA COLLECTION – PRIVACY PROTECTION
DATA DETAILS
23
COMPARABLE WAGE INDEX
Additional Resources
HELP WITH STATE PLANS
Equitable Access Support Network • Convenings, webinars, and State-specific supports,
including voluntary review of draft plans• Communities of Practice (coming soon)
– A Communities360⁰ website which will include a clearinghouse of relevant resources, tools, and research
Center on Great Teachers and Leaders• Equitable Access Toolkit (Stakeholder engagement guide,
data analysis tool, root cause workbook, sample plan)• [email protected]
AVAILABLE RESOURCES FOR CONDUCTING DATA-BASED ANALYSES
25
HELP US HELP YOU
• What support do you need to understand the data Department data files?
• What support do you need accessing the data? Do you know what systems the data are in? What questions do you have? What challenges does your state have?
• What additional resources or tools do you need? • What types of technical assistance will be most
useful for you?
Please type into the chatbox and send a private message to the host.
IDENTIFY THE SUPPORTS THAT ARE NEEDED
26
