connect with ncate: on twitter: @ncate on facebook: facebook.com/ncate.org elizabeth vilky...

Connect with NCATE:on Twitter: @ncateon Facebook: facebook.com/ncate.org

Elizabeth VilkyAccreditation Associate

The IRA/NCATE Program Review

ProcessChicago, Illinois

April 29, 2012



• Unit = School, College, or Department of Education plus other entities on campus

• Program = Specific Discipline Area• Candidate = pre-service teachers• Students = K-12 students• SPA = Specialized Professional Association; there are now 20 organizations that collaborate with NCATE to review programs



• Institutional Report—submitted by the unit to demonstrate that the unit meets the 6 NCATE Unit standards

• Program Report—submitted by programs to demonstrate that the programs meets the NCATE/SPA standards.

• Recognition Report—the report you receive back from NCATE and the SPAs



• National Program Review by SPA (i.e. IRA, AMLE, ALA/AASL,TESOL, CEC, ACTFL, etc)

• State Program Review

• Review by another accrediting body (For example, NASM accreditation of a university’s College of Music)



• Whether institutions submit programs to a SPA (AMLE) or to the state for review depends on the NCATE/State Partnership

• Some states require SPA review while some require state review. Others allow the institution to choose.



SPA Program Review State Program Review

Alaska, Arizona, Arkansas, Colorado, Connecticut, Delaware, DC, Hawaii, Illinois, Indiana, Iowa, Louisiana, Maryland, Massachusetts, Michigan, Mississippi, Nevada, New Hampshire, New Jersey, New York, Ohio, Oklahoma, Pennsylvania, Puerto Rico, Rhode Island, South Carolina, Texas, Utah, Vermont, West Virginia, Wyoming

Alabama, California, Florida, Georgia, Idaho, Kansas, Kentucky, Maine, Minnesota, Missouri, Montana, Nebraska, New Mexico, North Carolina, North Dakota, Oregon, South Dakota, Tennessee, Virginia, Washington, Wisconsin

Some of these states allow institutions to substitute SPA review for state review.



• Determine whether or not the program has in place comprehensive assessments that demonstrate candidate mastery of the IRA standards.

• Candidate performance on these assessments is appropriate to demonstrate mastery.

• Provide information for unit to use to respond to Unit Standard 1.

• National Recognition



Unit Program

Standards NCATE SPA-IRA

Reviewed by Board of Examiners

Program Reviewers

(or state)

Process On-site Electronic

Decision Accreditation Recognition

Final Decision-Maker

Unit Accreditation Board

Audit Team/Program Reviewers



• The program decisions factor into Standard 1, which says: “Candidates preparing to work in schools as teachers or other school personnel know and demonstrate the content knowledge, pedagogical content knowledge and skills, pedagogical and professional knowledge and skills, and professional dispositions necessary to help all students learn. Assessments indicate that candidates meet professional, state, and institutional standards.”



Spring Cycle Fall Cycle

Institution Submits Program Report

March 15 September 15

Review Period April 15-June 1 October 15-November 15

IRA Audit Team Review

June 1-July 1 November 15-January 1

NCATE Staff Review

July 1-August 1 January 1-February 1

Final Recognition Report to Institution

August 1 February 1



Semester of NCATE Visit to the Institution Program Reports Due Date Recognition Report Due

Back to Institution

Spring 2012 March 15, 2011 August 1, 2011

Fall 2012 September 15, 2010; March 15, 2011

February 1, 2011;August 1, 2011

Spring 2013 March 15, 2011 August 1, 2011

Fall 2013 September 15, 2011 February 1, 2012

Fall 2016 September 15, 2013 February 1, 2014



• Nationally recognized

• Nationally recognized with conditions (if this is the decision, the conditions must be specified, and must relate to the standards; programs have 18 months to address conditions)

• Further Development Required/Recognized with Probation (program has 12-14 months to submit a revised report)

• Not nationally recognized (for programs that have submitted a total of three times and have not managed to move to recognized with conditions or nationally recognized)



Options for Program Review



• Option A

• Option B

• Option C

• Option D

• IL/PB



Option A- Current Process

• Current process: the program selects 6 to 8 key assessments required of all candidates.

• Institution must submit a minimum of six assessments, unless the SPA specifies more than six required assessments

• Institution may submit additional assessments when SPA does not specify all eight assessments

• Five specific types of assessments are required by all SPAs



Required Assessments in National Program Review-Option A

1. State licensure exam for content2. Assessment of content knowledge3. Assessment of Planning (e.g., lesson

plan or unit plan)4. Student teaching/internship

assessment5. Assessment of candidate impact on

student learning or providing a supportive learning environment

6. Other assessment



Option B

• Allows institutions to choose all of their own assessments (with some constraints)– No more than 8 assessments.– Must submit state test data-Assessment 1– Must demonstrate content, pedagogical content knowledge and skills, and impact on student learning

– Must have assessment of candidate impact on student learning or for non- teaching programs, candidate impact on providing a supportive learning environment-Assessment 2

– Must meet SPA standards



Option C-Continuing Recognition

• Designed to reduce the documentation requirements for programs already nationally recognized.

• Can be used by programs that were previously nationally recognized using the 6 to 8 key assessment model (started process in Fall 04) and whose standards have not changed since the last submission.

• Must submit current data on all assessments.

• Focus on Section V—self study and continuous improvement



Option D

• A program can conduct validity and reliability studies of its assessments in lieu of other program report evidence requirements – Must seek permission from NCATE before pursuing this option



IL/PB

• Option IL/PB: Initial Licensure/Post-Bacc– For “MAT-like” programs for secondary level licensure in all or some of the five secondary content areas – foreign language (ACTFL), social studies (NCSS), English (NCTE), mathematics (NCTM), & science (NSTA)

– Leads to National Recognition by NCATE, not the individual SPAs

– Reviewed by SPA Coordinators at this point



Guidelines



• Data Requirements:– Minimum data required is data resulting from two applications of the assessments

– For resubmissions (Response to Conditions or Revised Reports), data from one application new/revised assessments is required

– A program is eligible to receive National Recognition with Conditions even if there are no data available yet

Data Rule



For units undergoing accreditation for the first time, programs are expected to be able to include in their program reports at least one year of data on all assessments in order to be eligible for full national recognition. They will be expected to have two years of data at the time of their unit visit.

The following question was added to program reports:

Data Rule



Enrollment Programs

Low-Enrollment Programs:•The option to defer low-enrollment programs (defined as 5 or fewer completers in a program in the last 3 years combined) will continue until we transition into CAEP. •At that time, we will determine if the new option, CAEP Program Review with Feedback, will meet the needs for review of low-enrollment programs.•Programs are NOT required to defer program review due to low enrollment.



Timeliness Rates

Program reports have been consistently available to institutions on time (Feb. 1 or Aug. 1) for the past 5 years…

Cycle % on time Cycle % on time

Fall 2011 99.7% (931/934) Spring 2009 98%

Spring 2011 98% Fall 2008 98%

Fall 2010 98% Spring 2008 95%

Spring 2010 99% Fall 2007 95%

Fall 2009 98% Spring 2007 95%



Recognition Rates

Initial Reports:

Cycle R + C* (# of reports)

Total # of Reports % of Total R + C*

Fall 2011 344 510 67.5%

Spring 2011 436 593 73.5%

Fall 2010 371 517 71.8%

Spring 2010 223 319 69.9%

Fall 2009 226 307 73.6%

* R = Nationally Recognized; C = Recognized with Conditions



Recognition Rates

Revised & Response to Conditions Reports:

Cycle R + C* (# of reports)

Total # of Reports % of Total R + C*

Fall 2011 360 412 87.4%

Spring 2011 399 422 94.5%

Fall 2010 268 314 85.4%

Spring 2010 361 387 93.3%

Fall 2009 420 454 92.5%

* R = Nationally Recognized; C = Recognized with Conditions



Resources on NCATE web site

• www.ncate.org, Accreditation, Program Review – Assessment Library

• 250+ assessments approved by the SPAs– Program Report Forms– Guidelines, Instructions – Examples of Reports

• Multiple examples of reports fully approved on first submission

– Archived Web Seminars for Institutions and Program Reviewers

– Mini-videos on how to use PRS



Moving To CAEP



CAEP Information

• October 22, 2010 was a historic day for educator preparation.

• The NCATE and TEAC governing boards voted unanimously to create a single accrediting body for educator preparation.

• CAEP-Council for the Accreditation of Educator Preparation

• NCATE and TEAC will continue, but will begin to merge activities.

• It is expected that by January 2013, CAEP will be fully active and NCATE and TEAC will sunset.



NCATE Contacts

For questions related to overall process, submission requirements, etc.

• Monique Lynch, [email protected]• Elizabeth Vilky, [email protected]• Sabata Morris, [email protected]• Danielle Peyton, [email protected]

• Technical problems:Frank Huang, [email protected] Jones, [email protected]



IRA Contact

• For questions related to the standards and what are appropriate assessments:

• Diane [email protected]



Questions

connect with ncate: on twitter: @ncate on facebook: facebook.com/ncate.org elizabeth vilky...

Documents

state program review

ncate staff reviewjuly

spa review

state review

institution program

nasm accreditation

campus program

probation program