department of education professional education unit assessment system september 2008
DESCRIPTION
Department of Education Professional Education Unit Assessment System September 2008. Today’s Agenda. What is the Professional Education Unit Assessment System? Samples of Data Questions, Comments, Discussion. CONTINUOUS ASSESSMENT SYSTEM: Program and Unit Operations. - PowerPoint PPT PresentationTRANSCRIPT
Department of EducationProfessional Education Unit
Assessment SystemSeptember 2008
Today’s Agenda
• What is the Professional Education Unit Assessment System?
• Samples of Data• Questions, Comments, Discussion
CONTINUOUS ASSESSMENT SYSTEM: Program and Unit Operations
Program Unit
Internal Assessments
Candidate Performance
•Knowledge
•Skills
•Dispositions
Enrollment Data
Budget Data
Faculty Productivity
Resources
Facilities
External Assessments
Candidate Performance
•Knowledge
•Skills
•Dispositions
Alumni FeedbackEmployer FeedbackMentor Teacher Internship EvaluationsTitle II ReportsAccrediting Agencies
Internal AssessmentsProgram Level
Assessment of KnowledgeGPA and Content Major GradesProfessional Portfolio Internship EvaluationPracticum Evaluation (graduate)Comprehensive Exams (graduate level)Action Research Paper (graduate level)
Assessment of SkillsProfessional PortfolioInternship EvaluationPracticum Evaluation (graduate)
Assessment of Dispositions Dispositions and Diversity Inventory (DDI)Internship EvaluationPracticum Evaluation (graduate)
External AssessmentsProgram Level
Assessment of KnowledgePRAXIS I/SAT/ACT/GREPRAXIS IIProfessional Portfolio Internship Evaluation Practicum Evaluation (graduate)
Assessment of SkillsField Experience/Pre-Internship EvaluationsProfessional Portfolio Internship Evaluation Practicum Evaluation (graduate)
Assessment of Dispositions Field Experience/Pre-Internship EvaluationsDispositions and Diversity Inventory (DDI) Internship Evaluation Practicum Evaluation (graduate) Specialized Professional Association Reports (SPA Reports)
Internal Evaluations: Unit
Enrollment/Resources Data
Admission to PEU
Enrollment Data
Degrees Awarded
Recruitment/Retention Data
Diversity of Candidates
Retention Rates
Faculty Data
Characteristics
Diversity of Faculty
Faculty Productivity
Evaluation of Faculty Instructionby Candidates
Faculty Self-Evaluation
Faculty Peer Evaluations
Evaluation of Faculty by Chair
UMES Annual Report
Strategic Plan and Evaluations
Budget Data
Candidate Appeals/Resolution
Candidate Exit Evaluation of Unit
Facilities
Resources
Student Learning Outcomes Assessment Report (SLOAR)
Grant Reports
External Evaluations: Unit
Alumni Feedback
Employer Survey
Title II ReportTeacher Preparation Improvement Program (TPIP Report)
National Council for the Accreditation of Teacher Education (NCATE: Part C)
Management for Results (MFR)
USM External Reports
MSDE Teacher Staffing Report
Professional Education Data System (PEDS) Report (AACTE)
Accrediting Agencies
- Maryland State Department of Education
- Middle States
- NCATE
Advisory Board
PDS Evaluation
PDS Summer Institute Evaluations
Key Assessments
• Field Experience/Pre-Internship Evaluations• Internship/Practicum Evaluations• Dispositions and Diversity Inventory• Professional Portfolio Evaluations• Mentor Teacher Evaluation• University Supervisor Evaluation• Exit Survey• Alumni Survey• Employer Survey
Field Experience/Pre-Internship Evaluations
• Different Levels– Pre-candidates– Methods candidates– Pre-Internship candidates
• Task Lists
Field Experience/Pre-Internship Evaluation Results Spring 2008 Overall Average 3.65
Demonstrates working knowledge of the subject being taught. (Reflective, Effective/Knowledge, Skills, Dispositions) 3.54
Demonstrates initiative by identifying tasks that need to be done and by completing them. (Professional, Innovative, Effective/Dispositions)
3.54
Interacts well with all types of students. (Professional, Reflective, Diversity/ Knowledge, Skills, Dispositions) 3.84
Field Experiences:How You Can Help Us
• Candidates come with Task Sheetsbut often are not able to complete thetasks.
• Too many “Not Observed” scores• Suggestions of reasonable tasks at each
level.• Suggestions of items for the revised
evaluation form.
Internship Evaluation
4 Exceptional/OutstandingThe teacher intern demonstrates thorough understanding of the concepts within the component and skill implementation well beyond what is expected of a student intern. Students within their classroom appear to be highly motivated and involved in their own learning.
3 Competent/Proficient The teacher intern demonstrates good understanding of the concepts within the component and is able to implement them on a regular basis. Students within their classroom appear to be active and involved in the learning process.
2 Beginning/BasicThe teacher intern demonstrates beginning understanding of the concepts within the component and is intermittently successful in implementing them. The intern still needs guidance and practice in this area.
1 UnsatisfactoryThe teacher intern demonstrates little or no understanding of the concepts within the component. The intern needs a great deal of guidance and practice in this area.
Not Observed (NO)Write NO if you have not yet had the opportunity to observe the particular behavior indicated.
Not Applicable (NA)Write NA if this behavior does not apply to this experience.
Internship Evaluation
• Interstate New Teachers Assessment and Support Consortium (INTASC) Principles
• Conceptual Framework (PRIDE)
• National Council for the Accreditation of Teacher Education (NCATE) Standards
Internship Evaluation DataFall 2007/Spring 2008
Professional
3
3.1
3.2
3.3
3.4
3.5
3.6
3.7
3.8
1stExper
2ndExper
1stExper
2ndExper
Mentor Teacher
University Supervisor
Internship Evaluation DataFall 2007/Spring 2008
Reflective
3.1
3.2
3.3
3.4
3.5
3.6
3.7
3.8
3.9
1stExper
2ndExper
1stExper
2ndExper
Mentor Teacher
University Supervisor
Internship Evaluation DataFall 2007/Spring 2008
Innovative
3
3.1
3.2
3.3
3.4
3.5
3.6
3.7
3.8
1stExper
2ndExper
1stExper
2ndExper
Mentor Teacher
University Supervisor
Internship Evaluation DataFall 2007/Spring 2008
value Diversity
3
3.1
3.2
3.3
3.4
3.5
3.6
3.7
3.8
3.9
1stExper
2ndExper
1stExper
2ndExper
Mentor Teacher
University Supervisor
Internship Evaluation DataFall 2007/Spring 2008
Effective
3
3.1
3.2
3.3
3.4
3.5
3.6
3.7
3.8
1stExper
2ndExper
1stExper
2ndExper
Mentor Teacher
University Supervisor
Internship Evaluations:How You Can Help Us
• Write comments to support your evaluation if you are scoring exceptionally high or low. We need the feedback in order to make changes.
• Plan time to talk with the Mentor Teacher and the intern in a three-way conference.
• Complete evaluations in a timely manner!
Dispositions and Diversity InventoryMentor Teacher Evaluations
• Attendance• Punctuality • Professional Appearance• Professional Demeanor• Task Completion• Initiative• Fairness/Lack of Bias • Effective Oral
Communication
• Effective Written
Communication• Effective Interpersonal
Communication• Legal/Ethical Conduct• Social Justice• Commitment to
Professional Development
• Commitment to Improving Professional Performance
Dispositions and Diversity InventoryMentor Teacher Evaluations
Spring 2008 (N = 5; 31% Response Rate)
0
10
20
30
40
50
60
70
80
90
100
Attendance Punctuality ProfessionalAppearance
Target
Developing
Unsatisfactory
Professional Portfolio
•Content Knowledge•Characteristics of Learners•Learner Diversity•Instructional Strategies•Learning Environment
•Communication•Planning for Instruction•Assessment•Impact on Student
Learning•Reflective Practice•Community
Portfolio Scoring System
• Target
• Acceptable
• Unacceptable or Missing
University Faculty and PDS Partners collaboratively evaluate candidate portfolios for triangulated data.
Portfolio Artifacts
• Internship Evaluations• Action Research Paper• Reflection Papers• Lesson/Unit Plans• Classroom Management Plan• Diversity Plan• Teaching Video with Self-Reflections• Assessment Plan• Evidence of Impact on Student Learning• Teacher-Made Assessments• Philosophy of Education
Intern Evaluation of Mentor Teacher
1. My mentor teacher made me feel welcome in the classroom.
2. My mentor teacher explained to me in detail what was expected of me.
3. My mentor teacher took time each day to discuss my progress.
4. My mentor teacher modeled reflective thinking about his/her own teaching.
5. My mentor teacher modeled the behaviors he/she wanted me to perform.
6. My mentor teacher was understanding when I made mistakes or lessons didn't turn out just right.
Evaluation of Mentor Teacher
7. My mentor teacher and I maintained good communication throughout the experience.
8. My mentor teacher modeled innovative instructional techniques. 9. My mentor teacher demonstrated through his/her behaviors that
he/she valued diversity in the classroom. 10. I consider my mentor teacher to be an effective teacher in terms of
classroom management. 11. My mentor teacher acted in a professional manner at all times. I
am pleased with the experience I encountered with this cooperating teacher.
12. I would recommend this teacher as a future mentor teacher for other students. I consider my mentor teacher to be an effective teacher in terms of instruction.
Evaluation of Mentor Teacher Spring 2008 Data Sample
SA/AExper. 1
SD/D Exper. 1
SA/AExper. 2
SD/DExper. 2
I consider my mentor teacher to be an effective teacher in terms of classroom management.
53% 40% 82% 18%
My mentor teacher and I maintained good communication throughout the experience.
60% 40% 76% 18%
My mentor teacher made me feel welcome in the classroom.
74% 27% 82% 18%
I would recommend this teacher as a future mentor teacher for other students.
47% 40% 69% 18%
Intern Evaluation of University Supervisor
1. My university supervisor observed me a minimum of three times during each experience.
2. My university supervisor explained to me in detail what was expected of me.
3. My university supervisor had an initial conference with me and my cooperating teacher (prior to the three observations) to set out expectations and responsibilities.
4. My university supervisor took time each visitation to discuss my progress with me.
5. My university supervisor observed a complete teaching lesson each time he/she came.
Intern Evaluation of University Supervisor
6. I felt that I could talk with my university supervisor about any problems I might be encountering.
7. My university supervisor and cooperating teacher discussed my progress with me each visitation in a three-way conference.
8. My university supervisor and I maintained good communication throughout the experience.
9. My university supervisor offered me appropriate suggestions.
10.My university supervisor acted in a professional manner at all times.
11.I am pleased with the experience I encountered with this university supervisor.
Intern Evaluation of University Supervisor
12. My university supervisor provided me with a formal midterm evaluation.
13. My university supervisor provided me with a formal final evaluation.
14. My university supervisor helped me understand the PDS Collaboration Model.
15. My university supervisor helped me understand the role and responsibilities of my cooperating teacher.
16. I would recommend this person as a university supervisor for other students.
17. Other Comments:
Evaluation of University Supervisor Spring 2008 Data Sample
SA/AExper. 1
D/SDExper. 1
SA/AExper. 2
D/SDExper. 2
My university supervisor explained to me in detail what was expected of me. 82% 13% 100%
I am pleased with the experience I encountered with this university supervisor.
81% 6% 100%
My university supervisor helped me understand the PDS Collaboration Model. 87% 13%
Undecided88% 12%
I would recommend this person as a university supervisor for other students.
81% 12% 100%
Professional Education Alumni SurveySpring 2008 Results
5 point scale
5-Strongly Agree
4= Agree
3= Undecided
2 = Disagree
1 = Strongly Disagree
Professional 3.48
Reflective 4.20
Innovative 4.35
value Diversity 4.47
Effective 4.40
Value of Course Work 4.26
Program Met Expectations 2.62 (out of 3 points)
Quality of Professional Education Courses
2.58 (out of 3 points)
Likelihood of recommending program to friends
2.74 (out of 3 points)
Professional Education Employer SurveyCounselor Education (N = 4)
Spring 2008 Results3 point scale
Disagree
Professional 2.57
Reflective 2.35
Innovative 2.14
value Diversity 2.71
Effective 2.38
Research and Best Practice 2.36
Content and Counseling 2.57
5-Strongly Agree
4= Agree
3= Undecided
2 = Disagree
1 = Strongly Disagree
Professional 2.72
Reflective 2.58
Innovative 2.55
value Diversity 2.87
Effective 2.62
Research and Best Practice 2.65
Content and Pedagogy 2.61
Professional Education Employer SurveyTeacher Education (N = 12)
Spring 2008 Results3 point scale
Questions, Comments, Discussion