© tntp 2013 videographer orientation assessment and evaluation, nte october 2014

© TNTP 2013

Videographer OrientationAssessment and Evaluation, NTE

October 2014

/ 2

Videographers will be able to:

• Articulate the purpose of Extension Plan and TNTP Instructional Feedback Project video observations

• Describe the workflow for each observation round

• Understand how and when to report to the Central Manager

• Describe the qualities of a good video observation

• Articulate next steps for starting video observations

Objectives

/ 3

Agenda

Overview of the Assessment of Classroom Effectiveness (ACE)

Video Observation Windows

Video Observation Workflow

Uploading to BloomBoard

Scheduling Video Observations

BREAK

Reporting In

Technology

Time Tracking

Next Steps

Questions

/ 4

The Assessment of Classroom Effectiveness – also known as ACE – is a multiple-measure evaluation system for first- and second-year teachers enrolled in TNTP Academy.

Classroom Observations – 4 per year

Student Surveys – for grades 3-12

Principal Surveys – benchmark against other novice teachers

Value-Added Data – where available

Participants have three outcomes at the end of their first year – Pass,

Fail, or Extend.

Extended participants return to the classroom and are evaluated again

at the end of their second year.

/ 5

Teacher performance on each ACE measure will be mapped to the performance scale below, earning between 1 and 5 points for each ACE component.

Each component will be weighted and combined to calculate the final ACE rating.

ClassroomObservations

Principal Ratings

Student Surveys

Student Achievement

Ineffective1.00 – 1.99

points

Much worse than

1 point

2.99 or lower1 point

Ineffective1 point

Minimally Effective

2.00 – 2.79 points

Worse than2 points

3.00 – 3.492 points

Minimally Effective2 points

Developing2.80 – 3.59

pointsSame as3 points

3.50 – 3.993 points

Developing3 points

Proficient3.60 – 4.29

pointsBetter than

4 points4.00 – 4.49

4 pointsProficient4 points

Skillful4.30 – 5.00

points

Much better than

5 points

4.50 – 5.005 points

Skillful5 points

/ 6

While ACE considers multiple measures, those measures carry different weights toward the final ACE score.

Scenario 1:Classroom

Observations

Principal Rating


Observations

Principal Rating

Student Surveys


Observations

Principal Rating

Student Surveys

Student Achievement

Data

The weights for each ACE measure will vary, depending on the total number of measures

available given the specific teaching placement.


Observations

Principal Rating

Student Achievement

Data

/ 7

Adding it up: Four Scoring Scenarios

Scenario 1: Classroom Observations + Principal Ratings

Observations

(60%)

PrincipalRating(40%)

0.60 * 3.15 points = 1.89 points (Observations)+ 0.40 * 4 points = 1.60 points (Principal Rating)

3.49 points ( Final ACE Score)

Scenario 2: Classroom Observations + Principal Ratings + Student Surveys

Student

Surveys

(30%)

Observations

(40%) PrincipalRating(30%)

0.40 * 3.15 points = 1.26 points (Classroom Observations)+ 0.30 * 3 points = 0.90 points (Principal Rating)+ 0.30 * 2 points = 0.60 points (Student Surveys)


/ 8

Adding it up: Four Scoring Scenarios, cont’d

0.25 * 3.15 points = 0.79 points (Observations)+ 0.20 * 3 points = 0.60 points (Principal Rating)+ 0.20 * 2 points = 0.40 points (Student Surveys)+ 0.35 * 4 points = 1.45 points (Achievement)


StudentAchievem

ent(35%) Principal

Rating(20%)

Observations

(25%)

Student

Surveys

(20%)

Scenario 3: Classroom Observations + Principal Ratings + Student

Surveys + Student Achievement Data

Scenario 4: Classroom Observations + Principal Ratings + Student

Achievement Data

Observations

(35%)

StudentAchievem

ent(35%)

Principal Rating(30%)

0.35 * 3.15 points = 1.10 points (Observations) + 0.35 * 4 points = 1.40 points (Student Achievement) + 0.30 * 3 points = 0.90 points (Principal Rating)


/ 9

TNTP Instructional Feedback Project vs. Extension Plan Observations

TNTP Instructional Feedback Project

Extension Plan

• Teachers in this project successfully passed ACE last year and are participating in this study solely for feedback – not evaluation.

• They receive a monetary incentive.

• They can opt out of the study at any time.

• Teachers on an extension plan fell short of passing ACE last year but demonstrated potential to become great teachers. They are teaching again this year and will be evaluated under ACE again.

• They do not receive a monetary incentive.

• Contact with the program is mandatory.

/ 10

Agenda






BREAK

Reporting In

Technology

Time Tracking

Next Steps

Questions

/ 11

All Extension and Second-Year Participants will receive two observations, conducted within the following windows.

ROUND 1 ROUND 2

Nov 12 – Dec 12

• Our back-up week to catch straggling observations will be December 15-19.

• Remember to keep your observations as evenly spaced as possible!

• Also try to space out subject areas….

February 2-20

• Our back-up week to catch straggling observations will be February 23-27.

• Remember to keep your observations as evenly spaced as possible!

• Also try to space out subject areas….

/ 12

All Extension and Second-Year Participants are required to submit the Video Attestation Form to you on your first visit.

Video Overview Form

Video Attestation

Form

For Students

• This form describes the purpose and nature of our video observations.

• Students wishing to opt out will sign and return the bottom portion to the teacher.

• You will only collect the Attestation form – not any opt-out forms.

For Teachers

• Teachers are required to attest that they’ve shared the video overview form with students.

• They will sign and give this form to you on your first visit.

• Please carry an extra copy or two in case they’ve lost theirs!

/ 13

Agenda






BREAK

Reporting In

Technology

Time Tracking

Next Steps

Questions

/ 14

Observation Workflow – Round #1

• Generate your observation schedule for the full window. Use the Course Schedule Survey to plan your schedule. Check school calendars as well for vacations or inservice days.

• Keep a running record of your tentative and confirmed times in the Google doc.

• Conduct your video observations – starting November 12! Be sure to collect the video attestation form from teachers on your first visit.

• Upload the videos to BloomBoard within 24 hours of the observation.

• Update the Google doc again once the video has been uploaded.

• Record your hours in Replicon! You’ll receive a reminder from Replicon when your timesheet is due (every two weeks on Tuesday, can submit as soon as your hours are complete).

/ 15

Agenda






BREAK

Reporting In

Technology

Time Tracking

Next Steps

Questions

/ 16

Uploading to BloomBoard requires that you log in under the teacher’s account.

ACE Teacher_Videographer Instructions - Upload Video.mp4

https://apps.bloomboard.com

/ 17

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 18

Videographers will keep a running record of their schedule and progress towards completion via the shared Google Doc.

Your full participant list will be shared via this Google doc, including email address, BloomBoard login, and school name/address. Bookmark this page!

You’ll edit only columns N through Q. In column N and O, you’ll use italicized dates and times to indicate tentative appointments and bold dates and times to indicate confirmed appointments.

Update column P once the video has been uploaded to BloomBoard – within 24 hours of the observation.

Note any concerns or anomalies in the Comments sections.

Using the Google Doc

/ 19

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 20

Scheduling video observations will be the same for both projects.

ACE Extension Plan AND Instructional Feedback Project

• You’ll access participants’ schedules in the Course Schedule Survey (Excel spreadsheet).

• Once you’ve planned a tentative schedule, you’ll contact the teacher(s) directly via email to notify them when you’ll be coming using the email template (with subject line) provided.

• Any rescheduling will be done over email.

• Email the night before to confirm and provide a phone number to call for emergencies (if you’d like).

Please copy Amy on all INITIAL emails to participants!

/ 21

Guidelines around selecting courses to video are fairly common sense.

• Avoid test prep (ACT/SAT), electives outside the area of certification (music, art, phys ed), study hall, or other non-academic subjects.

ACADEMIC

• We’ll need to see a full lesson cycle – if the course is only scheduled to last 30 minutes that’s fine, but don’t leave early or arrive late.

FULL LESSON

• For SPED classes we prefer to observe lessons in which the teacher is lead teaching. You can confirm this with the teacher via email.

LEAD TEACHI

NG

/ 22

Know where you’re going and plan your schedule in advance – be sure to add buffer for rescheduling.

• Use www.batchgeo.com to map your school locations. Group schools geographically to minimize drive time!

MAP IT

• Plan out your tentative schedule for the three-week window before emailing participants using a calendar template. You should be able to conduct at least 5 observations per week without issue.

PLAN IT

• Once you have your full schedule planned, add the tentative dates to the Google doc and email your teachers!

EMAIL IT

http://www.batchgeo.com/

/ 23

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 24

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 25

Technology

• The camera – regular definition (MP4, 4 Mbps)

• Camera accessories (tripod, travel charger, etc.)

• Computer with high-speed connection for upload

You’ll Need

Next Steps

• Amy will ship all video equipment and accessories to your home address.

• A return shipping label will be included with the package – DO NOT LOSE THIS and KEEP THE BOX.

We’ll need to keep our AV profile fairly low-tech – hi-def videos take far too long to upload. Audio quality will be the main concern.

/ 26

Characteristics of High-Quality Video Observations

• We see the class from beginning to end – don’t splice out idle time.

• Capture the OBJECTIVE – zoom in on the board if you have to!

• Capture the LESSON PLAN – either make/take a copy to scan/upload or take a picture/pan in on it.

• Stay through the end – we need to see end-of-class routines/exit tickets.

• We hear both the teacher’s direct instruction and student responses – the latter being particularly important.

• Video should be steady – use a tripod if you can!

• Please zoom in on student assignments and desk work if you can do so without missing key lesson dialogue.

• Focus on student/teacher interactions, not just student small-group work.

/ 27

Characteristics of High-Quality Video Observations

Try to sit to the side of the classroom or near the front so we can see both the teacher and students – and so we’re not staring at the backs of students’ heads. Seeing the whiteboard/overhead is also key.

Be sure to pan the entire class at least once so we can get an idea of how many students are in attendance.

Be sure to record the objective of the lesson to share when you upload the video.

Don’t be afraid to move around to capture student learning, as long as the video does not become disruptive.

Ms. Liz

https://vimeo.com/24224285#at=0

(password ACE)

Ms. McClam

https://vimeo.com/tntptrainingvids/review/38916005/846c705762

Bad Example

Better Example

https://vimeo.com/24224285

https://vimeo.com/24224285





/ 28

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 29

You’ll track the hours you work in Replicon.

The most important thing to remember about Replicon is to submit your timesheets every

other Tuesday!

• You’ll receive an auto-generated email with your Replicon login once your paperwork is complete.

• The first time you enter hours, make sure your time-tracking code is correct! PATL – Virtual Coaching: ACE – Videographer. This information is on your offer letter.

• Record hours for:

• This orientation!• Scheduling/rescheduling with teachers• Updating the Google doc• Classroom video recording time• Drive between schools (if reasonable)• Setting up the upload

• Do NOT record hours for:

• First/last commute• Idle time during video upload

https://login.replicon.com/Default.aspx?companykey=TNTP&msg=&code=&init=

/ 30

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

/ 31

Starting tonight, follow these next steps to get started on your video observations!

• Head back to the ACE Videographer wiki space and review all materials in the After Orientation section. Reach out with any questions.

Complete the Self-

Study Module

• Amy will send your video equipment directly to your home address – if this address is different from your hiring paperwork, let me know!

Receive Your

Equipment

• Amy will share the Google doc with you once your participant caseload is finalized.

Wait for Your

Caseload

• Use www.batchgeo.com and a calendar template of your choosing to plan your schedule.

• Remember to copy Amy on all initial emails to participants.

Plan Your Schedule

• Keep that Google doc updated! Flag any issues or concerns directly to Amy.

Start Observing!

http://www.batchgeo.com/

/ 32

Key Dates and Deliverables – Round 1

Date Due Deliverable Responsible Party

11/3/2014 Caseloads shared with Videographers via Google doc

Amy

11/5/2014 Email invitations sent to teachers

Videographers

11/10/2015 Teacher confirmations due to Videographers

Teachers

11/12/2015 Video observations start Videographers

12/12/2014 Video observations close Videographers

12/15/2015 ALL final videos uploaded to Bloomboard

Videographers

/ 33

Agenda





Reporting In


BREAK

Technology

Time Tracking

Next Steps

Questions

© tntp 2013 videographer orientation assessment and evaluation, nte october 2014

Documents

points observations

points classroom observations

pointsskillful5 points

points achievement3

points principal rating3

points final ace scorescenario

points student surveys2

ace measure