edtech505-requestforproposal

7/31/2019 EDTECH505-RequestforProposal

1/6

Evaluation of Determining Instructional Purposes (DIP)

A Proposal Submitted to Far West Laboratory for Educational and Research

Development

By

Zae Evaluation Services

July 10, 2012


2/6

Introduction

The Far West Laboratory for Educational and Research Development (FWL) has made

a preliminary investment in the design and implementation of a training program in the

form of a handbook entitled Determining Instructional Purposes (DIP). They now

decided to do an evaluation before moving forward with continued investment andpossible expansion of the project. FWL is accepting bids for Request For Proposals

(RFPs) from suitable candidates that will focus the evaluation on providing information

and recommendations for use in making decisions regarding marketing and sale of the

DIP units. This document is being submitted by Zae Evaluation Services (ZES) in

accordance with the Request For Proposal (RFP) put forward by FWL.

Description of Program Being Evaluated

The DIP training package was developed by FWL for the purpose of training school

administrators and graduate students in educational administration in skills related to

planning of effective school programs. The DIP package consists of a coordinators

handbook with three units with each containing six modules and activities that actively

engage learners in authentic administrative duties.

Each unit focuses on a certain concentration: (i) setting goals, (ii) analyzing problems,

and (iii) deriving objectives. FWL estimates of the training time required for the units are

10-15 hours each for Units 1 and 3 and 12-18 hours for Unit 2. The units can be run

individually or concurrently depending on the needs of the school system at a given

instance. The coordinators handbooks can be purchased individually or by the set.

A coordinator is required to organize, guide, and monitor activities in which participants

use the materials and procedures contained in the units. According to the programdevelopers, the coordinator should have worked through the relevant unit(s) on his/her

own before embarking on any training exercise although he/she does not require a

special skill set or prior knowledge of the content area before he/she administers the

training sessions.

Evaluation Method

The success level of any school system is largely dependent on prudent spending,

accurate decision making by key stakeholders, and the willingness of stakeholders to

participate in training exercises.

However, before moving forward from this standpoint, a comprehensive set of

evaluation questions needs to be addressed.

Is the training material adequate and appropriate for the target audience?

Are the three units designed and implemented properly to meet the intended

learning outcomes?


3/6

What impact will the program have on participants when they return to their

normal administrative duties?

The goal of the assessment exercise is to determine if administrators will find

participating in the training a worthwhile monetary investment that should be sustained.

The DIP training program will be evaluated on several fronts. It is the intention of the

evaluator to categorize the evaluations as either formative or summative in nature.

Formative assessments will focus on two target populations the training participants

and the training coordinators. The summative assessments will focus on program

participants and school system administration. For this evaluation, it is suggested that

the training units should be run three-days per week from Monday-Wednesday over the

six weeks period allowing administering of assessments prior to the next training week.

Formative Assessments

Assessment 1 Training participants will be asked to take part in surveys and

interviews throughout the training to assess the effectiveness of the instruction and

facilitation. A Likert-type scale will be incorporated to assess the effectiveness of eachtraining session. The surveys will also contain areas for participants to make anecdotal

comments about the program, identifying areas of strength and recommend them for

correction. Did the participants feel that the instruction was adequate in meeting learner

need? Did the participants feel that the level of instruction was in line with expectations?

All participants will be interviewed since the group is relatively small.

Assessment 2 Interviews will be held with training coordinators twice per unit. The

interview questions will focus on two areas: The effectiveness of the training

preparation, and areas for revision based on implementation timeline. It is important to

determine if the coordinator preparation is adequate for the training programs to run

effectively. As such FWL will need to assess the validity of the method used to selectcoordinators.

Summative Assessments

Assessment 3 Both Pre and Post-testing will be administered to all program

participants to assess learning outcomes for each of the three project units. The pre and

post tests will consist of educational scenarios similar to the modules and group

activities present in each instructional unit. Participants will be asked to make

administrative decisions based upon the information presented. The post testing will be

used to assess how decision making skills have changed and adapted based upon new

understandings. Some scenarios may be repeated in both the pre and post testing to

further measure growth. The purpose is to assess if participants meet the objectives as

outlined in the program protocol. Answer to question such as: Were students able to

make adequate progress in the training program? ...will be solicited.

Assessment 4 Interviews with administrators to assess overall satisfaction with the

program as it pertains to meeting desired outcomes. This will be conducted three

months following the training. This later date will be done to determine the impact of the

training in the actual school setting.


4/6

Administrators will be interviewed to assess the authentic impact of the training on the

administrative staff and the overall impact on their routine tasks in the work place.

Task Schedule

Task Responsible

Deadline

1. Preliminary 2-day meeting to be conducted at FWL.This will entail opening dialogues between FWL and ZES.

All three representatives of ZES will be present. The goalis to determine evaluation strategies and the locus offocus.

FLW June 10,2012

2. Videoconference on http ://www .gotomeeting .com /fec /

between Mr. Zae and FWL representatives. The purposeof this meeting is to review the questionnaires, surveys,and interviews designed by Mr. Zae for the evaluationprocess.

ZES July 3, 2012

3. Final submission of evaluation design revisions to ZESby FWL for final mark-up.

FWL July 24

4. Meeting with FWL to examine final drafts ofquestionnaires, surveys, and interviews. Meetings will alsoinclude planning sessions for evaluation strategizing.

ZES August 15

5. Initial posting of instruments on collaborative wiki -http ://kirklandlawrence .wikispaces .com /to facilitate editingbefore posting instruments to Google Docs Survey.

ZES August 29

6. Full six weeks training session for all three units in theDIP training program during September and part ofOctober. All scheduling of workshops will be coordinatedthrough the wiki and by emails.

FWL September 3- October12, 2012.

8. Meeting with FWL to forward ZES with all Pre and Posttest data, all interviews and all surveys. This meeting willalso be used to make determinations about whichparticipant will be used for the long term impactassessment after the training session.

ZES December 18, 2012
http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://www.gotomeeting.com/fec/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://kirklandlawrence.wikispaces.com/http://www.gotomeeting.com/fec/


5/6

9. Emails will be sent to participants detailing their role inthe process. They will each be given the link to GoogleDocs Survey to participate in the DIP assessment. Thissite will be used to track and monitor participants as theycomplete the surveys online.

FWL January 20,2013

10. Meeting with FWL to summarize the pre and post testdata, the participant interviews and surveys, and thecoordinator interviews.

FWL February 30,2013

11. Close the DIP survey portal in Google Docs Survey.Begin review and analysis of data.

FWL March 10,2013

12. Submit final report to FWL . ZES April 14,2013

Project Personnel

Rick Zae - President of ZES, he has a masters degree in sales and marketing and have

done several evaluation of similar training programs. Kirkland Lawrence - CEO,

possessed a masters degree in educational technology and have 5 years

experience conducting evaluations which are technology related, and Clancy

Jones - secretary/ liaison officer, he has a bachelors degree in business

administration, he will coordinate meetings, making phone calls, sending emails

etc.

Budget or Fee

Budget of Expenditure

Personnel Subtotal

"Mr. Zae - Project Director

(40 days @ $450/day)" $18,000

"Mr. Lawrence - Evaluation Coordinator

(40 days @ $375/day" $15,000

Mr. Jones -secretary/ liaison officer $6,500TOTAL $40,500

Travel & Accommodation Subtotal

Flights from Miami > Boise $2,240.00

(June 15, August 15,

Feb. 30, 2013 & April 14).


6/6

Hotel Accommodation $2,000.00

Estimated mileage between

hotel & FWL 260 miles@ $0.555 $143.00

TOTAL $4,383.00

Supplies/Materials Sub Total

Paper, binding materials $600.00

Printing services $375.00

Stationery supplies $280.00

TOTAL $1255

Miscellaneous Sub Total

Per diem meals $1, 350.00

TOTAL $1,350.00

Program Supplies Sub Total

Coordinator hand books $195.00

Unit handbooks $1250.00

Other $300.00

TOTAL $1745.00

Total Estimate of Expenditure = $49,233.00

Payment SchedulePayment Percentage Due Date Amount

Payment 1: 25% due after first meeting June 10, 2012 $12,308.25

Payment 2: 25 % due at the commencement of training Dec. 18, 2012 $12,308.25

Payment 3: 25% Due at summary meeting February 30,2012

$12,308.25

Payment 4: 25% due at final meeting with FWL topresent report.

April 4, 2013 $12,308.25

edtech505-requestforproposal

Documents