syllabi and curricula - web viewexaminations and assessment tools . ... have the following...

Self-assessment

SELF-ASSESSMENT TABLE OF CONTENTS

Syllabi and Curricula............................................................................................1

Facilities...............................................................................................................2

Outsourcing and Contractor Management...........................................................3

Records-Keeping and Documentation Systems....................................................3

Information Materials...........................................................................................5

Surveys and Course Evaluations..........................................................................5

Examinations and Assessment Tools...................................................................6

Appropriate Staff Size..........................................................................................7

Appropriate Employee Training............................................................................7

Complaint, Dispute, and Appeals Policies............................................................8

Outsourcing and Contractor Management.........................................................10

Internal Audit or Management Review...............................................................11

Task Analysis Basis for Curriculum or Syllabus..................................................11

Policies for Curriculum or Syllabus Development and Maintenance...................12

Participation.......................................................................................................13

Linkage with Industry.........................................................................................13

Application Process............................................................................................14

Written Job Descriptions and Reports.................................................................15

Examinations......................................................................................................15

Documented Management System....................................................................17

1

Self-assessment

Syllabi and Curricula Training has a current defined syllabus for each relevant course and, where applicable, a defined curriculum for each relevant program that accurately represents what is actually being taught.

ASSESSMENT QUESTIONS

Are lesson plans matching the current syllabus and curriculum used to conduct instruction?

Are lesson plans sufficiently detailed to ensure effective and consistent instructions?

Are training materials, including lesson plans and student handout materials, consistent with current syllabus and curriculum?

Are training materials controlled to ensure they are periodically updated and that only the most current versions of materials are used?

How is instruction evaluated to ensure that it accurately represents current syllabus and curriculum (observations, evaluations, etc.)?

Facilities

Are facilities appropriately accessible to students?

2

Self-assessment

Is there adequate ventilation?

Is there adequate lighting?

Are work surfaces adequate?

Are presentation materials adequate?

Is access to lavatory facilities and potable water relative to the volume of anticipated students?

How do you ensure that facilities that are rented, borrowed, or leased meet the requirements above?

Who is responsible for ensuring that rented, borrowed, or leased facilities meet the requirements above?

Outsourcing and Contractor Management Is there a developed a written contract with any paid outsourcer or contractor performing training-related work (training, training documentation, training program management).


Does contract define relationship between the employer and outsourcer or contractor?

How is it determined if outsourcers or contractors are complying requirements (observations, interviews, etc.)?

3

Self-assessment

How is effectiveness determined, measured, and evaluated?

Records-Keeping and Documentation Systems ASSESSMENT ITEM: Program maintains a records-keeping/documentation system appropriate to its particular circumstances and in compliance with any local laws or regulations to ensure the integrity of the process and the confidentiality of the information.


Is there a written policy or procedure providing a detailed description of the records-keeping/documentation system that include the following:

commitment to confidentiality;

designation of types of records to be stored;

designation of access to particular records;

designation of storage time frames; and

description of proper records disposal.

Are the following records being stored:

student applications;

course or instructor evaluation reports;

4

Self-assessment

liability waivers and releases;

documentation of syllabi and curricula development;

relevant industry linkages records; and

records disposal policies.

How long are key documents stored?

Where are documents stored? Is the storage secure?

How do you dispose of documents?

Who is responsible for ensuring that documentation is maintained according to policy?

Information Materials ASSESSMENT ITEM: Program provides informational and promotional materials to prospective students with current, detailed description of the training, training content, training process, and criteria by which student outcomes will be evaluated.


What marketing and/or informational materials exist for relevant course(s) and program?

How are materials made available to current or prospective students (online, by request, in magazine racks around town, etc.)?

5

Self-assessment

Do materials reference relevant job task analysis?

How do you know if current students or prospective students are effectively receiving these materials (observations, interviews, tracking of distribution, etc.)?

How do you know if students are using these materials?

Surveys and Course Evaluations ASSESSMENT ITEM: Program has developed, implemented, and maintained survey documents for students, contractors, and other program participants.


Do surveys give students, contractors, and other program participates the options to provide:

comments;

suggestions;

criticisms;

complaints; and

feedback on training or administration of training?

How is feedback utilized (interviews with students, program improvements, etc.)?

6

Self-assessment

How are surveys maintained ?

Examinations and Assessment Tools ASSESSMENT ITEM: At the end of each course, program assesses student learning outcomes by using measurable, objective criteria. This should include but not be limited to attendance, verbal participation, outcome of course projects, and performance on written or oral examinations. Prior to the start of training, students are provided the criteria by which they will be evaluated for a given training course or program.


What methods are used to evaluate student learning outcomes (written, verbal, skills evaluations, or other)?

Are policies and procedures governing the development, administration, and maintenance of assessments readily available

What types of assessments are used and how often?

How are examinations maintained to ensure security and confidentiality?

Who is responsible for maintaining and administering examinations?

Appropriate Staff Size ASSESSMENT ITEM: Program employs staff members, instructors, and trainers in adequate numbers to fulfill the organization’s workload.


7

Self-assessment

What guidelines are used to determine appropriate staff size?

What is current staff size?

What are individual positions (administrative, trainers, etc.)?

What is the current distribution of workload (student-to-trainer ratio)?

Does student-to-trainer ratio meet predetermined guidelines?

Appropriate Employee Training ASSESSMENT ITEM: Program ensures that employees have access to all appropriate training necessary to perform their jobs successfully.


What steps are taken to ensure that the entire staff has the appropriate education, training, and experience necessary to perform their jobs?

Can examples of staff development activities or support be provided?

Who is responsible for verifying that staff has adequate education and training (show examples)?

How often is education and training of staff reviewed?

8

Self-assessment

Complaint, Dispute, and Appeals Policies ASSESSMENT ITEM: Program has defined policies and procedures for the resolution of complaints, disputes, and appeals received from applicants, students, and their employers, customers, and clients as well as other parties concerning the training process, training content, and the performance of trained persons.


Can copies of policies and procedures for the resolution of complaints, disputes, and appeals be provided?

How do you ensure that this policy is understood and implemented at all levels of the organization?

Who is responsible for ensuring the implementation of this policy?

How often is this policy invoked?

Have you ever dealt with a complaint, dispute, or appeal?

Was the complaint, dispute, or appeal resolved? If so, describe the policies and procedures employed to resolve the situation.

How often are records of complaints, disputes, or appeals reviewed to ensure they are being handled in accordance with current policies and procedures?

9

Self-assessment

Outsourcing and Contractor Management ASSESSMENT ITEM: Program takes and maintains full responsibility for all outsourced work.

Can policies and procedures related to contractors and contracting be provided?

How are competency and experience requirements for each contractor established?

Where is tracking of competency and experience requirements maintained?

How are competency and experience requirements maintained and updated?

Does program ensure that contractors are competent and comply with ISPQ Standard 01022?

How does program ensure that activities of contractors do not compromise the confidentiality, objectivity, and impartiality of training?

Does program assess and monitor compliance and efficacy of contractors?

How often are compliance and efficacy of contractors assessed and

10

Self-assessment

monitored?

Internal Audit or Management Review ASSESSMENT ITEM: Program has defined system for at least an annual internal review of its management system and procedures, including provisions for continual improvement as well as corrective and preventive actions.


Can policies relating to an internal audit or management review be provided?

Is internal audit or management review conducted more than once a year?

Can documentation of previous internal audit or management review outcomes be provided?

Task Analysis Basis for Curriculum or Syllabus ASSESSMENT ITEM: Program offers course/program based on an established industry approved task analysis. Syllabi and curricula, together with appropriate prerequisites, ensure that participating student receives sufficient instruction and practice to meet the knowledge and skills competencies of the relevant industry-approved task analysis.


Can current/relevant industry-approved task analysis be provided?

Do approved lesson plans reference

11

Self-assessment

task analysis?

Do student informational materials reference task analysis?

Policies for Curriculum or Syllabus Development and Maintenance ASSESSMENT ITEM: Program has policies in place guiding the development of an appropriate curriculum or syllabus, including definition of the prerequisites that students must meet to adequately learn the full points of the relevant approved task analysis.


Can policies for curriculum and syllabus development be provided?

How are prerequisites established?

Who verifies that students have meet prerequisites prior to enrollment?

Are learning objectives derived from task analysis?

How are learning objectives determined?

Do lesson plans specify standards for evaluating trainee performance?

Are training materials, including lesson plans and student handout materials, consistent with current task analysis?

Have training materials been reviewed and approved by subject matter

12

Self-assessment

experts?

Are training materials controlled to ensure they are periodically updated and that only the most current versions are used?

How can students access reference material (on site, online)?

Participation ASSESSMENT ITEM: Program provides interested and relevant parties significantly concerned with the workforce outcomes of the training with avenues to participate in the development of training content and methodologies.


Who are your stakeholders?

How do you allow and/or encourage the participation of stakeholders in the development of your training content?

Linkage with Industry ASSESSMENT ITEM: Program demonstrates it has and maintains an appropriate linkage with the subject industry.


Have potential employers in the local area been identified for job placement assistants?

Has a relationship between these potential employers and the WTC

13

Self-assessment

been established?

Have the following strategies been employed:

join and participate in relevant business and trade associations;

attend job fairs;

use community leaders to establish business contacts; and

conduct a general mailing or e-mailing campaign advertising services?

Application Process ASSESSMENT ITEM: Program has an application process for potential students.


Do all students submit a completed application form prior to attending training?

Can a copy of student application be produced?

Does application include

scope of the training program;

statement that student agrees to comply with the requirements and directions of the training program and supply any information relevant to

14

Self-assessment

safety and medical issues;

descriptions of how prerequisites are met and evidence in support of student meeting prerequisites for education, work experience, etc.; and

general information on the applicant (name, address, and other information required for identification)?

Written Job Descriptions and Reports ASSESSMENT ITEM: Program provides all training-related staff with clearly documented job descriptions, listing their duties and responsibilities and identifying their supervisors or reports.


Are job description and reports kept current through at least an annual review?

How do you keep the job descriptions current?

Are job descriptions made available for review upon request?

How are job descriptions made available?

Can copies of policies related to staff job description development, review, updating, etc., be verified?

15

Self-assessment

Examinations ASSESSMENT ITEM: Program has written, oral, and skill examinations that are developed and administered according to written organizational policies in a manner that ensures that requirements of the ISPQ Standard are effectively applied.


Are students appropriately tested against materials actually presented in the course?

Are test materials stored in an appropriately secure location?

Is person responsible for test instructed in practices that ensure impartiality and security in the delivery of the examination?

Is the test presented under fair environmental conditions, including

an unbiased test administrator;

students having equal access to all testing aids or materials; and

test environment and facilities equal for all?

Are test results (grades) released or held according to defined policies and in a way that will not unfairly single out individual students for unwanted attention nor violate the ISPQ

16

Self-assessment

requirement for confidentiality?

Are there criteria for defining a passing vs. a non-passing score?

Are the test results documented in a way that gives confidence to both students and other stakeholders that outcomes are verifiable?

Do students review test results, and do they have access to an appeals procedure if they feel that their results have been incorrectly tabulated or that some degree of unfairness or inconsistency hindered their testing process?

Has a subject matter expert, other than the test developer, reviewed the test items for accuracy and relevance to the course?

Do test questions follow standard guidelines for specific types of test items (e.g., do multiple choice test questions have only one correct answer)?

Are there accommodations for students with special needs?

How are exam results analyzed?

17

Self-assessment

Documented Management System ASSESSMENT ITEM: Program has a documented management system ensuring that the requirements of the ISPQ Standard are effectively applied.


Do you have management policies outlining the following:

organizational goals and where they are published;

means of measuring outcomes (evaluations);

systems to monitor and correct for meeting organizational goals;

provision for an (at least) annual review of the application and success of the management system;

description of the organization structure of personnel and areas of responsibility; and

policies and procedures that ensure work outcomes meet quality guidelines?

18

syllabi and curricula - web viewexaminations and assessment tools . ... have the following...

Documents