welcome back! day 3

48
Drs. Krishna and Webb October 31, 2013

Upload: keane-mcfadden

Post on 31-Dec-2015

29 views

Category:

Documents


1 download

DESCRIPTION

Welcome Back! Day 3. Drs. Krishna and Webb October 31, 2013. Agenda. 6 6.1 6.2 6.3 6.4 7.1, 7.2, 7.3, 7.4 7 7.3 7.4 LUNCH. But first…. What questions do you have from yesterday’s discussions, slides, examples, exercises? Anything back to Day 1? - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Welcome Back! Day 3

Drs. Krishna and WebbOctober 31, 2013

Page 2: Welcome Back! Day 3

6 6.1 6.2 6.3 6.4 7.1, 7.2, 7.3, 7.4 7 7.3 7.4 LUNCH

ANSI Training 2013: Webb/Krishna

Page 3: Welcome Back! Day 3

What questions do you have from yesterday’s discussions, slides, examples, exercises?

Anything back to Day 1?

Hold on to your hats – 50 slides this morning!

ANSI Training 2013: Webb/Krishna

Page 4: Welcome Back! Day 3

6.1.1 The certification body shall manage and be responsible for the performance of all personnel involved in the certification process. ◦ Document how the certification body manages

the performance of all personnel involved in the certification process and provide specific policies and procedures if applicable.

ANSI Training 2013: Webb/Krishna

Page 5: Welcome Back! Day 3

6.1.2 The certification body shall have sufficient personnel available with the necessary competence to perform certification functions relating to the type, range and volume of work performed. ◦ No information is required here as the

information provided under 6.1.3 is used to evaluate compliance under this requirement.

ANSI Training 2013: Webb/Krishna

Page 6: Welcome Back! Day 3

6.1.3 The certification body shall define the competence requirements for personnel involved in the certification process. Personnel shall have competence for their specific tasks and responsibilities.

a) Provide position descriptions, position qualifications, and resumes or bios of people involved in certification activities. ◦ WHAT EVIDENCE MIGHT BE USED?

ANSI Training 2013: Webb/Krishna

Page 7: Welcome Back! Day 3

6.1.4 The certification body shall provide its personnel with documented instructions describing their duties and responsibilities. These instructions shall be kept up-to-date.

Describe the procedures used to update all documented work instructions and position descriptions. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 8: Welcome Back! Day 3

6.1.5 The certification body shall maintain up-to-date personnel records, including relevant information, e.g. qualifications, training, experience, professional affiliations, professional status, competence and known conflicts of interest.

Document the certification body’s policies and procedures to maintain personnel records, e.g. qualifications, training, experience, professional affiliations, professional status, competence, and known conflict of interests. SAMPLING?

ANSI Training 2013: Webb/Krishna

Page 9: Welcome Back! Day 3

6.1.6 Personnel acting on the certification body's behalf shall keep confidential all information obtained or created during the performance of the body's certification activities, except as required by law or where authorized by the applicant, candidate or certified person.

Document how all information obtained or created during the certification body’s activities is kept confidential. EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 10: Welcome Back! Day 3

6.1.7 The certification body shall require its personnel to sign a document by which they commit themselves to comply with the rules defined by the certification body, including those relating to confidentiality, impartiality and conflict of interests.

NOTE Where permitted by law, other methods, including electronic signature, are acceptable.

… EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 11: Welcome Back! Day 3

Provide a sample copy of the signed document by which personnel comply with applicable rules including confidentiality, impartiality, and conflict of interests.◦ CHECK ON SITE? VIRTUAL ON SITE?

ANSI Training 2013: Webb/Krishna

Page 12: Welcome Back! Day 3

6.1.8 When a certification body certifies a person it employs, the certification body shall adopt procedures to maintain impartiality.

If the certification body’s employees are allowed to take the certification examination, describe the procedure to maintain impartiality. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 13: Welcome Back! Day 3

6.2 Personnel involved in the certification activities

6.2.1 General   The certification body shall require its

personnel to declare any potential conflict of interest in any candidate.

No information is required here as the information provided under 6.1.7 is used to evaluate compliance under this requirement.

ANSI Training 2013: Webb/Krishna

Page 14: Welcome Back! Day 3

6.2.2.1 Examiners shall meet the requirements of the certification body. The selection and approval processes shall ensure that examiners: understand the relevant certification scheme;

are able to apply the examination procedures and documents;

have competence in the field to be examined;

ANSI Training 2013: Webb/Krishna

Page 15: Welcome Back! Day 3

are fluent, both in writing and orally, in the language of examination; in circumstances where an interpreter or a translator is used, the certification body shall have procedures in place to ensure that it does not affect the validity of the examination;

have identified any known conflicts of interest to ensure impartial judgments are made. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 16: Welcome Back! Day 3

For each of the certification scope, document how the certification body ensures that examiners:

Understand the relevant certification scheme Are able to apply the examination procedures and

documents Have competence in the field to be examined Are fluent in the language of the examination Utilized processes to maintain the validity of the

examination is not compromised when translated into other languages.

Have identified any known conflicts of interest to ensure impartial judgments are made.

 

ANSI Training 2013: Webb/Krishna

Page 17: Welcome Back! Day 3

6.2.2.2 The certification body shall monitor the performance of the examiners and the reliability of the examiners' judgments. Where deficiencies are found, corrective actions shall be taken.

NOTE Monitoring procedures for examiners can include, for example, on-site observation, review of examiners' reports, feedback from candidates.

ANSI Training 2013: Webb/Krishna

Page 18: Welcome Back! Day 3

Describe the process to monitor the performance of the examiners and process to implement corrective actions when deficiencies are identified.

b) Provide documentation to show the reliability of the examiners’ judgment (e.g. inter-rater reliability). ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 19: Welcome Back! Day 3

6.2.2.3 If an examiner has a potential conflict of interest in the examination of a candidate, the certification body shall undertake measures to ensure that the confidentiality and impartiality of the examination are not compromised. These measures shall be recorded.

ANSI Training 2013: Webb/Krishna

Page 20: Welcome Back! Day 3

a) If the examiner has a potential conflict of interest (serve as candidate’s employer, colleague, competitor, trainer etc.) document the measures to ensure that the confidentiality and impartiality of the examination are not compromised. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 21: Welcome Back! Day 3

6.3.1 The certification body shall have a legally enforceable agreement covering the arrangements, including confidentiality and conflict of interests, with each body that provides outsourced work related to the certification process.

NOTE For the purposes of this International Standard, the terms “outsourcing” and “subcontracting” are considered to be synonyms. WHY “AND”?

ANSI Training 2013: Webb/Krishna

Page 22: Welcome Back! Day 3

Attach your legally enforceable agreements with all entities to whom certification activities are outsourced/contracted/

subcontracted. ◦ WHAT OTHER SECTIONS OF THE STANDARDS

WOULD HELP AN ASSESSOR CHECK THAT ALL SUBCONTRACTORS / CONTRACTORS ARE LISTED?

ANSI Training 2013: Webb/Krishna

Page 23: Welcome Back! Day 3

a) take full responsibility for all outsourced work;

b) ensure that the body conducting outsourced work is competent and complies with the applicable provisions of this International Standard;

c) assess and monitor the performance of the bodies conducting outsourced work in accordance with its documented procedures;

… WHAT IS REASONABLE?

ANSI Training 2013: Webb/Krishna

Page 24: Welcome Back! Day 3

d) have records to demonstrate that the bodies conducting outsourced work meet all requirements relevant to the outsourced work;

e) maintain a list of the bodies conducting outsourced work. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 25: Welcome Back! Day 3

List all the certification activities that are outsourced or subcontracted and for each activity identify the entity/person that delivers it (WHY IS THIS A GOOD IDEA?)

Describe how the certification body assesses and monitors the performance of the outsourced certification work. Provide relevant performance audit reports. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 26: Welcome Back! Day 3

The certification body shall use adequate premises, including examination sites, equipment and resources for carrying out its certification activities.

Provide evidence that the premises, examination sites, equipment, and resources are adequate for certification activities. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 27: Welcome Back! Day 3

7.1 Records of applicants, candidates and certified persons

 7.1.1 The certification body shall maintain records. The records shall include a means to confirm the status of a certified person. The records shall demonstrate that the certification or recertification process has been effectively fulfilled, particularly with respect to application forms, assessment reports (which include examination records) and other documents relating to granting, maintaining, recertifying, expanding and reducing the scope, and suspending or withdrawing certification.

ANSI Training 2013: Webb/Krishna

Page 28: Welcome Back! Day 3

Provide a description of what information is maintained for every candidate and for certified person, and where such information is kept and how it is updated, and secured. ◦ EVIDENCE? SAMPLING ON SITE? SAMPLING

VIRTUALLY?

ANSI Training 2013: Webb/Krishna

Page 29: Welcome Back! Day 3

7.1.2 The records shall be identified, managed and disposed of in such a way as to ensure the integrity of the process and the confidentiality of the information. The records shall be kept for an appropriate period of time, for a minimum of one full certification cycle, or as required by recognition arrangements, contractual, legal or other obligations.

Provide a copy of the record retention policy for each type of record.

ANSI Training 2013: Webb/Krishna

Page 30: Welcome Back! Day 3

7.1.3 The certification body shall have enforceable arrangements to require that the certified person informs the certification body, without delay, of matters that can affect the capability of the certified person to continue to fulfil the certification requirements.

Provide documentation that the certifying body has enforceable arrangements that require the certified person to inform the certification body of matters that affect his/her capability to continue to fulfill the certification requirements.

EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 31: Welcome Back! Day 3

7.2.1 The certification body shall verify and provide information, upon request, as to whether an individual holds a current, valid certification and the scope of that certification, except where the law requires such information not to be disclosed.

Provide the policy regarding how information regarding an individual’s certification status is verified including how the information is provided and what information is disclosed. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 32: Welcome Back! Day 3

7.2.2 The certification body shall make publicly available without request information regarding the scope of the certification scheme and a general description of the certification process.

a) Are the certification scope and description of the certification process publicly available without request? Yes or No.

b) Include documentation.

ANSI Training 2013: Webb/Krishna

Page 33: Welcome Back! Day 3

7.2.3 All pre-requisites of the certification scheme shall be listed and the list shall be made publicly available without request.

a) Are the pre-requisites of the certification scheme listed and publicly available without request? Yes or No.

b) Include documentation.

ANSI Training 2013: Webb/Krishna

Page 34: Welcome Back! Day 3

7.2.4 Information provided by the certification body, including advertising, shall be accurate and not misleading.

Provide evidence to show how the certification body guards against inaccuracies or misleading statements used in publicly available information, including advertising. ◦ EVIDENCE?

 

ANSI Training 2013: Webb/Krishna

Page 35: Welcome Back! Day 3

 7.3.1 The certification body shall establish documented policies and procedures for the maintenance and release of information.

Provide a copy of the policies and procedures for maintenance and release of information. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 36: Welcome Back! Day 3

7.3.2 The certification body shall, through legally enforceable agreements, keep confidential all information obtained during the certification process. These agreements shall cover all personnel.

Provide documentation to show how all information obtained during the certification process is kept confidential. ◦ EVIDENCE?

ANSI Training 2013: Webb/Krishna

Page 37: Welcome Back! Day 3

7.3.3 The certification body shall ensure that information obtained during the certification process, or from sources other than the applicant, candidate or certified person, is not disclosed to an unauthorized party without the written consent of the individual (applicant, candidate or certified person), except where the law requires such information to be disclosed.

Provide the policy regarding release of candidate information.

ANSI Training 2013: Webb/Krishna

Page 38: Welcome Back! Day 3

7.3.4 When the certification body is required by law to release confidential information, the person concerned shall, unless prohibited by law, be notified as to what information will be provided.

Provide a sample candidate agreement covering consent to release information.

ANSI Training 2013: Webb/Krishna

Page 39: Welcome Back! Day 3

7.3.5 The certification body shall ensure that the activities of related bodies do not compromise confidentiality.

a) Provide a list of related bodies. b) Describe the type of information that is

shared with each of them. c) Provide a copy of agreement with the

related bodies to ensure confidentiality. ◦ EVIDENCE? NEW OR DÉJÀ VU?

ANSI Training 2013: Webb/Krishna

Page 40: Welcome Back! Day 3

 7.4.1 The certification body shall develop and document policies and procedures necessary to ensure security throughout the entire certification process and shall have measures in place to take corrective actions when security breaches occur.

No response required here. Application questions 7.4.2 and 7.4.3 address this requirement.

ANSI Training 2013: Webb/Krishna

Page 41: Welcome Back! Day 3

7.4.2 Security policies and procedures shall include provisions to ensure the security of examination materials, taking into account the following:

the locations of the materials (e.g. transportation, electronic delivery, disposal, storage, examination centre);

the nature of the materials (e.g. electronic, paper, test equipment);

ANSI Training 2013: Webb/Krishna

Page 42: Welcome Back! Day 3

the steps in the examination process (e.g. development, administration, results reporting);

the threats arising from repeated use of examination materials. ◦ …

ANSI Training 2013: Webb/Krishna

Page 43: Welcome Back! Day 3

Provide a copy of the certification body’s policies and procedures to ensure security throughout the entire certification process to include all provisions under 7.4.2

Describe the measures in place to take corrective actions when security breaches occur.

c) Provide documentation on how the most recent security breach was addressed.

ANSI Training 2013: Webb/Krishna

Page 44: Welcome Back! Day 3

7.4.3 Certification bodies shall prevent fraudulent examination practices by: requiring candidates to sign a non-disclosure agreement or other agreement indicating their commitment not to release confidential examination materials or participate in fraudulent test-taking practices; requiring an invigilator or examiner to be present; confirming the identity of the candidate;

ANSI Training 2013: Webb/Krishna

Page 45: Welcome Back! Day 3

implementing procedures to prevent any unauthorized aids from being brought into the examination area; preventing candidates from gaining access to unauthorized aids during the examination; monitoring examination results for indications of cheating.

ANSI Training 2013: Webb/Krishna

Page 46: Welcome Back! Day 3

a) Provide a copy of the certification body’s candidate agreement indicating the candidate’s commitment not to release confidential examination materials or participate in fraudulent test-taking practices.

 b) Provide documentation of the requirement that the invigilator or examiner be present during test-taking.

ANSI Training 2013: Webb/Krishna

Page 47: Welcome Back! Day 3

c) Provide documentation of the policies and procedures for the process to confirm the identity of the candidate.

 d) Provide documentation of the policies and procedures that prevent candidates from gaining access to unauthorized aids.

ANSI Training 2013: Webb/Krishna

Page 48: Welcome Back! Day 3

e) Provide documentation of the policies and procedures that address actions taken if a candidate is found to use unauthorized aids.

 f) Provide documentation of the policies and procedures that address the process to monitor examination for indications of cheating.

ANSI Training 2013: Webb/Krishna