aviation english language test service (aelts) 2-2 aelts.pdf · aviation english language tests;...

34
28 March 2013 Slide 1 Aviation English Language Test Service (AELTS) Dawn Flanagan AELTS Programme Administrator

Upload: others

Post on 19-Oct-2020

23 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 1

Aviation English Language Test Service (AELTS)

Dawn Flanagan

AELTS Programme Administrator

Page 2: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 2

Outline

• The Why, What and How of AELTE

• What did we learn?

• What are we doing now? – AELTS

• How does the system work?

• Possible outcomes

• What does it look like?

Page 3: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 3

Why?

• Problem: – Endorsement of licenses and personnel records

depends on testing

– Testing industry is unregulated

• In 2009, ICAO held a brainstorming session with IFATCA, IFALPA, ICAEA and ILTA – Determined need to have a mechanism to assess tests

– Needed funding and resources to support

– Determined ICAO was the organization with the recognized authority to establish service

Page 4: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 4

What?

• Through extensive discussions with ILTA, IFALPA, IFATCA, ICAEA and ICAO, it was decided that it was necessary to: – Establish a service to provide States with impartial

recommendations in the selection or development of aviation English language tests;

– Develop and implement a process to encourage and facilitate the implementation of ICAO language proficiency requirements; and

– Establish a means to monitor and improve the quality of aviation language testing.

Page 5: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 5

What? (cont.)

• Workgroup established (ICAO, ILTA, ICAEA, IFALPA and IFATCA) to develop process

• End result: Establishment of the ICAO Aviation English Language Test Endorsement (AELTE) Service

– Press release October 2011

– Pilot project

– Voluntary service

Page 6: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 6

Principles of AELTE

• Two types of recognition:

– Endorsed (3 years); or

– Conditionally endorsed (1 year)

• Process is cost-recovery

• Process developed with support of ILTA, ICAEA, IFALPA and IFATCA

Page 7: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 7

How?

• Never been done before by ICAO!

• Had to build it from scratch – Website developed to inform public/TSPs about

service

– Use of online tools for TSPs to submit test documentation and for evaluators to review documentation against ICAO Doc 9835

– Establishment of cadre of test evaluators

– Correspondence between ICAO and TSPs regarding results

Page 8: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 8

What did we learn?

• Need to get back to basics

– Explain clearly the purpose, requirements and outcomes of service

– Reinforce importance of ICAO Doc 9835

• Importance of pre-assessment questionnaire must be emphasized

Page 9: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 9

What did we learn? (cont.)

• Need for better communication

– May require more info from TSPs in their submissions

– ICAO should provide more feedback in reports

– Regular dialogue between ICAO and test evaluators is beneficial

Page 10: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 10

What did we learn? (cont.)

• Need to better align service with other ICAO assessment programmes

– Aviation English Language Test Service

• Create an easily identifiable programme

– Unique logo

• Possibility for reconsideration of tests

• Need to increase fees to support a cost-recovery service

Page 11: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 11

What are we doing now?

• Developing a new website

– Soon to enter testing phase

– Whole process on-line

Become an AELTS Member

Test Pre-Assessment

Questionnaire

Pay Assessment Fee

Submit Test Documentation

Obtain ICAO certificate (if recognized)

Page 12: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 12

What we are doing now? (cont.)

• Also on website

– Links to references in Doc 9835

• Pre-assessment questionnaire

• Submission of test documentation

– More guidance to TSPs for submitting documentation

– Invoicing

– Certificates

Page 13: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 13

What are we doing now? (cont.)

• Re-launching with new name and unique logo

Page 14: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 14

What we are doing now? (cont.)

• Standing rules for service

– General terms and conditions, including legal agreement

• Increase in fees for service

– Possible increase in assessment fee

– New charges for reconsideration

• Established a Steering Committee

Page 15: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 15

How does the system work?

• Public access to website to learn about programme

• TSP signs up to become a member

• TSP take Pre-Assessment Questionnaire

• TSP determines if the test is ready to be submitted for assessment

Page 16: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 16

How does the system work? (cont.)

• TSP submits documentation for assessment

– Agree to Terms and Conditions

– Pay assessment fee

– Submit all required documentation

• Evaluation team reviews test documentation

– Assesses information against ICAO Doc 9835 and ICAO SARPs for LPRs

– Determines if more information is required

– Provides findings/recommendations

Page 17: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 17

How does the system work? (cont.)

• ICAO issues a report to TSP

– Conforms

– Partially Conforms

– Does Not Conform

• Reconsideration

• Certificates Issued

• Notice of recognition posted on website

Page 18: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 18

Possible Outcomes: Conforms with Standards

• ICAO recognition for 3 years

• TSPs are required to submit annual reports

• At end of 3 years, ICAO will determine if the TSP can:

– Request renewal of recognition and pay fee; OR

– Submit test for assessment and pay fee

Page 19: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 19

Possible Outcomes: Partially Conforms

• ICAO recognition for 1 year

• TSP must submit improvement plan

• Plan is reviewed and approved by ICAO

• TSP to provide updates on actions to implement plan

• ICAO determines if completed actions demonstrate conformance

• New status may be granted

Page 20: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 20

Reconsideration

• TSP may request reconsideration of test results – Justification and substantiating documentation must

be provided

– Must be submitted within 30 days of receipt of report from ICAO

• ICAO to review and determine if test will be reconsidered

• Fee for reconsideration commensurate with work involved

• ICAO decision is final

Page 21: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 21

What does it look like? (cont.)

Page 22: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 22

What does it look like? (cont.)

Page 23: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 23

What does it look like? (cont.)

Page 24: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 24

What does it look like? (cont.)

Page 25: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 25

What does it look like? (cont.)

Page 26: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 26

What does it look like? (cont.)

Page 27: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 27

What does it look like? (cont.)

Page 28: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 28

What does it look like? (cont.)

Page 29: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 29

What does it look like? (cont.)

Page 30: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 30

What does it look like? (cont.)

Page 31: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 31

What does it look like? (cont.)

Page 32: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 32

Certificates

Page 33: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 33

Certificates

Page 34: Aviation English Language Test Service (AELTS) 2-2 AELTS.pdf · aviation English language tests; –Develop and implement a process to encourage and facilitate the implementation

28 March 2013 Slide 34

Conclusion

Questions?