aviation english language test service (aelts) 2-2 aelts.pdf · aviation english language tests;...
TRANSCRIPT
28 March 2013 Slide 1
Aviation English Language Test Service (AELTS)
Dawn Flanagan
AELTS Programme Administrator
28 March 2013 Slide 2
Outline
• The Why, What and How of AELTE
• What did we learn?
• What are we doing now? – AELTS
• How does the system work?
• Possible outcomes
• What does it look like?
28 March 2013 Slide 3
Why?
• Problem: – Endorsement of licenses and personnel records
depends on testing
– Testing industry is unregulated
• In 2009, ICAO held a brainstorming session with IFATCA, IFALPA, ICAEA and ILTA – Determined need to have a mechanism to assess tests
– Needed funding and resources to support
– Determined ICAO was the organization with the recognized authority to establish service
28 March 2013 Slide 4
What?
• Through extensive discussions with ILTA, IFALPA, IFATCA, ICAEA and ICAO, it was decided that it was necessary to: – Establish a service to provide States with impartial
recommendations in the selection or development of aviation English language tests;
– Develop and implement a process to encourage and facilitate the implementation of ICAO language proficiency requirements; and
– Establish a means to monitor and improve the quality of aviation language testing.
28 March 2013 Slide 5
What? (cont.)
• Workgroup established (ICAO, ILTA, ICAEA, IFALPA and IFATCA) to develop process
• End result: Establishment of the ICAO Aviation English Language Test Endorsement (AELTE) Service
– Press release October 2011
– Pilot project
– Voluntary service
28 March 2013 Slide 6
Principles of AELTE
• Two types of recognition:
– Endorsed (3 years); or
– Conditionally endorsed (1 year)
• Process is cost-recovery
• Process developed with support of ILTA, ICAEA, IFALPA and IFATCA
28 March 2013 Slide 7
How?
• Never been done before by ICAO!
• Had to build it from scratch – Website developed to inform public/TSPs about
service
– Use of online tools for TSPs to submit test documentation and for evaluators to review documentation against ICAO Doc 9835
– Establishment of cadre of test evaluators
– Correspondence between ICAO and TSPs regarding results
28 March 2013 Slide 8
What did we learn?
• Need to get back to basics
– Explain clearly the purpose, requirements and outcomes of service
– Reinforce importance of ICAO Doc 9835
• Importance of pre-assessment questionnaire must be emphasized
28 March 2013 Slide 9
What did we learn? (cont.)
• Need for better communication
– May require more info from TSPs in their submissions
– ICAO should provide more feedback in reports
– Regular dialogue between ICAO and test evaluators is beneficial
28 March 2013 Slide 10
What did we learn? (cont.)
• Need to better align service with other ICAO assessment programmes
– Aviation English Language Test Service
• Create an easily identifiable programme
– Unique logo
• Possibility for reconsideration of tests
• Need to increase fees to support a cost-recovery service
28 March 2013 Slide 11
What are we doing now?
• Developing a new website
– Soon to enter testing phase
– Whole process on-line
Become an AELTS Member
Test Pre-Assessment
Questionnaire
Pay Assessment Fee
Submit Test Documentation
Obtain ICAO certificate (if recognized)
28 March 2013 Slide 12
What we are doing now? (cont.)
• Also on website
– Links to references in Doc 9835
• Pre-assessment questionnaire
• Submission of test documentation
– More guidance to TSPs for submitting documentation
– Invoicing
– Certificates
28 March 2013 Slide 13
What are we doing now? (cont.)
• Re-launching with new name and unique logo
28 March 2013 Slide 14
What we are doing now? (cont.)
• Standing rules for service
– General terms and conditions, including legal agreement
• Increase in fees for service
– Possible increase in assessment fee
– New charges for reconsideration
• Established a Steering Committee
28 March 2013 Slide 15
How does the system work?
• Public access to website to learn about programme
• TSP signs up to become a member
• TSP take Pre-Assessment Questionnaire
• TSP determines if the test is ready to be submitted for assessment
28 March 2013 Slide 16
How does the system work? (cont.)
• TSP submits documentation for assessment
– Agree to Terms and Conditions
– Pay assessment fee
– Submit all required documentation
• Evaluation team reviews test documentation
– Assesses information against ICAO Doc 9835 and ICAO SARPs for LPRs
– Determines if more information is required
– Provides findings/recommendations
28 March 2013 Slide 17
How does the system work? (cont.)
• ICAO issues a report to TSP
– Conforms
– Partially Conforms
– Does Not Conform
• Reconsideration
• Certificates Issued
• Notice of recognition posted on website
28 March 2013 Slide 18
Possible Outcomes: Conforms with Standards
• ICAO recognition for 3 years
• TSPs are required to submit annual reports
• At end of 3 years, ICAO will determine if the TSP can:
– Request renewal of recognition and pay fee; OR
– Submit test for assessment and pay fee
28 March 2013 Slide 19
Possible Outcomes: Partially Conforms
• ICAO recognition for 1 year
• TSP must submit improvement plan
• Plan is reviewed and approved by ICAO
• TSP to provide updates on actions to implement plan
• ICAO determines if completed actions demonstrate conformance
• New status may be granted
28 March 2013 Slide 20
Reconsideration
• TSP may request reconsideration of test results – Justification and substantiating documentation must
be provided
– Must be submitted within 30 days of receipt of report from ICAO
• ICAO to review and determine if test will be reconsidered
• Fee for reconsideration commensurate with work involved
• ICAO decision is final
28 March 2013 Slide 21
What does it look like? (cont.)
28 March 2013 Slide 22
What does it look like? (cont.)
28 March 2013 Slide 23
What does it look like? (cont.)
28 March 2013 Slide 24
What does it look like? (cont.)
28 March 2013 Slide 25
What does it look like? (cont.)
28 March 2013 Slide 26
What does it look like? (cont.)
28 March 2013 Slide 27
What does it look like? (cont.)
28 March 2013 Slide 28
What does it look like? (cont.)
28 March 2013 Slide 29
What does it look like? (cont.)
28 March 2013 Slide 30
What does it look like? (cont.)
28 March 2013 Slide 31
What does it look like? (cont.)
28 March 2013 Slide 32
Certificates
28 March 2013 Slide 33
Certificates
28 March 2013 Slide 34
Conclusion
Questions?