Transcription

1 ICAO LPR Workshop Paris 8-10 December 2010 Michael O Donoghue John Kennedy 9835_2010 Foreward References throughout the document are to language proficiency requirements in general regardless of the specific language concerned. While it is understood that proficiency in English will be the major preoccupation in the implementation of the requirements, itisrecognizedthatis that many States will be concerned with ensuring compliance also for local languages. 1

2 Getting that rateable sample safely rated (Reflections on the design and implementation of MTF_ALP) Getting a rateable sample test centric & test taker centred broad & narrow interpretation of work related Applying ICAO LPRs to phraseology safely rated Reliability High stakes Protect test taker & rater Exploring the boundaries Context May 2008 Requirements: DSNA / DSAC Levels <4, 4, 5 & 6 (Doc 9835: ) 14)» English AND French Test takers Ab initio Little operational experience Operational controllers Volume: Cadets: 400 Operational controllers:? MAY

3 Mandate: Task: Develop a common procedure and test format to meet all the NSA s requirements in conformity with the ICAO LPRs. Methodology What aspects of known tests best allow candidates to reveal the different skills on the Icao scale Rateable sample : Test takers can demonstrate their level Raters can determine the real level with reference to the ICAO descriptors. Background 1994 PELA 2002 TNP >3000 controllers 2005 PRICESG Montréal» PH & PL» Rater training ELPAC (development & trialling) 2008 MultiLingual Test Format Aviation Language Proficiency Credentials 3

4 Options Test centric / Test taker centred The Broad and the Narrow Test organisation Separate roles for Interlocuter and Raters Remote rating PH & PL Familiarise ATCO instructors with LPRs Test taker centred Tests [The test] provides an opportunity for [the candidates] to demonstrate [their proficiency] in [the target language]. [Test taker] Rateable Sample [Raters] 4

5 Broad & narrow Test tasks (Doc 9835) There are many kinds of test tasks or prompts that can be used to elicit speech samples. In general, tasks that resemble real life life activities are most suitable. It is important to keep in mind that the idea of a work related context can accommodate different interpretations. A narrow interpretation would aim to closely replicate radiotelephony communications, including the extent of plain language needed in unusual, unexpected or emergency situations. A broad interpretation of the holistic descriptors and Rating Scale would aim to elicit plain language on various topics that are related to radiotelephony communications or aviation operations, without replicating radiotelephony communications specifically. Examples may include question and answer routines, problem solving exchanges, briefings, simulations and role plays. Both interpretations are valid. Narrow interpretation Face value ( cosmetic value) Relevant Comfort reassuring work environment Phraseology Closer to reality the more you should be using phraseology Might not get that rateable sample Fragmentation / excessive customisation Different test for each work postition Practicality Validity Hard to create Easy to memorise Archives Need for many versions Verbose on R/T 5

6 MTF_ALP Test-taker taker Remote Rater PROCEDURE Test Recording 3rd Rater Interlocuter Anonymity guarantees impartiality Rater reliability constantly monitored Allows for cross rating RemoteRater Exploring the boundaries (2) Rater 1 ( 4 ) ( ) Rater 2 ( 4 ) ( ) Rater 3 ( ) ( 5 ) Stats: raters 1 & 2 harmonised Reality: raters 2 & 3 closer Discrepanciesi raters? test taker population? 6

7 Overlap! Local languages? Cross rating? Exploring the boundaries? PhD: Stephanie Lopez Norm and usage in aeronautical communications where?, when?, why? Prescribed phraseology < > plain language Corpora: norm / usage Contacts [email protected] [email protected] [email protected] Thankyou! 7

8 Phraseology Concise Unambiguous Universal Easy to learn Clipping Embroidery Plain language Doc 9835_2010 (3.3.14) Plain language in aeronautical radiotelephony communications means the spontaneous, creative and noncoded use of a given natural language, although constrained by the functions and topics (aviation and nonaviation) that are required by aeronautical radiotelephony communications, as well as by specific safety critical ii requirements for intelligibility, directness, appropriacy, nonambiguity and concision. 8

9 Kit graphique ENAC Voici le kit graphique powerpoint de la nouvelle charte ENAC. Vous avez à disposition, dans ce document, différents icones (modifiable en taille) qui vous spermettront de réaliser rapidement votre otreprésentation powerpoint. Vous avez la possibilité de les supprimer, s ils ne conviennent pas à votre présentation. Nous attirons votre attention sur le fait du format 16/9 e. Depuis peu de temps les écrans élargis ont fait leur apparition, le format a donc été adapté pour correspondre aux standards écran actuels. Vous pouvez changer cette taille, en précisant des dimensions 21 x 29,7 (format A4 paysage) Aviation University e l aviation civile The French Civil A 9