Table of Contents. Part I Introduction. Part II Quick usage guide. Language Proficiency Test. 1 Requirements. 2 IW-LPT and ICAO.

Transcription

1 USER MANUAL Document version , 2014

2 All rights reserved. No parts of this w ork may be reproduced in any form or by any means - graphic, electronic, or mechanical, including photocopying, recording, taping, or information storage and retrieval systems - w ithout the w ritten permission of the publisher. Products that are referred to in this document may be either trademarks and/or registered trademarks of the respective ow ners. The publisher and the author make no claim to these trademarks. While every precaution has been taken in the preparation of this document, the publisher and the author assume no responsibility for errors or omissions, or for damages resulting from the use of information contained in this document or from the use of programs and source code that may accompany it. In no event shall the publisher and the author be liable for any loss of profit or any other commercial damage caused or alleged to have been caused directly or indirectly by this document. Printed: 2014 in Innsbruck, Austria Page 2

3 Table of Contents Part I Introduction 5 1 Requirements IW-LPT and ICAO... 7 Part II Quick usage guide 10 1 Getting started Menu items and usage 3 Examination st rating nd rating Page 3

4 USER MANUAL Page 4 Part I

5 1 Introduction Welcome to the Tool IW-LPT is an aviation language testing tool for testing candidates in accordance with the ICAO language proficiency requirements. The questionnaire is considered appropriate to the diverse contexts in which aviation language testing occurs. The principles underlying this questionnaire suit various operational and regulatory needs. This test is designed to assess SPEAKING and LISTENING proficiency abilities in accordance with each component of the ICAO language proficiency rating scale and the holistic descriptors. ICAO standard phraseology should be used whenever possible but when phraseology is not applicable pilots and air traffic controllers should demonstrate also PLAIN ENGLISH. The minimum skill level requirements are embodied in the ICAO language proficiency rating scale. LEVEL 4 is considered the minimum level of proficiency to ensure an acceptable level of safety. IW-LPT may be used for testing operational (4), extended (5) and expert (6) level. This is the document version Page 5

6 1.1 Requirements Requirement for the Usage of the LPT-System Headset: A headset connected to the computer is required. To record the interview in a good quality, we recommend to install a table microphone. Computer: A standard computer suitable for office purposes. For optimal use we recommend a minimum screen resolution of 1280 x 1024 pixel. Operating system: Windows, Mac OS X Internet connection: We recommend a high speed internet connection for optimal use. The minimal requirement is a bandwidth of 512kBit. Webbrowser: Currently we support the following browsers: Internet Explorer 6 Internet Explorer 7 Internet Explorer 8 Internet Explorer 9 Internet Explorer 10 Internet Explorer 11 Firefox up to the actual version Safari 4 Safari 5 Flash: A functional Adobe Flash Plugin, minimum version 10, is required. Javascript: Javascript must be enabled in the webbrowser. Acrobat Reader For displaying the final documents the Acrobat Reader is required. You can download it for free at the Adobe Homepage. Page 6

7 1.2 IW-LPT and ICAO The philosophy of the software is to give the examiner an easy to use tool according to the ICAO requirements and the specifications of the local authority. Also the final document output will depend on the needs of the examination country. There are no limitations on the number of exams conducted by the LAB/LPE/LPLE. Only exams finished by the candidate are invoiced at the end of the month. To give the examiners and raters some support in rating the exams, the possible answers are also provided in the rating interface. In addiction the LAB can manage their examiners and raters on their own. The software combines the semi-direct testing method as described in ICA O Circula r 318-A N / 180 cha pter 1, and also the capability to rate the interview in direct testing mode as described in ICA O Circula r 318-A N /180 cha pter 1, As a result of this concept the testing method can provide the complete requirements of the ICAO as described in ICA O Circula r 318-A N /180 cha pter 1, The core of the software is the question pool. To guarantee a wide range of testing capabilities we split the pool into eleven sections: Common questions Personal questions ICAO phonetic alphabet Pictures and animations Animations and drawings Personal opinion Accident, incident, occurrence reporting Radiotelephony Radiotelephony emergency situations Aviation operations Standard and emergency situations interactions In the system configuration it is defined, how many questions of each category are provided at least for the test. This ensures a comparable result over a wide range of exams and minimizes the possibility of having two similar exams. For local needs we have designed an interface definition, so that individual questions can be implemented quite easily. We also provide a versioning of the question pool. For guaranteeing an access to the exams for at least ten years we must ensure, that the questions can be replayed as they have been at exam time. Even a change in the rating criteria assignment would cause a new version of the question. The question pool was developed with two level 6 examiners and a LPLE, so the requirements of ICA O Circula r 318-A N /180 cha pter 1, 4.1 to 4.11 and cha pter 2, 1.2 to 1.2 are fulfilled. There is a special logarithm implemented to be able to select classified level 6 questions and also questions related to the pilot s license. We fulfill the needs and comply with principles of good practice and a code of ethics as described in Doc For providing several dialects we use a minimum of four speakers in the question pool. The rating mechanism uses strictly the requirements as described in Page 7

8 ICA O Circula r 318-A N /180 cha pter 2, 1.3 and 3.1. We provide a short demo of the complete software as described in ICA O Circula r 318-A N /180 cha pter 2, 4. Due to security reasons the demo-mode provides only the first question of each category. An examination for english level 6 requires that the student writes a summary (minimum 80 words) on his english competencies. As described in ICA O Circula r 318-A N /180 cha pter 2, and we have implemented some security features to avoid manipulation of the exams. The questions will be selected after the audio check immediately before starting the test. The candidate has to answer all 30 questions without the possibility of a break. An interrupted exam cannot be continued and has to be repeated. The data of the interrupted exam will remain in the system for statistic and audit needs. The backup mechanism as described in ICA O Circula r 318-A N /180 cha pter 2, 4.3 is working automatically in a daily process. All recorded audio data and the whole database is stored on a backup system in our datacenter in Vienna, and also on the backup system in our company. The process is monitored and possible errors would cause a technician to check the systems. The backend of the software are two server systems and a backup mechanism. The main server provides an http-server and a MySql database system. PHP, Javascript and Flash as programming languages ensure an optimal load balance between client and server. The minimum requirements to use the system match to almost every actual office pc. For downward compatibility we also support older browser versions including the outdated Internet Explorer 6. As described in ICA O Circula r 318-A N /180 cha pter 2, 6 the raters must have a valid examiner or LPE license. These licenses are given from the local authority, which is also providing the initial training as well as the rater-, LPLE- and LAB-trainings. The training of the candidates is done by the several raters and LAB s. In Austria the national authority provides the preparation for testing methods as described in ICA O Circula r 323-A N /185 during the rater training. Page 8

9 USER MANUAL Part II Page 9

10 2 Quick usage guide Short Overview of the LPT-System This quick user guide shall help you to start the application without problems. 2.1 Getting started Please log in to the system using the username and password you got from Infowerk. After a successful login switch to the system menu. You will see the main window. In this example the user level is Examiner / Rater. Page 10

11 2.2 Menu items and usage Menu items in the system According to the user level there are up to 4 menu entries available: My Account Examiner / Rater / Admin (LAB Admin only) Candidates LPT My Account These are the actual data of the currently logged in User. You are able to change several personal information, including login name and password. Please ensure, that the Examination Country is selected correctly! Page 11

12 Examiner / Rater / Admin If you are registered as Language Assessment Body, the defined admin of the LAB can insert ( ) and the data of the other members of the LAB. Candidates Before you can start an exam, the candidate must be inserted into the system. Here you can manage the candidates basic data ( Page 12, ).

13 And you can insert and plan a new exam ( You will jump directly to the LPT section. ), with all details. Please make sure you enter the correct licence data, this information will be used as criteria for the questions and also printed on the final PDF. Page 13

14 LPT In this section all information about exams is accessible. Depending on your user level and your login the displayed options may be different. Logged in as Examiner / Rater: You can only see your own exams and those, where you have the role as 2nd examiner. The date behind 'P: ' shows the date of assignment. Logged in as Admin: You can see all exams of the LAB, assign and edit them and finally download the PDF. An admin is not allowed to start examinations. 2.3 Examination Examination in the IW-LPT-System To start an exam you must be logged in as examiner / rater. Ensure to select the correct candidate. Press Page 14 to continue.

15 (Level 6:) Personal assessment First the student has to write a summary (minimum 80 words) on his english competencies. Audio test After starting/continuing, the examination tool starts up. You will be asked by Adobe Flash Player to allow the software to access your microphone. Select to continue. Then you hear a question and you have to answer to check the volume adjustment. Page 15

16 Afterwards you can review to the recording quality. Please ensure, that the volume is high enough and the quality is clear. If necessary, adjust the audio-settings of your computer/headset and the procedure. Accept and start the recording part of the exam After you press You have to Page 16 you will see the screen with the start button. the Declaration of consent to start the recording part.

17 - From this point the exam (question part) is running till the end. - Do not refresh the page or interrupt the exam, there will be no possibility to start again. - Please be patient while loading the questions! The exam (questions) There are 4 different types of questions: pure audio, text, animation and image. In each type the question is spoken. All 30 random questions take about minutes. In the window are several controls: Volume of the spoken question Time display for the duration of the answer The Button If you left the fullscreen mode the button is visible Page 17

18 The exam (interview) After the question part you can start the interview ( ). After installation of the table microphone it is recommended to conduct an audio test (the same as in the question part). The student has to the conditions for conducting at the beginning. - From this point the interview is running till the end. - Do not refresh the page or interrupt the interview, there will be no possibility to start again. - The minimum time is 15 minutes. After this time you can stop the interview. Page 18

19 2.4 1st rating 1st Rating by LPE The LPE can evaluate the questions of the Computer Based Exam (CBE) either before or after the interview. Rating the CBE The colored buttons will guide you through the various actions. They will change according to the state of the exam. - The date/time behind 'S: ' shows the start date and time of the question part. - The date/time behind 'E: ' shows the end date and time of the question part. - The time behind 'D: ' shows the duration of the question part (20-30 minutes). Start the CBE rating procedure Click on the button ( or in a later status ). (Level 6:) Text of personal assessment First you can review the personal assessment written by the student. It can serve as an additional means for the assessment. To rate the questions click on the button on the top. Page 19

20 The CBE Rating The button plays the question, the button plays the recorded answer. For each question you can set the reached proficiency level in each possible category. If you want to set the whole row to a specific value, you can use the preset selectors on the top of the list. A dialogue box will appear. Please select the option you need. Page 20

21 You can leave the rating screen every time, the current state is saved immediately. Finishing the CBE rating When all questions are rated, you will find a button of the main window. at the top You have to conclude the rating before you are able to go ahead in the system. You can not change the rating of a concluded CBE. You can view the details of a concluded CBE-rating by pressing the button and. The ratings are displayed as values and small bars: Page 21

22 Start the interview rating procedure After the CBE is concluded you are able to rate the interview and the holistic descriptors. Click on the button ( or in a later status ). To listen to the interview, use the player on the top right. You can set the reached proficiency level in each possible category and holistic descriptors. At this point the additional language proficiency can be entered also at the right side. Page 22

23 When all is rated, you will find a button at the top of the main window. You can not change the rating of a concluded interview. Finishing If both parts are rated and concluded, you can view the details by pressing the button and. You will be able to download a PDF-sheet "R1" with the results of the 1st rating. This may be different, depending on the several requirements of the different countries. As LPE you have to download the PDF R1 (using the button sign it, scan and upload it as "R1S" using the button ),. The upload dialogue for R1S: Please note, that ACG only accepts forms with the original sign of the first rater. Page 23

24 After an upload you can upload R1S again (in case of mistake) using the button or download your uploaded R1S using the button,. If you upload the R1S-document again the previous document is replaced and not available anymore! 2.5 2nd rating For all exams a 2nd rater is required. Once you have finished your 1st rating, a button appears: Click on it and you will see the access-code. Page 24

25 You have to submit this India Whiskey Code and password to the 2nd rater. He has to be a LPLE. The second rating by a LPLE The second rater (LPLE) can find the appropriate exam by inserting the individual India Whisk ey Code in the right search box. After accepting the exam ( to insert the given password and click on ) he has. The second rater (LPLE) uses the same user interface as the initial rater, without the Holistic Descriptors. (See chapter "1st rating".) To ensure the independent assessment through the LPLE, he can't see the initial assessment of the LPE. After concluding of the CBE and interview rating you are able to view the details of the exam using the button and. Page 25

26 All question ratings are displayed as values and small bars. Here you can compare the rating of the LPE (left bar) with the rating of the LPLE (right bar). Depending on the deviation the bars are highlighted: Page 26

27 Index -LLAB Language Assessment Body licence data 2nd examiner M - -A- Mac additional language proficiency 19 6 main window 10 My Account -C- 11 -Pcandidates Chrome 11 6 personal information Computer 6 conclude 19 concluded -R- 19 Rater -E- 10, 11 Rating 19 Rating the CBE Examiner 19 10, 11 -S- -F- Secretary Finishing the CBE rating Firefox Flash Short Overview T - 6 -H- The CBE rating procedure The INTERVIEW rating Headset W- -I- Webbrowser Internet 19 6 Windows Internet Explorer Introduction JJAR Licence Javascript 11 6 Page 27

28 Printed: in Innsbruck, Austria Page 28