NEAS ELT Management Conference

Transcription

1 NEAS ELT Management Conference May 2009 Fraser Cargill, Pearson Language Tests

2 Contents Pearson the Not-So New Kid on the Block Pearson s Testing Performance A Snapshot PTE Academic Test Overview Test Items samples Scoring system The PTE Score Scales Score report form Security Verification site Learning resources Questions

3 Pearson The Not-So New Kid on the Block Pearson is an international media company with world leading businesses in education, business information and consumer publishing. Financial Times: global source of business news. Pearson Education: world leading education company. Penguin: adult and children s book publisher.

4 Pearson Education- Global Reach CANADA 652 people EUROPE 1000 people UK 6,500 people ASIA 1,269 people UNITED STATES 16,500 people Pearson Education has offices in 60 countries SOUTH AMERICA 200 people AFRICA 500 people MIDDLE EAST 40 people AUSTRALIA/ NEW ZEALAND 700 people INDIA 600 people

5 Pearson s Testing Capabilities A Snapshot Pearson Educational Measurement - provides state-wide testing services to 30 US states, delivers 3.8 million tests online, scores and reports 40 million multiple choice tests and scores 14 million essays. Edexcel delivered 8.2 million exam scripts in over 85 countries, with 4.3 million marked onscreen using the groundbreaking epen technology. Pearson VUE delivered 6 million secure online tests in more than 4,000 test centres worldwide Pearson Research & Assessments Item development for the NAPLAN in Australia; developed tests in Arabic, English, Maths and Science for the Abu Dhabi Education Council; Jordan development of a national item banking software for final school exams

6 Overview of PTE Academic state-of-the-art and comprehensively field-tested English language proficiency test developed by leading international English language test experts measurement of English language enabling skills (Grammar, Oral Fluency, Pronunciation, Spelling, Vocabulary and Written Discourse) in addition to the four basic English language skills of reading, writing, listening and speaking inclusion of a candidate s speech sample

7 Overview contd... automated scoring, with high correlation to human raters scores, ensuring standardised scoring across countries globally-recognised candidate, test and score security systems testing on-demand with quick turn-around of results 5 days institution score verification site including searchable data bases

8 Test Format

9 Sample Test Items html

10 Pearson s Automated Essay Scoring How does the automated writing scoring work? Use of Intelligent Essay Assessor and Summary Street - automated scoring tools powered by Pearson s state of the art Knowledge Analysis Technologies engine. Use of Latent Semantic Analysis (LSA) a mathematical approach which provides a computer analysis of text based on the correlation between the essay s content and that of training essays previously scored by expert human raters. LSA automatically learns the meaning of words and text through analysis of large text corpora. Invented and refined by Pearson Computer simulation model of semantics of language Widely published & validated - more than 20 years of experience in this field

11 Detailed Score reporting Overall score: Academic English Language Ability (based on performance on all items in the test) Scores for communicative skills: Listening, Speaking, Reading & Writing (based on performance on all items that test one or more of these skills) Scores for enabling skills: Oral Fluency, Grammar, Pronunciation, Spelling, Vocabulary, Written discourse (based on aspects of candidate s language)

12 For example Integrated speaking task (involving both listening & speaking) You will hear a short lecture. After listening to the lecture, in 3 seconds, please speak into the microphone and retell what you have just heard from the lecture in your own words. You will have 40 seconds to give your response. The candidate s response is scored on: Content (if zero, no further scoring) + Vocabulary Vocabulary score + Pronunciation Pronunciation score + Fluency Fluency score = Total Item Score Speaking score Listening score Overall score

13 Alignment with CEF PTE Score Scale Area of highest precision <A1 A1 A2 B1 B2 C1 C2

14 Concordance Estimates PTE Score Scale IELTS TOEFL ibt Admission Range

15 PTE Academic Sample Score Report PTE Academic Draft Score Report.pdf

16 Test Security Security features of test Variety of item types Randomised tests Item banking software No paper versions No access to test material by centre staff

17 Test Centre Security Fully trained and certificated invigilators 3 types of biometrics Digital photograph Digital signature Digital Palm Vein Scanning Video recorded test taking Live incident reporting system Test centre audits by independent assessors

18 PTE Academic Score Verification Website Introducing PTE Academic.htm

19 Resources currently available Test tutorial Official Guide (third review) Test Taker Handbook (English version) FAQs the test, scores, research, test security Score information sheets Overview brochure Various White Papers on PTE Academic

20 The PTE Advantage Features Secure test centers with integrated biometrics Innovative, integrated item types Score report includes more information Test on demand Automated scoring Online practice tests Candidate results 5 days Benefits Confidence in item & identity integrity Authentic measure of skills Improved admissions process Flexible access worldwide Consistent and accurate grading Improved preparation process Improved application process

21 QUESTIONS