EuropeanaConnect Multilinguality Survey

Transcription

1 EuropeanaConnect Multilinguality Survey Nicola Ferro & Vivien Petras Workshop at ICSD 2009 Trento, Italy 9 September 2009 Background EuropeanaConnect Task 2.1 User studies & multilingual resources use: Accompany ongoing work to provide focus in the development of multilingual features Provide guidances on user preferences Requirements & best practices for multilingual access Methods: User interviews Analyzing operational multilingual systems (Workshop!) Survey

2 Development of survey Identification of themes regarding multilingual access Development of queries within the different themes Several iterations of drafts Editing and evaluation of proper survey questions by Silvia Gabrielli, FBK Available for online use by University of Padua Library Centre (CAB) Online location: uality-questionnaire username = europeana_mlia / password = europeana Administration of survey / test runs June 2009 Librarians: 25 (not discussed today) PhD students / researchers at the TrebleCLEF summer school: 24 2 highly biased groups: More experience with digital libraries More experience with multilingual retrieval issues Analysis of results & discussion here should feed into reediting / improving the survey for Europeana users

3 Survey structure 7 themes 23 questions Multiple choice Most restricted to one selection, some multiple selections possible Alternative options: asking for specification Comments section in the end Survey themes User profile incl. native & other languages and DL use Multilingual content interaction Multilingual user interface Information access and retrieval Multilingual information retrieval Multilingual query formulation & expansion Multilingual results presentation

4 Survey questions User profile incl. native & other languages and DL use 1. Age 2. Country 3. Occupation 4. Native language 5. Other languages and skill 6. Activities performed in non-native language 7. Familiarity with dl services Survey questions Multilingual content interaction 9. Experience with ml contents in several genres / media 10. Frequency of tasks dealing with ml content Multilingual user interface 10. Preference of Europeana interface in native language 11. Mode of language switch for Europeana interface Information access and retrieval 12. Search functionalities 13. Ranking options

5 Survey questions Multilingual information retrieval 14. Interest in ml retrieval results 15. Interest in ml browsing subject headings Multilingual query formulation & expansion 16. Use of language selection option 17. Language selection option for more than 1 language 18. Translation of named entities 19. Control over ml retrieval process Survey questions Multilingual results presentation 20. Presentation order of ml results 21. Filtering options by language of results 22. Translation of results 23. Translation expectations

6 Preliminary results TrebleCLEF survey 24 participants CLIR researchers & students TrebleCLEF survey Native language Arabic 1 Basque 1 Dutch 1 English 1 Finnish 2 French 3 German 2 Greek 1 Italian 4 Malay 1 Persian 1 Romanian 2 Russian 1 Spanish 2 Vietnamese 1

7 TrebleCLEF survey Known languages English: good excellent: 22 French: basic 6, good very good 6 German: basic 3, good very good 3 Italian: 4; Spanish: 3 Activities in Foreign languages Reading: Often 11, Always 12 Speaking: Often 11, Sometimes 6, Always 6 Writing: Often 13, Always 6 Thinking: Often 10, Sometimes 8 1 Person: Neve TrebleCLEF Survey: DL Services

8 TrebleCLEF Survey: Expected Search Functionalities TrebleCLEF Survey: Expected Ranking

9 TrebleCLEF survey: Multilingual User Interface I'm happy to use English in research-related activities I'm fine with English. It feels awkward and funny to me have translated interfaces sometimes English if fine for me I always use English interface even if the interface in my native language is available. The reason for that is that anyway almost all development is done in English and thus there are no translation delays or errors. I prefer all my interfaces in English TrebleCLEF Survey: Results in Multiple Languages

10 TrebleCLEF Survey: Subject Headings Browsing TrebleCLEF Survey: Multilingual Querying

11 TrebleCLEF Survey: Multilingual Authority TrebleCLEF Survey: Multilingual Result Ranking

12 TrebleCLEF Survey: Multilingual Result Translation Discussion Survey questions Results Options for improvement