Overview The Corpus Nederlandse Gebarentaal (NGT; Sign Language of the Netherlands)

Transcription

1 Overview The Corpus Nederlandse Gebarentaal (NGT; Sign Language of the Netherlands) Short description of the project Discussion of technical matters relating to video Our choice for open access, and how this is implemented Future developments BAAL 2007 Symposium The emergence of corpus sign language linguistics, 6 Sept Onno Crasborn & Inge Zwitserlood Department of Linguistics / Centre for Language Studies (CLS) Radboud University Nijmegen Two-year project until May 2008 Funding from the Netherlands Organisation for Scientific Research (NWO) k"220 (k 150) Six people working part-time on data recording & annotation (2.0 fte) Two people doing everything else (us; parttime, 0.8 fte) 50 pairs! 100 participants male, female age regions Technology Types of data Introduction Cartoons Event Picture stories Spot-the-difference Discussion on SL / CI Size Average recording session: 3-4 hours Useable clips: ± 1.5 hours Total number of clips: >2.000 Total disk space required: ± 2TB Storage Hosting, archiving & backups: MPI for Psycholinguistics, Nijmegen Camera setup: two on each signer HDV (high resolution HD) for body, DV (standard PAL resolution) for top Compression (converting HDV to MPEG-4/H.264 is still a challenge) Advantages of HD recordings: high resolution may be useful for seeing more phonetic detail no separate camera recording the face is necessary MPEG-1 cutouts of face and body can be made for use with ELAN

2 ***Illustrate the setup we used: plaatje HDV-body en DV-top HD: 1920 x 1080 scale to 352x288 (MPEG-1) scale to 352 x 288 (MPEG-1) Cameras and recording format number of horizontal lines 288p MPEG-1 tape (max. 64 min.) 576i DV-PAL DVD hard disk (> 7 hours) memory card 720i 720p 1080i50 HD 1080p25... recording medium camera recording format DV > MPEG-2: 720 x 576 Cameras and recording format Corpus NGT: low-budget, 2006 number of horizontal lines 288p MPEG-1 tape (max. 60 min.) 576i DV-PAL DVD hard disk (max. 7 hours) memory card 720i 720p 1080i50 HD 1080p25... recording medium camera recording format Information on Internet open access public access open content free content streaming DRM wiki-model user management Creative Commons open source copyleft file sharing public domain Open Access to the Corpus NGT All movies, annotations and metadata are freely accessible through the web Scientific access: all data can be accessed by a web browser, and can be searched by their IMDI metadata description (standardised) and the available ELAN annotations (not standardised) General public: available via web, examples No registration or password needed Licensing: Creative Commons Creative Commons licenses Goal: explicitly allow use of copyrighted material Three types of restrictions: 1. Mention author s name 2. Do not use for commercial purposes 3. Do not modify or: if you do, share under the same conditions From all rights reserved to please use, but don t do x and y

3 CreativeCommons.org Authored material in a new age Internet allows easy sharing and easy access, but also unwanted copying and abuse 1998: extension of duration of US copyright laws CC: copyright is OK, but use and reuse should be promoted rather than discouraged Harvard & Stanford legal experts designed a internetadapted reference to copyright laws (2001) More than 20 different translations available, all taking into account national laws but staying close to the original Dutch version: 2004 CreativeCommons.org Advantages: regular national copyright laws are what the licenses refer to / extend the various national translations stay close to the US original, so that a world-wide standard is coming about the promotion of such a common standard will ease the acceptance and awareness among Internet users Different versions: detailed legal text detailed legal text in machine-readable form layman version CC for sign language corpora License for the Corpus NGT Should derivative works be allowed (1) or not (2, ND), or only under the condition that it is published under the same conditions (3, SA)? Use of the work in a collection is always permitted and does not count as a derivative work, translation does. But how about using a selection of a video clip? You cannot prevent abuse, and it will be hard to take legal action when necessary General moral rights to the good name of the creator and signer still apply What counts as commercial use? Specific commercial uses can still be negotiated or allowed (e.g. inclusion of clips on commercial dictionary DVDs) BY, NC, SA for all movies and annotation files BY for all other documents (manuals etc.) A brief segment at the beginning and end of each movie clip is used to refer to the text of the license (URI) and to the project of which the movie forms a part (URI) no direct reference to the authors (Crasborn & Zwitserlood) no reference to the names of the signers For the average user reference to a special project web site ( would be convenient, but maintenance is hard to guarantee. Hosting of (sign) language data 1. Archiving data 2. Making movies and related material available ELRA: European Language Resources Association LDC: Linguistic Data Consortium MPI: Max Planck Institute for Psycholinguistics Your university s web server Any internet provider Hosting of (sign) language data 1. Archiving data 2. Making movies and related material available ELRA: European Language Resources Association LDC: Linguistic Data Consortium MPI: Max Planck Institute for Psycholinguistics 3. Guaranteeing backups (!) 4. Taking care of conversions to future formats for video, annotations and metadata Your university s web server Any internet provider

4 Expected future developments Use for non-scientific purposes Integration of existing lexicon corpora and Corpus NGT Extension of materials by others (annotations, content; wiki wiki) Technological developments Inclusion of stories in L2 teaching materials Use of sentence examples in lexicons Discussions on deaf issues may contribute to teaching deaf culture Use as bed time stories for children et cetera improved searching and data mining tools integration of additional types of data (e.g. cyber glove, eye tracker) in future data sets Automatic annotation Scientific use General public Corpus Nederlandse Gebarentaal (Corpus NGT) Events Click on a number to open a movie of signers from a particular region. A G R S V o Code: Color: 0001 Man, 0001 Woman 0001 several persons What more could one wish for?! Corpus Nederlandse Gebarentaal (Corpus NGT) 0014 Amsterdam region Nederlandse vertaling: (English translation) W: Hey, hey! Wait a moment, hey, wait a moment, hey! A different one. Wait, it's nothing, hey! Will you notice! I know, when I was born and grew up, I always liked to bite my nails, I was always biting my nails and chewing them. I would tear off a nail and chew it and bite my nails. I grew up and got married. My husband saw me, well, biting my nails...well, I begged him: If I'm nervous I like to bite my nails. It's difficult. Well, anyway. I was married, it was all right, never mind. Much later, the dentist pulled all my teeth out. Oh, my teeth! I got false teeth to put in instead. OK, it felt alright. Fortunately, then biting my nails was no longer possible! I didn't manage to bite my nails anymore! It didn't! I said to my husband: Hey, I can't bite my nails any longer! My teeth are no good any longer. I'm so nervous! Very good, long nails are good! he said. Look! That's it! Well. Your turn. M: I...This is funny. I always just love a good laugh. I know that. W: I also like to laugh. M: I like a good laugh, me. W: Laugh, yes, me. M: It was in a train station. I was waiting for a train. There the train came in and stopped. I got into the train. There was a sign saying the train went to Rotterdam. " Event Collaboration with organisations and institutes in the Netherlands: exploiting the existing corpus Collaboration with MPI for development of corpus tools Collaboration with sign language colleagues throughout Europe (and elsewhere): establish standards and compare languages! Funding needed! "

5 Onno Crasborn: Inge Zwitserlood: