Building Authorities with Crowdsourced and Linked Open Data in ProMusicDB

Transcription

1 Building Authorities with Crowdsourced and Linked Open Data in ProMusicDB Kimmy Szeto Baruch College, City University of New York Christy Crowl ProMusicDB Metropolitan Library Council Annual Conference January 15, 2014, 12:15 PM

2 Authority Control

3 Name/Title Authorities NAME TITLE TITLE TITLE TITLE TITLE

4 Roles and Relationships RDA Appendix I o Relationship Designators: Relationships between a Resource, and Persons, Families, and Corporate Bodies Associated with the Resource is to be used in only bibliographic records. PCC Guidelines for RDA Appendix I Relationship Designators. Guideline 12. o Appendix I relationship designators should not be used in a name/title access point tagged MARC or , or in a name/title linking field tagged MARC 76X-78X.

5 Roles and Relationships Library of Congress RDA Refresher Training o Special Topics: Relationship Designators in RDA Name Authority Records (NARs), Slide 4

6 Roles and Relationships?

7 Name/Title Authorities NAME NAME WORK / EXPRESSION TITLE TITLE TITLE TITLE TITLE TITLE WORK / EXPRESSION TITLE TITLE TITLE TITLE

8 Bibframe Model

9 Data Sourcing/Processing OCLC TITLE NAME LC Authority TITLE NAME German Authority TITLE NAME DBpedia TITLE NAME WORK / EXPRESSION MATCH DISAMBIGUATE NAME TITLE LEARN TITLE / REPEAT TITLE NAME

10 Recombinant Data

11 Musicians Names

12 Before promusicdb: Quincy Jones DBpedia Library of Congress Discogs

13 promusicdb.org The Smithsonian of music credits. Kimmy Szeto, Baruch College, City University of New York Christy Crowl, ProMusicDB Contact: Fiscal Sponsor Proudly endorsed by The Music Library Association, EIDR.org, SAG-AFTRA, and The American Federation of Musicians, Los Angeles

14 promusicdb Stakeholders, Use Cases & Artifacts Vocal Keyboard Sound Eng. Proj. Mgrs, Contractors Live Sound Recording Music MetaData SourcesMPerforming Performance Artists Non- Performing Management & Support Shared Content Video File, Audio File Digital Product Online Content, Airplays Personal Webpage, Social Media Streaming Services WikiPedia Links Name Var. Archival & Cataloging Info DBPedia Credits Name Var. Discogs/ MusicBrainz Licensing PRO Participant info Performer Unions Work Associated with Standard IDs. ISNI ID for BD BD Registry (EIDR) Music Library, Music Schools

15 promusicdb.org The Smithsonian of music credits. Kimmy Szeto, Baruch College, City University of New York Christy Crowl, ProMusicDB Contact: Crowdsourced and Linked Open Data January 15, 2014

16 promusicdb Vocal Keyboard Sound Eng. Proj. Mgrs, Contractors Live Sound Recording Music Metadata of today = MUSIC HISTORY TOMORROWMPerforming Performance Artists Non- Performing Management & Support Shared Content Video File, Audio File DIGITAL ARCHIVE Online Content, Airplays Personal Webpage, Social Media Streaming Services WikiPedia Links Name Var. Archival & Cataloging Info DBPedia Credits Name Var. Discogs/ MusicBrainz Licensing PRO Participant info Performer Unions Work Associated with Standard IDs. ISNI ID for BD BD Registry (EIDR) Music Library, Music Schools

17 promusicdb CHALLENGE: Developing the complexity of interconnecting technology necessary to link music metadata collected from authoritative and verifiable individual and organizational professional music sources in order to create a standardized digital reference resource that can answer basic and simple questions with accuracy regarding the history of musical works and musicians, their live and recorded performances, and their relationships to other musical works and/or musicians. (Who performed, What they performed, Where they performed, and When).

18 AnalyticsA I promusicdb: The Smithsonian of music credits. Live Per. Projects Upcoming events, Multimedia Content Born Digital Entities OCLC# MADSRDF LC Bio WikiPedia Links Name Var. Credits Name Var. ISNI # Name Var. Member Info Composer Publisher Participant info Music Professional BD Registry (EIDR) Music Library DBPedia Discogs/ MusicBrainz ISNI PRO Performer Unions PromusicDB MP Plug-in PromusicDB BD Plug-in PromusicDB ML Plug-in PromusicDB DBP Plug-in PromusicDB MB Plug-in PromusicDB ISNI Plug-in PromusicDB PRO Plug-in PromusicDB Union Plug-in PromusicDB Import Control PromusicDB UI Research and education Verified archival Consumer product enrichment PromusicDB Data Access Control PromusicDB Digital Identity Governance PromusicDB Unique Identifier (artists, born digital work, events) access Name variation info GAPI (artist names, song names, event names) Project info (studio recording, session details) Licensing info (copyrights, royalties..) Influence/derivation info (original, performances, live, remix) Standard IDs (ISNI, OCLC,..) Membership info (performing unions,..) Standards classification (genre, credits, media type, work type) PromusicDB Streaming Services

19 MetaData Source Breakdown: - Who has Authentic and Verifiable Music Credit Metadata? - Is there a music metadata standard in relation to credits? promusicdb

20 promusicdb Are any sources Comprehensive in regard to the life cycle of a musician s career or musical work? LC MediaNet WorldCat AllMusic DDEX HFA RIAA ISNI ASCAP BMI SoundExchange Standard Data Partner PRO

21 promusicdb Where do existing Authentic Metadata sources fit in the Recording Artist/Musician life cycle?

22 promusicdb Where do existing Authentic Metadata sources fit in the Musical Work life cycle?

23 promusicdb Comprehensive, Authentic, Verified, and Standardized Unique identifier Artists/performers, born digital work, events Name variation information Artist/performer names, song names, event names Professional music project information studio recording, session details, timeline Licensing information copyrights, writers, publishers Influence/derivation information original, performances, live, remix, academic works and performances Standard IDs ISNI, OCLC, LC, WorldCat Membership information performing unions, PRO Standards classification genre, credits, media type, work type Analytics Statistics, trends and insights Airplays, fan activity, influence tracking (professional, academic, cultural), trending music professionals (not just lead artists), genre, events, locations, etc.

24 Strategies for creating a digital credit standard and repository to accurately preserve music history Problem: Multiple identities promusicdb Strategy: Digital Identity Governance Problem: Incomplete, inaccurate, fragmented information Strategy: Professional Music Credit Management System Problem: Lack of interoperability across systems due to different systems, standards, models and workflows Strategy: Interoperability and Harmonization Problem: Inability to track transactions and trends Strategy: Integrated Analytics

25 Music LibraryIVerified promusicdb Technical Workflow Digital Identity Governance: Authentication of Name via ID Providers (Registration Agents) Music Professional Claiming Name/Credit ISNI ISNI # User Supplied Info Lookup Authentication response Performer Unions PRO PromusicDB Verification Confirmation Yes? Name Authority File No Register for new ID with ID Providers Register Music Professional and Generate Unique ID ID ProvidersP D

26 promusicdb Technical Workflow Digital Identity Governance: Authentication of Name via ID Providers (Registration Agents)

27 promusicdb Technical Workflow Unique ID Generator Logic: Name or Event Type Identifier 1=Name 5=Event 2 nd Identifier Random 3 rd Identifier Random Random 4 th Identifier Random 5 th Identifier

28 PName Authority File promusicdb Technical Workflow Verification of Credit Claims Music Professional Claiming Name/Credit ISNI ID SAG-AFTRA member # ISNI SAG-AFTRA Input Type Request AFM member # AFM PRO member # PRO Published Author ID Music Library PromusicDB Film or TV Title EIDR EIDR#! Unverified Claim No Verified? Reply Yes Verified Claim

29 promusicdb Technical Workflow Verification of Credit Claims

30 promusicdb Technical Workflow Multi-Level Verification Process Music Professional Claiming Name/Credit PromusicDB Unverified Claim Level 1 Colleagues worked on same project Level 2 Verified by Colleagues Music Metadata Services Level 3 Verified with Music Metadata Sources International Identifiers Level 4 PROs and Unions Verified with relevant International Identifiers Level 5 Verified by Unions & PROs

31 promusicdb Technical Workflow Professional Music Project Information Music Professionals Upload Refer Contracts & Agreements PromusicDB Project Template Update PromusicDB Project Sheets PromusicDB Project Plug-in Render Schedule & Call Sheets PromusicDB Project View Photographs, Blog Posts, Reports etc.

32 promusicdb Technical Workflow Provenance Tracking Music Professional/ Project Artifacts PromusicDB Update Music Professional/ Project Artifacts PromusicDB Project Plug-in Music Provenance Tracking Music Professional/ Project Artifacts PromusicDB Provenance Plug-in Render Music Professional/ Project Artifacts Professional music projects by various groups over period of time PromusicDB Influence Chart

33 promusicdb OCLC# MADSRDF LC Music Library Data to be imported Technical Workflow WorldCat Integration Information Content Metadata Material Type, Document Type, All Authors / Contributors, OCLC Number, Notes, Performer, Description Linked Data library:oclcnum, ProductTypeOntologyClass, SchemaOrgClass, madsrdf:is Identified By Authority, LC Classification, FAST Authority File, Dewey Decimal Classification, VIAF PromusicDB ML Plug-in Plug-in to facilitate query access Plug-in Requirement Query Access to WorldCat Imported data Transformed data Transformations Transformations needed WorldCat to class names in ProMusicDB schema Genre, artists, works merge ProMusicDB Transformed data merged in ProMusicDB Information incorporated in ProMusicDB Content Metadata Classification as per MADSRDF, LC IDs OCLC #, DOI,..

34 promusicdb Technical Workflow Metadata Integration Overview

35 promusicdb Technical Workflow Standardization and Compliance

36 promusicdb Technical Workflow Standardization and Compliance - DDEX

37 Before promusicdb: Quincy Jones DBpedia Library of Congress Discogs

38 promusicdb: Wireframe - 1

39 promusicdb: Wireframe - 2

40 promusicdb: Wireframe - 3

41 promusicdb: Wireframe - 4

42 promusicdb: Wireframe - 5

43 promusicdb: Wireframe - 6

44 promusicdb: Wireframe - 7

45 promusicdb: the legacy of Quincy Jones

46 promusicdb: the legacy of Quincy Jones User experience video

47 promusicdb.org The Smithsonian of music credits. Contact: Fiscal Sponsor Proudly endorsed by The Music Library Association, EIDR.org, SAG-AFTRA, and The American Federation of Musicians, Los Angeles

48 promusicdb Enabling Technologies Semantic Web Technologies Ontology Engineering and Ontology Mapping Semantic Query and Reasoning Machine Learning and Data Mining Technologies Named-entity recognition Database, Data Integration and Analytics Technologies NoSQL technologies Extract, Transform, Load (ETL) techniques Data Provenance Social Network Analysis Techniques Community recognition Social Recommendations Collaboration graph

49 promusicdb Semantic Web Technologies Ontology Engineering To describe concepts, properties and relationships of various elements in music industry Music professionals, Organizations, Events, Genres, Media Types, etc. Ontology Mapping To establish relationship across concepts defined in existing relevant schemas, vocabularies and ontologies MADSRDF, LC, WorldCat, Schema.org, ISNI, dbpedia, DDEX, Musicbrainz, etc. Semantic Query and Reasoning To discover implied relationships among instances To facilitate advanced search and retrieval

50 promusicdb Machine Learning and Data Mining Technologies Named-Entity Recognition To recognize people, places, events, concepts etc. from text Text Similarity To identify and establish name variations Data Mining To discover new trends, insights from data

51 promusicdb Database, Data Integration and Analytics Techniques NoSQL Technologies To facilitate massive amount of data sets To facilitate support for graph, time-series and transactional data Extract, Transform and Load (ETL) To facilitate integration of data from multiple data sources on regular intervals Data Provenance To track provenance of data on people, work, events

52 promusicdb Social Network Analysis Technologies Collaboration Graph To establish collaboration relationships among music professional Community Detection and Recognition To identify communities in the network of music professionals To identify recognition of individuals in the network of music professionals Influence Detection To identify and establish influence of individuals in community Social Recommendations To facilitate recommendations based on interests, collaboration and community participation

53 promusicdb.org The Smithsonian of music credits. Contact: Fiscal Sponsor Proudly endorsed by The Music Library Association, EIDR.org, SAG-AFTRA, and The American Federation of Musicians, Los Angeles