Value of the Online Newspaper Collection at the University of Illinois at Urbana-Champaign Library

Transcription

1 Value of the Online Newspaper Collection at the University of Illinois at Urbana-Champaign Library Kirk Hess, Digital Humanities Specialist Sarah Hoover, History, Philosophy, and Newspaper Library Graduate Assistant University Library University of Illinois at Urbana-Champaign

2 Research Questions How did our patrons access digitized newspaper content in and? Can we develop a reliable metric to measure the relative usefulness of each title and/or aggregator? Utility Cost Quality

3 Online Newspaper Sources Included in Study EbscoHost: Newspaper Source Gale: newspaper and newswire titles from Academic OneFile, Opposing Viewpoints in Context, and Biography in Context LexisNexis Academic: news sources NewsBank: Access World News, Archives of Americana, and World Newspaper Archive ProQuest: newspaper, historical newspaper, and wire feed titles Library PressDisplay

4 Factor One: Utility

5 Measure Most vendors provided COUNTER JR1 reports, which track successful full-text article requests by title LexisNexis does not provide JR1 reports and has its own article-level usage statistics PressDisplay is tracked by issues read rather than by article Filtered by type of content Newspapers Newswires Historical newspapers

6 Vendor-Level Usage

7 Successful Full-Text Article Requests Newspaper Article Requests by Vendor, - This point includes data mining of a number of UK newspaper titles This point includes data mining of the San Jose Mercury News (CA) and San Mateo County Times (CA) This point includes data mining of the Wall Street Journal, Chicago Defender, and Financial Times (London) EbscoHost Gale LexisNexis NewsBank ProQuest

8 Issues Read PressDisplay Usage,

9 Successful Full-Text Article Requests Successful Full-Text Article Requests EbscoHost Usage by Title (Log scale) Individual Titles Individual Titles

10 Successful Full-Text Article Requests Successful Full-Text Article Requests Gale Usage by Title (Log scale) Individual Titles Individual Titles

11 Successufl Full-Text Article Requests Successful Full-Text Article Requests LexisNexis Usage by Title (Log scale) Individual Titles and Aggregate Categories Individual Titles and Aggregate Categories

12 Successful Full-Text Article Requests Successful Full-Text Article Requests NewsBank Usage by Title (Log scale) Individual Titles Individual Titles

13 Successful Full-Text Article Requests Successful Full-Text Article Requests ProQuest Usage by Title (Log scale) Individual Titles Individual Titles

14 Issues Read Issues Read PressDisplay Usage by Title (Log scale) Individual Titles Individual Titles

15 Title Usage by Vendor, - EbscoHost EbscoHost Gale Gale LexisNexis LexisNexis Newsbank Newsbank ProQuest ProQuest PressDisplay PressDisplay Titles with 2 or more requests Titles with 1 request Titles with 0 requests *Source of data for total titles varies by vendor; some title counts post-date the year of usage, thus making the total number of titles with 0 requests an approximation.

16 Title-Level Usage

17 Coverage Notes Coverage ranges for individual titles from different vendors vary ProQuest titles are separated in the graphs into ProQuest and ProQuest Historical based on the designation within ProQuest databases, but there is generally an overlap in coverage: ProQuest Historical: ~19 th century s or 2000s Current ProQuest: ~1980s current Coverage for Gale, LexisNexis, NewsBank generally starts in the 1980s

18 Title-Level Methods and Notes Analysis brought together separate data points for print and online versions as well as varied date ranges from ProQuest Historical titles under a single title heading Variations in vendor naming practices limited the effectiveness of automatic matching for identifying title overlaps Individual newspaper titles within LexisNexis are also part of aggregated sets in LexisNexis, with no data available for article views from individual titles within those sets. Examples include: Major World Publications Combined Newspapers All Full-text English US Newspapers and Wires

19 Successful Full-Text Article Requests Most-Used Newspaper Titles San Jose Mercury News (CA) San Jose Mercury News (CA) San Mateo County Times (CA) San Mateo County Times (CA) The New York Times The New York Times Wall Street Journal Wall Street Journal Chicago Tribune Chicago Tribune PR Newswir e PR Newswir e Chicago Defender Chicago Defender ProQuest Historical ProQuest NewsBank LexisNexis Gale EbscoHost Business Wire Business Wire Washingt on Post Washingt on Post Financial Times (London, England) Financial Times (London, England)

20 Anomalous Activity Rates in Most-Requested Titles, Title Vendor Months of high activity Peak requests in a single month Average requests per month Median requests per month San Jose Mercury News (CA) San Mateo County Times (CA) NewsBank May-July NewsBank May-July New York Times LexisNexis Feb-March PR Newswire ProQuest December Business Wire ProQuest December Financial Times (London) The Times (London) The Guardian (London) NewsBank NewsBank NewsBank March-April March-April March-April Chicago Defender ProQuest May All of these cases appear to represent some degree of data mining. Data mining

21 Anomalous Activity Rates in Most-Requested Titles, Title Vendor Months of high activity Peak requests in a single month Average requests per month Median requests per month Wall Street Journal Chicago Defender Financial Times (London) ProQuest March ProQuest (historical) March ProQuest March PR Newswire ProQuest February Business Wire ProQuest February Los Angeles Sentinel Sacramento Observer ProQuest March ProQuest March All of these cases appear to represent some degree of data mining.

22 Top 20 Titles out of Total Requests, ( requests) Titles not used: ~11520* Next 15 titles: All other titles (~6326*) 36% San Jose Mercury News (CA) 20% PR Newswire 1.40% Chicago Defender 1.39% Business Wire 1.25% Washington Post 1.11% Financial Times (London) 0.98% Los Angeles Times 0.96% The Baltimore Sun 0.73% The Guardian (London) 0.70% The Times (London) 0.57% The News-Gazette 0.57% (Champaign-Urbana, IL) The State Journal-Register 0.46% (Springfield, IL) New York Tribune 0.42% San Francisco Chronicle 0.40% The Daily Telegraph/Sunday 0.35% Telegraph (London) The Daily Mail/Mail on Sunday 0.35% (London) Next 15 titles 12% Chicago Tribune 4% San Mateo County Times (CA) 14% The New York Times 9% Wall Street Journal 5% * These numbers are high, as title de-duplication (both between and within vendors) was done manually for the top 20 titles and could not be accurately done automatically

23 Top 20 Titles out of Total Requests, ( requests) Titles not used: ~12649* Next 15 titles: All other titles (~4742*) 42% Wall Street Journal 22% PR Newswire 1.70% Washington Post 1.63% Los Angeles Times 1.33% New York Tribune 1.07% The State Journal-Register 0.96% (Springfield, IL) The News-Gazette 0.95% (Champaign-Urbana, IL) Business Wire 0.91% The Baltimore Sun 0.84% The Boston Globe 0.70% The Guardian (London) 0.67% Los Angeles Sentinel 0.59% Times of India 0.55% McClatchy-Tribune Business 0.53% News Sacramento Observer 0.50% Sun Reporter (San Francisco) 0.48% Next 15 titles 13% The New York Times 10% Chicago Defender 5% Financial Times (London) 4% Chicago Tribune 4% * These numbers are high, as title de-duplication (both between and within vendors) was done manually for the top 20 titles and could not be accurately done automatically

24 Successful Full-text Article Requests Usage of Top Ten Major US Newspapers (by circulation), The Wall Street Journal The Wall Street Journal The New York Times The New York Times USA Today USA Today Los Angeles Times Los Angeles Times Daily News of New York ProQuest Historical ProQuest NewsBank LexisNexis Average weekday circulation: 2,378,827 1,865,318 1,674, , , , , , , ,930 Circulation statistics: Alliance for Audited Media. Average weekday circulation October -March. Includes digital editions such as those on tablet computers or restricted websites as well as branded editions, which include regional editions or those tailored for commuters. Daily News of New York New York Post New York Post The Washin gton Post Gale EbscoHost The Washin gton Post Chicago Sun- Times Chicago Sun- Times The Denver Post The Denver Post Chicago Tribune Chicago Tribune

25 Top Ten Titles (Successful Full-Text Article Requests) per Vendor, - EbscoHost Newspaper Source, M2PressWIRE 689 Toronto Star 624 USA Today 554 The San Francisco Chronicle (San Francisco, CA) 425 Christian Science Monitor 406 Times, The (United Kingdom) 374 Arabia Washington Post 322 Philadelphia Inquirer, The (PA) 276 Evening Standard 274 Total for all journals: EbscoHost Newspaper Source, M2PressWIRE 498 USA Today 400 Toronto Star 387 Arabia Washington Post 337 Times, The (United Kingdom) 330 Christian Science Monitor 328 All Things Considered (NPR) 209 Morning Edition (NPR) 188 Philadelphia Inquirer, The (PA) 159 Total for all journals: Gale, The New York Times 6964 The Financial Times 270 States News Service 176 PR Newswire 67 The Times (London England) 60 The Washington Post 46 Sunday Times (London England) 39 CNN Wire 31 BBC Monitoring International Reports 15 The Age (Melbourne Australia) 14 Total for all titles: 7855 Gale, The New York Times 6005 States News Service 988 The Financial Times 382 The Times (London England) 231 UWIRE Text 208 Sunday Times (London England) 127 The Hindu (English) 127 International Business Times - US ed. 121 CNN Wire 114 The Washington Post 110 Total for all titles: 9052

26 Top Ten Titles (Successful Full-Text Article Requests) per Vendor, - LexisNexis, The New York Times Major World Publications All Full Text, English News 6123 Combined Newspapers 3046 Miscellaneous 2686 International News, Company Info, Business Opps & Analysis, Country Analysis & Legal Info 2613 The State Journal Register 1041 PR Newswire 833 US News (Papers & Wires) 676 NRC Handelsblad 407 Total for all content: LexisNexis, Major World Publications All Full Text, English News The New York Times 5455 Combined Newspapers 2183 Miscellaneous 1157 Le Monde 692 US News (Papers & Wires) 513 Daily Deal/The Deal 463 Combined Wire Services 280 USA Today 199 Total for all content: NewsBank, San Jose Mercury News (CA) San Mateo County Times (CA) Early American Imprints, Series Early American Imprints, Series II. Shaw-Shoemaker 7416 Financial Times (London, England) 4274 Times, The (London, England) 3215 Guardian, The (London, England) 2998 News-Gazette, The (Champaign-Urbana, IL) 2820 Daily Telegraph, The/The Sunday Telegraph (London, England) 2231 Daily Mail, The / The Mail on Sunday 2194 Total for all titles: Newsbank, Early American Imprints, Series Early American Imprints, Series II. Shaw-Shoemaker 4161 State Journal-Register, The (Springfield, IL) 3686 Undefined 2988 News-Gazette, The: Web Edition Articles (Champaign-Urbana, IL) 1955 News-Gazette, The (Champaign-Urbana, IL) 1660 Chicago Sun-Times (IL) 1212 Targeted News Service (USA) 1199 US Fed News (USA) 931 Tombstone Epitaph Prospector* 758 Total for all titles: *all but four requests from this title are from a single month

27 Top Ten Titles (Successful Full-Text Article Requests) per Vendor, - ProQuest, Wall Street Journal Eastern edition New York Times (1923-Current file) Chicago Daily Tribune ( ) New York Times ( ) 9373 PR Newswire 7589 Business Wire 7584 Chicago Daily Tribune ( ) 5925 Chicago Tribune (1963-Current file) 5658 Wall Street Journal (Online) 5332 Los Angeles Times (1923-Current File) 4867 Total for all titles: ProQuest, Wall Street Journal New York Times (1923-Current file) Financial Times Wall Street Journal (Online) Chicago Daily Defender (Daily Edition) ( ) 9250 PR Newswire 5633 Chicago Daily Tribune ( ) 5361 The Chicago Defender (National edition) ( ) 5216 New York Times ( ) 4916 Los Angeles Times (1923-Current File) 4085 Total for all titles: PressDisplay, (measured by issues read) Chicago Tribune 1090 The Washington Post 455 The Moscow Times 346 The Wall Street Journal Europe 321 South China Morning Post 212 Daily Mail 180 Brasil Economico 167 The Washington Post Sunday 130 Valor Economico 130 USA TODAY US Edition 118 Total for all titles: 4909 PressDisplay, (measured by issues read) Chicago Tribune 774 The Washington Post 220 Brasil Economico 216 NRC Handelsblad 204 The Moscow Times 192 Chicago Sun-Times.com 102 Los Angeles Times 82 USA TODAY International Edition 72 USA TODAY US Edition 67 International New York Times 66 Total for all titles: 3343

28 Usage Rank and Score

29 Usage Score i: row entry n: newspaper title v: vendor

30 Rank score For each month, get rank score for each title For each vendor, get monthly average rank score

31 Usage Score

32 Rank Score

33 Usage Score

34 Rank Score

35 Factor Two: Cost

36 Cost per Use Vendor Use () Cost per Use Rank EbscoHost Newspaper Source $ Gale (Academic OneFile, OVC, Biog; newspaper, newswire formats only) 7855 $ NewsBank (Access World News, World Newspaper Archive, Archives of America) $ LexisNexis Academic (news sources) $ ProQuest (newspapers, newswires, historical newspapers) $ PressDisplay 4909 $2.15 N/A

37 Problems with Cost Analysis EBSCO cost is > $0 Calculating costs for news content within mixed databases: Gale, LexisNexis, and ProQuest Measurement issues: Press Display, LexisNexis Usage statistics calendar year, cost by Fiscal Year Each title or database has a cost in addition to the access fee, which was not calculated Need for more Cost data (FY13 & FY14)

38 Factor Three: Quality

39 Quality How to measure without objective metrics? No Impact Factor Newspapers Journals Current news: circulation? WSJ, NYT have high use, high circulation (#1 & #2) USA Today, NY Daily News, low use, high circulation (#3, #5) Historical news: subjective WSJ, NYT still important news sources Data Mining?

40 Conclusions

41 Findings Measured Utility and Cost, but not Quality. Ranked titles and vendors on usage, vendors on cost Certain titles drive use New York Times, Wall Street Journal Many titles, but most are never used Why so many newspapers are never used? Is something wrong with our discovery systems (SFX)? Should we pay for content which is never used? Some titles are duplicated across vendors Data mining exists: problems, outreach to users? Need to be able to see usage grouped by purchase group vs. individual titles only in order to be able to match the usage with the costs paid COUNTER-like statistics needed for non-journal serials that have articles Need more quality metrics for individual historical newspaper titles Lack of good metadata hinders analysis (identifiers, uniform title, coverage)

42 Next steps Collect 2014 Usage data Coverage analysis Language (spec. non-english) Rank by Quintile (0-4) Improve cost analysis Collect FY13 & FY14 acquisition data Investigate additional costs Rank by Quartile (0-3) Develop Quality metric Consult with faculty/staff to develop list Boolean (0-1) Weighted Value Analysis

43 Literature Breakstone, Elizabeth R Now how much of your print collection is really online? An analysis of the overlap of print and digital holdings at the University of Oregon Law Library. Legal Reference Services Quarterly 29 (4): doi: / x Cheney, Debora.. Text mining newspapers and news content: new trends and research methodologies. Paper presented at: IFLA World Library and Information Congress, August, Singapore. Cooper, Mindy M The importance of gathering print and electronic journal use data: getting a clear picture. Serials Review 33 (3) (September): doi: /j.serrev Way, Doug The impact of web-scale discovery on the use of a library collection. Serials Review 36 (4) (December): doi: /j.serrev Wilson, Jacqueline and Li, Chan. Calculating scholarly journal value through objective metrics. CDLINFO News Wood, Elizabeth H Measuring journal usage: add a survey to the statistics? Journal of Electronic Resources in Medical Libraries 3 (1) (January): doi: /j383v03n01_06. Zappen, Susan H Managing resources to maximize serials access: the case of the small liberal arts college library. Serials Librarian 59 (3/4) (October): doi: /