Columbia University Digital Library Architecture. Robert Cartolano, Director Library Information Technology Office October, 2009

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Columbia University Digital Library Architecture. Robert Cartolano, Director Library Information Technology Office October, 2009"

Transcription

1 Columbia University Digital Library Architecture Robert Cartolano, Director Library Information Technology Office October, 2009

2 Agenda Technology Architecture Off-site NYSERNet Facility Ingest, curation and support tools Academic Commons - Dspace to Fedora Migration

3 Goal Scale up efforts to catalog, digitize & publish to the Web unique, distinctive collection holdings that have significant value for teaching or research. Design & implement coherent & comprehensive preservation program for ensuring survival & continued accessibility of Libraries digital content. Develop & budget for long-term digital archiving strategy for content created by the Libraries, whether born-digital or converted from analog formats. Collaborate with other stakeholders to develop affordable cooperative solutions to ensure long-term preservation of licensed content. Libraries Strategic Plan,

4 Who Columbia University Libraries/Information Services Digital Program and Technology Services Center for Digital Research and Scholarship Center for New Media Teaching and Learning Copyright Advisory Office Digital Preservation and Conversion Libraries Digital Program Division Library Information Technology Office Columbia University Libraries:

5 Technical Team Ben Armintor Terry Catapano Robert Cartolano Stephen Davis Jack Donovan Sarah Holsted Risa Karaviotis Rebecca Kennison Stuart Marquis Nada O Neal Alberto Ortiz Patricia Renfro James Stuart

6 Questions in 2007 Build a single consolidated system? Digital Library Collections DSpace Academic Commons (institutional repository) Long-term Archive What is storage impact of large-scale digitization? How many copies? What level of offsite storage? What are budget requirements?

7 Requirements Stable, secure storage for large-scale access & longterm preservation Support efficient creation & management of administrative, descriptive, structural, preservation & rights metadata Support object relationships, actions, behaviors Support fine-grained access control policies Administrative tools (eg: statistics, reporting)

8 Key Decision Points Build integrated system to support: Digital Library Collections Academic Commons (institutional repository) Long-term Archive Use Fedora 3 as platform Two copies on disk, two copies on tape Offsite storage Scalable storage Central IT supported infrastructure Sustainable funding

9 Technology Approach Risk Averse - use tried and true technologies Use mature, commodity products as much as possible Choose first-tier vendor (Sun) with sustainable support models, proven reliability, stability Open to maximize sustainability and flexibility Open Data, Open Formats, Open Source, Open Protocols, Open Community Entrance and Exit Strategy Hancock, Mara, UC Berkeley, New Structures and Efficiecies, Exploring New Potential Collaborations in the Field,

10 Technology Storage Technology Sun Storage Archive Manager (SAM) Policy-based, tiered storage approach Released as open source TAR Archive format - no proprietary archive format on disks Commercial support from Sun Access Method NFS access for application use Solaris 10, ZFS Highly reliable, scalable file system model Released as open source Commercial support from Sun

11 Technology SUN Storage Archive Manager (SAM) Platform 70TB effective storage, expandable to 400TB Policy-based, tiered storage, commercial support Two Front-End SAM T5240 Solaris Servers Tier I Disk Cache, 9.6 Terabytes (TB) expandable to 60TB Tier II Disk Storage - 192TB Raw, mirrored for 70TB net storage Tier II Tape Storage - 80TB, expandable to 460TB Four copies - 2 Disk, 2 Tape for Preservation Open as possible to maximize sustainability

12 Storage Architecture Columbia Digital Library Applications Columbia Academic Commons Applications Fedora Servers SAM Servers Disk Cache On-Site Disk Campus Data Center On-Site Tape Campus Data Center Off-Site Disk NYSERNet Data Center Off-Site Tape Off-line, Off-Site Facility Copy 1 Copy 2 Copy 3 Copy 4

13 Offsite: NYSERNet Data Center Colocation facility in Syracuse, NY 24x7x365 support Battery/Diesel Backup Dual-Power Grid High Speed Fiber (adj. to NYSERNet POP) New Machine Room NYSERNet Data Center Overview:

14 Storage Architecture Columbia Data Center New York, NY Campus Private Network 1 Gigabit/sec NYSERNet Data Center Syracuse, New York SUN T5240 SAM Metadata Servers 10TB FC Disk Storage Copy 3) 70TB SATA Offsite Disk Storage Copy 1) 70TB SATA Onsite Disk Storage Copy 2) 80TB Onsite Tape Copy 4) Offline Tape To Offsite Facility

15 Fedora Platform and Library/Information Services Columbia Digital Library Columbia Academic Commons Public facing Library facing Fedora Asset Repository & Long-Term Archive Internal Workflow Management Systems Internal Data Management Systems

16 ! For example: Digitized collections Born-digital collections (eg: spatial data) Online Exhibitions Columbia Digital Library!! For example: Columbia-produced content Rich collaboration spaces Faculty profiles Columbia Academic Commons Public facing Library facing Fedora Asset Repository & Long-Term Archive Internal Workflow Management Systems Internal Data Management Systems! For example: Hypatia, batch ingest tools Digitization workflow Preservation workflow Online exhibition workflow!! For example: Backup Data migration SAM-FS

17 Open Source Benefit Columbia Library/IS staff added capability to Fedora to accept content via locally mounted file system Provide better integration with SAM-FS Patch to be incorporated into Fedora 3.3 Benefit of open source approach make change to meet local requirements, benefit to larger community FCREPO Allow the retrieval of content via the file URI scheme:

18 Progress To Date July thru December 2008 Purchased hardware Completed initial hardware installation Sun professional services, training Finalized Fedora software plan and configuration Completed initial Fedora installation Evaluated multiple tools Revised technology roadmap

19 Progress To Date January thru September 2009 Implemented Academic Commons in Fedora Migrated from DSpace to Academic Commons Built Hypatia cataloging tool for Columbia needs Designing metadata and content models in coordination with Cornell Inventoried and stabilized legacy digital content from hard drives and CDs to staging storage (approx. 8 terabytes) Began metadata remediation of legacy digital assets Began batch ingest of Digital Collections for long-term archive Developed initial requirements for long-term archive

20 Curation Fast Ingest Rate Slow Complexity Complex Assisted Cataloging Full-Service Cataloging Digital Library Cost $$$ Simple None None Automated Self-Service Cataloging Academic Commons $$ $ Low Effort High Derived from: Goble, Carole, University of Manchester, Curating Services and Workflows: the Good, the Bad and the Ugly,

21 Hypatia - Ingest Tool Developed by Columbia Library/IS staff Enables non-programmers to create input forms and workflows for metadata schemas and then catalog items in a secure, controlled environment. Support multiple projects, collections, workflows, with secure, granular access controls, in "Hypatia Spaces." Initial support for Academic Commons: Assisted curation support for Library/IS staff Faculty self-service deposit

22 Hypatia - Ingest Tool

23 !"#$"% &#"'$()#*!+,-./* &#,#0# 1-$2 3+.'#" Admin: Reject with Comments Users: Submit Withdraw Describe, Deposit, Disseminate 4#5(#6 7/9(:% '-9+,#0#;9#0./.0. $#'-$/*;5.,(/.0# )(0"0$#.9*;5#$(<= Hypatia Admin: Approve / Un-Approve 7++$-5# 7/9(:%;A#$(<= $#'-$/*;.""(>: B&";C;'-,,#'D-:;C #E+-$0;0#9+,.0# Admin: Commits 8#/-$. 7F0-9.D'%;G9.(,

24 Academic Commons Migrated from DSpace to Fedora for Fall 2009 Open access to Dspace and Fedora backends very helpful Custom export/import code written to move data in exactly the format we wanted to meet Columbia metadata requirements Multiple iterations and extensive testing Match existing public interface with enhancements Provides foundation to rapidly increase deposits

25 Academic Commons

26 Next Steps Application Development Develop and implement staff digital collection viewer Continue Academic Commons development Continue Hypatia development Expand to support additional media types (eg: video) Research and Development Investigate Fedora administration tools Investigate media servers (eg: djatoka JPEG2000 server) Develop broad strategy for persistent identifiers (eg: handles) Investigate advanced search and discovery for Academic Commons (eg: Blacklight evaluation)

27 Final Thoughts Team collaboration across disparate groups Technology platform is working well for our needs Success with Fedora 3 platform Importance of communications and awareness building

Reference Architectures for Digital Libraries

Reference Architectures for Digital Libraries Reference Architectures for Digital Libraries Keith Rajecki Education Solutions Architect Sun Microsystems, Inc. 1 Agenda Challenges Digital Library Solution Architectures > Open Storage/Open Archive >

More information

Less Code, More Product: Leveraging Open Source Technologies to Develop Digital Library Collections

Less Code, More Product: Leveraging Open Source Technologies to Develop Digital Library Collections Less Code, More Product: Leveraging Open Source Technologies to Develop Digital Library Collections Robert Cartolano, Stephen Davis, Carole Ann Fabian Columbia University April 13, 2015 Digital Preservation

More information

Columbia s Evolving Research Data Storage Strategy

Columbia s Evolving Research Data Storage Strategy An experience/position paper for the Workshop on Research Data Management Implementations *, March 13-14, 2013, Arlington Rajendra Bose, Ph.D., Manager, CUIT Research Computing Services Amy Nurnberger,

More information

Columbia University Libraries / Information Services

Columbia University Libraries / Information Services Stephen Davis, October 28, 2010 Columbia University Libraries / Information Services Digital Asset Management Digital Preservation Digital Publishing Introductions Stephen Paul Davis Director, Libraries

More information

Oracle Content Management and Archiving

Oracle Content Management and Archiving 1 Oracle Content Management and Archiving Donna Harland Principal Product Manager SAM QFS and Archiving Solutions Agenda Archive and Tiered Storage Value What is Oracle Content Management?

More information

2011 FileTek, Inc. All rights reserved. 1 QUESTION

2011 FileTek, Inc. All rights reserved. 1 QUESTION 2011 FileTek, Inc. All rights reserved. 1 QUESTION 2011 FileTek, Inc. All rights reserved. 2 HSM - ILM - >>> 2011 FileTek, Inc. All rights reserved. 3 W.O.R.S.E. HOW MANY YEARS 2011 FileTek, Inc. All rights

More information

Reference Architectures for Repositories and Preservation Archiving

Reference Architectures for Repositories and Preservation Archiving Reference Architectures for Repositories and Preservation Archiving Keith Rajecki Education Solutions Architect Sun Microsystems, Inc. 1 Agenda Challenges Solution Architectures > Open Storage/Open Archive

More information

<Insert Picture Here> Solution Direction for Long-Term Archive

<Insert Picture Here> Solution Direction for Long-Term Archive 1 Solution Direction for Long-Term Archive Donna Harland Oracle Optimized Solutions: Solutions Architect Program Agenda Archive Layers SAM QFS connectivity for

More information

Adding Robust Digital Asset Management to Oracle s Storage Archive Manager (SAM)

Adding Robust Digital Asset Management to Oracle s Storage Archive Manager (SAM) Adding Robust Digital Asset Management to Oracle s Storage Archive Manager (SAM) Oracle's Sun Storage Archive Manager (SAM) self-protecting file system software reduces operating costs by providing data

More information

Digital Asset Management Developing your Institutional Repository

Digital Asset Management Developing your Institutional Repository Digital Asset Management Developing your Institutional Repository Manny Bekier Director, Biomedical Communications Clinical Instructor, School of Public Health SUNY Downstate Medical Center Why DAM? We

More information

Archiving Systems. Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie. uwe.borghoff@unibw.

Archiving Systems. Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie. uwe.borghoff@unibw. Archiving Systems Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie uwe.borghoff@unibw.de Decision Process Reference Models Technologies Use Cases

More information

A Selection of Questions from the. Stewardship of Digital Assets Workshop Questionnaire

A Selection of Questions from the. Stewardship of Digital Assets Workshop Questionnaire A Selection of Questions from the Stewardship of Digital Assets Workshop Questionnaire SECTION A: Institution Information What year did your institution begin creating digital resources? What year did

More information

XenData Video Edition. Product Brief:

XenData Video Edition. Product Brief: XenData Video Edition Product Brief: The Video Edition of XenData Archive Series software manages one or more automated data tape libraries on a single Windows 2003 server to create a cost effective digital

More information

Archive Storage Infrastructure At the Library of Congress September 2015

Archive Storage Infrastructure At the Library of Congress September 2015 Infrastructure At the Library of Congress September 2015 http://www.loc.gov/avconservation/packard/ The Packard Campus Mission The National Audiovisual Conservation Center develops, preserves and provides

More information

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration Solutions Integrated Storage Appliances Management Optimized Storage & Migration Archive Data Retention & Compliance Services Global Installation & Support SECURING THE FUTURE OF YOUR DATA w w w.q sta

More information

THE BRITISH LIBRARY. Unlocking The Value. The British Library s Collection Metadata Strategy 2015-2018. Page 1 of 8

THE BRITISH LIBRARY. Unlocking The Value. The British Library s Collection Metadata Strategy 2015-2018. Page 1 of 8 THE BRITISH LIBRARY Unlocking The Value The British Library s Collection Metadata Strategy 2015-2018 Page 1 of 8 Summary Our vision is that by 2020 the Library s collection metadata assets will be comprehensive,

More information

Key Considerations for Managing Big Data in the Life Science Industry

Key Considerations for Managing Big Data in the Life Science Industry Key Considerations for Managing Big Data in the Life Science Industry The Big Data Bottleneck In Life Science Faster, cheaper technology outpacing Moore s law Lower costs and increasing speeds leading

More information

Functional Requirements for Digital Asset Management Project version 3.0 11/30/2006

Functional Requirements for Digital Asset Management Project version 3.0 11/30/2006 /30/2006 2 3 4 5 6 7 8 9 0 2 3 4 5 6 7 8 9 20 2 22 23 24 25 26 27 28 29 30 3 32 33 34 35 36 37 38 39 = required; 2 = optional; 3 = not required functional requirements Discovery tools available to end-users:

More information

Digital Repository Initiative

Digital Repository Initiative Digital Repository Initiative 01 April 2014 Ray Frohlich Director, Enterprise Systems and Infrastructure with Euan Cochrane Digital Preservation Manager, Preservation Michael Friscia Manager of Digital

More information

Sun Open Archive Framework and Fedora Repository Solutions

Sun Open Archive Framework and Fedora Repository Solutions Sun Open Archive Framework and Fedora Repository Solutions Technical Brief June 2009 Table of Contents Introduction... 3 Archive Crosses Many Industries... 4 Sun Open Archive Framework... 5 Four Layers

More information

PRESERVATION NEEDS ASSESSMENT PRESERVATION 101

PRESERVATION NEEDS ASSESSMENT PRESERVATION 101 Digital Assets If this section is not applicable to the collection(s) being surveyed, please note that here and move to the next section. Digital collections may include born-digital material and digital

More information

ARCHIVE FIRST: AN INTELLIGENT DATA ARCHIVAL STRATEGY, PART 1 OF 3

ARCHIVE FIRST: AN INTELLIGENT DATA ARCHIVAL STRATEGY, PART 1 OF 3 2013 Hitachi Data Systems Corporation. All Rights Reserved. ARCHIVE FIRST: AN INTELLIGENT DATA ARCHIVAL STRATEGY, PART 1 OF 3 PETER SJOBERG, SENIOR DIRECTOR, AMERICAS FILE, CONTENT AND CLOUD SOLUTIONS

More information

Klaus Kempf. Long Term Preservation: Needs and Activities at the Bavarian State Library (BSB) ALA 2010 Washington

Klaus Kempf. Long Term Preservation: Needs and Activities at the Bavarian State Library (BSB) ALA 2010 Washington Klaus Kempf Long Term Preservation: Needs and Activities at the Bavarian State Library (BSB) Agenda BSB s Institutional Profile Munich Digitization Center (MDZ) Current Responsibilities, Milestones, Activities

More information

Solution Brief: Creating Avid Project Archives

Solution Brief: Creating Avid Project Archives Solution Brief: Creating Avid Project Archives Marquis Project Parking running on a XenData Archive Server provides Fast and Reliable Archiving to LTO or Sony Optical Disc Archive Cartridges Summary Avid

More information

Carestream Information Management Solutions. Managing the explosion in patient information

Carestream Information Management Solutions. Managing the explosion in patient information Managing the explosion in patient information Carestream Information Management Solutions Carestream Information Management Solutions The right information in the right place at the right time from the

More information

Implementing a Digital Video Archive Using XenData Software and a Spectra Logic Archive

Implementing a Digital Video Archive Using XenData Software and a Spectra Logic Archive Using XenData Software and a Spectra Logic Archive With the Video Edition of XenData Archive Series software on a Windows server and a Spectra Logic T-Series digital archive, broadcast organizations have

More information

EMC DATA DOMAIN EXTENDED RETENTION SOFTWARE: MEETING NEEDS FOR LONG-TERM RETENTION OF BACKUP DATA ON EMC DATA DOMAIN SYSTEMS

EMC DATA DOMAIN EXTENDED RETENTION SOFTWARE: MEETING NEEDS FOR LONG-TERM RETENTION OF BACKUP DATA ON EMC DATA DOMAIN SYSTEMS SOLUTION PROFILE EMC DATA DOMAIN EXTENDED RETENTION SOFTWARE: MEETING NEEDS FOR LONG-TERM RETENTION OF BACKUP DATA ON EMC DATA DOMAIN SYSTEMS MAY 2012 Backups are essential for short-term data recovery

More information

Planning and Infrastructure for Analog to Digital Preservation Projects

Planning and Infrastructure for Analog to Digital Preservation Projects Planning and Infrastructure for Analog to Digital Preservation Projects Linda Tadic Director of Operations ARTstor lt@artstor.org Why digitize? To preserve and provide access to content : Content that

More information

Implementing a Digital Video Archive Based on XenData Software

Implementing a Digital Video Archive Based on XenData Software Based on XenData Software The Video Edition of XenData Archive Series software manages a digital tape library on a Windows Server 2003 platform to create a digital video archive that is ideal for the demanding

More information

Backup Solutions with Open-E Data Storage Software (DSS V6)

Backup Solutions with Open-E Data Storage Software (DSS V6) Solutions with Open-E Data Storage Software (DSS V6) Software Version: DSS ver. 6.00 up40 Presentation updated: September 2010 Different s opportunities using Open-E DSS The storage market is still growing

More information

TRANSFORMING DATA PROTECTION

TRANSFORMING DATA PROTECTION TRANSFORMING DATA PROTECTION Moving from Reactive to Proactive Mark Galpin 1 Our Protection Strategy: Best Of Breed Performance LEADER HIGH-END STORAGE VMAX Low Service Level LEADER SCALE-OUT NAS STORAGE

More information

The Future of Archive Storage

The Future of Archive Storage Long Term Preservation: The Future of Archive Storage Chris Powers Vice President, HP Storage Change is Constant data growth technologies High Performance long term preservation Near-Line Archive Flash

More information

Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software

Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software The Video Edition of XenData Archive Series software manages one or more automated data tape libraries on

More information

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures 1 Refreshing Your Data Protection Environment with Next-Generation Architectures Dale Rhine, Principal Sales Consultant Kelly Boeckman, Product Marketing Analyst Program Agenda Storage

More information

XenData Product Brief: SX-550 Series Servers for LTO Archives

XenData Product Brief: SX-550 Series Servers for LTO Archives XenData Product Brief: SX-550 Series Servers for LTO Archives The SX-550 Series of Archive Servers creates highly scalable LTO Digital Video Archives that are optimized for broadcasters, video production

More information

Versity 2013. All rights reserved.

Versity 2013. All rights reserved. From the only independent developer of large scale archival storage systems, the Versity Storage Manager brings enterpriseclass storage virtualization to the Linux platform. Based on Open Source technology,

More information

ETERNUS CS High End Unified Data Protection

ETERNUS CS High End Unified Data Protection ETERNUS CS High End Unified Data Protection Optimized Backup and Archiving with ETERNUS CS High End 0 Data Protection Issues addressed by ETERNUS CS HE 60% of data growth p.a. Rising back-up windows Too

More information

Digital Content Management Workflow Task Force

Digital Content Management Workflow Task Force Digital Content Management Workflow Task Force Contents Digital Content Management Workflow Task Force... 1 Background... 1 An Abstract Workflow... 3 Content Types:... 5 Preservation by Content Type...

More information

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007 Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms Cray User Group Meeting June 2007 Cray s Storage Strategy Background Broad range of HPC requirements

More information

SwiftStack Filesystem Gateway Architecture

SwiftStack Filesystem Gateway Architecture WHITEPAPER SwiftStack Filesystem Gateway Architecture March 2015 by Amanda Plimpton Executive Summary SwiftStack s Filesystem Gateway expands the functionality of an organization s SwiftStack deployment

More information

Data Protection. the data. short retention. event of a disaster. - Different mechanisms, products for backup and restore based on retention and age of

Data Protection. the data. short retention. event of a disaster. - Different mechanisms, products for backup and restore based on retention and age of s t o r s i m p l e D a t a s h e e t Data Protection I/T organizations struggle with the complexity associated with defining an end-to-end architecture and processes for data protection and disaster recovery.

More information

OCLC Tools Managing & Preserving Digitised Map Libraries

OCLC Tools Managing & Preserving Digitised Map Libraries Russ Hunt OCLC Tools Managing & Preserving Digitised Map Libraries Keywords: Digital collection management; digital collection access; digital preservation; long term preservation. Summary This paper explains

More information

Achieving Cost-Effective, Vendor-Neutral Archiving For Your Enterprise

Achieving Cost-Effective, Vendor-Neutral Archiving For Your Enterprise Achieving Cost-Effective, Vendor-Neutral Archiving For Your Enterprise How To Merchandise Data for Clinical Use By: Eran Galil, PACS/Archive Product Manager, Carestream Health, BBM JoAnn Linder, RIS/PACS/Archive

More information

The safer, easier way to help you pass any IT exams. Exam : 000-115. Storage Sales V2. Title : Version : Demo 1 / 5

The safer, easier way to help you pass any IT exams. Exam : 000-115. Storage Sales V2. Title : Version : Demo 1 / 5 Exam : 000-115 Title : Storage Sales V2 Version : Demo 1 / 5 1.The IBM TS7680 ProtecTIER Deduplication Gateway for System z solution is designed to provide all of the following EXCEPT: A. ESCON attach

More information

2. TEMPLATE TITLE SLIDE WITH PHOTO

2. TEMPLATE TITLE SLIDE WITH PHOTO NEW! Easily Swap Out the Image StorageTek 5800 system ( Honeycomb ) 2. TEMPLATE TITLE SLIDE WITH PHOTO Breakthrough Solution for Digital Repositories Scott Presenter s Parker Name Solutions Architect Presenter

More information

Optimizing Storage for Better TCO in Oracle Environments. Part 1: Management INFOSTOR. Executive Brief

Optimizing Storage for Better TCO in Oracle Environments. Part 1: Management INFOSTOR. Executive Brief Optimizing Storage for Better TCO in Oracle Environments INFOSTOR Executive Brief a QuinStreet Excutive Brief. 2012 To the casual observer, and even to business decision makers who don t work in information

More information

Scientific Storage at FNAL. Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015

Scientific Storage at FNAL. Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015 Scientific Storage at FNAL Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015 Index - Storage use cases - Bluearc - Lustre - EOS - dcache disk only - dcache+enstore Data distribution by solution

More information

Information Migration

Information Migration Information Migration Raymond A. Clarke Sr. Enterprise Storage Solutions Specialist, Sun Microsystems - Archive & Backup Solutions SNIA Data Management Forum, Board of Directors 1 SNIA DMFs 100 Year Task

More information

Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS.

Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS. National Digital Stewardship Residency - Boston Project Summaries 2015-16 Residency Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS. Harvard Library s Digital

More information

Creating a Catalog for ILM Services. Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel

Creating a Catalog for ILM Services. Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel Creating a Catalog for ILM Services Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel SNIA Legal Notice The material contained in this tutorial is copyrighted

More information

Vodacom Managed Hosted Backups

Vodacom Managed Hosted Backups Vodacom Managed Hosted Backups Robust Data Protection for your Business Critical Data Enterprise class Backup and Recovery and Data Management on Diverse Platforms Vodacom s Managed Hosted Backup offers

More information

WHITEPAPER. A Technical Perspective on the Talena Data Availability Management Solution

WHITEPAPER. A Technical Perspective on the Talena Data Availability Management Solution WHITEPAPER A Technical Perspective on the Talena Data Availability Management Solution BIG DATA TECHNOLOGY LANDSCAPE Over the past decade, the emergence of social media, mobile, and cloud technologies

More information

A Best Practice Guide to Archiving Persistent Data: How archiving is a vital tool as part of a data center cost savings exercise

A Best Practice Guide to Archiving Persistent Data: How archiving is a vital tool as part of a data center cost savings exercise WHITE PAPER A Best Practice Guide to Archiving Persistent Data: How archiving is a vital tool as part of a data center cost savings exercise NOTICE This White Paper may contain proprietary information

More information

Archive Solutions Strategy

Archive Solutions Strategy Archive Solutions Strategy Brought to you by Sun and HMK Joel Kimball VP WW Archive Solutions Sales 11 Agenda Archive facts & figures Strategic importance of archive A solutions approach Customer success

More information

Backup Implementation Proposal

Backup Implementation Proposal Backup Implementation Proposal Document Revision:. 5//6 (wcw) 6 Carnegie Mellon University. All Rights Reserved 1 Ideal Multi-tier backup architecture Tier 1 Tier Tier Backup Server for client machines

More information

IBM System Storage DR550

IBM System Storage DR550 An innovative information-retention solution IBM System Storage DR550 Highlights Repository for all kinds of Offers low TCO by using multiple content structured and storage tiers (disk, tape, unstructured

More information

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand.

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand. IBM Global Technology Services September 2007 NAS systems scale out to meet Page 2 Contents 2 Introduction 2 Understanding the traditional NAS role 3 Gaining NAS benefits 4 NAS shortcomings in enterprise

More information

Virtual Computing Environment Coalition

Virtual Computing Environment Coalition Efficiency. Control. Choice Virtual Computing Environment Coalition Ahmad Muammar Presales Manager-North Gulf EMC Copyright 2009 EMC Corporation. All rights reserved. 1 2 Waves of Information Technology

More information

WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression

WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression Sponsored by: Oracle Steven Scully May 2010 Benjamin Woo IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA

More information

Clodoaldo Barrera Chief Technical Strategist IBM System Storage. Making a successful transition to Software Defined Storage

Clodoaldo Barrera Chief Technical Strategist IBM System Storage. Making a successful transition to Software Defined Storage Clodoaldo Barrera Chief Technical Strategist IBM System Storage Making a successful transition to Software Defined Storage Open Server Summit Santa Clara Nov 2014 Data at the core of everything Data is

More information

IBM Tivoli Storage Manager

IBM Tivoli Storage Manager Help maintain business continuity through efficient and effective storage management IBM Tivoli Storage Manager Highlights Increase business continuity by shortening backup and recovery times and maximizing

More information

Exhibit to Data Center Services Service Component Provider Master Services Agreement

Exhibit to Data Center Services Service Component Provider Master Services Agreement Exhibit to Data Center Services Service Component Provider Master Services Agreement DIR Contract No. DIR-DCS-SCP-MSA-002 Between The State of Texas, acting by and through the Texas Department of Information

More information

Building community clouds to support access to scholarship. Michele Kimpton CEO, DuraSpace Jonathan Markow CSO, DuraSpace

Building community clouds to support access to scholarship. Michele Kimpton CEO, DuraSpace Jonathan Markow CSO, DuraSpace Building community clouds to support access to scholarship Michele Kimpton CEO, DuraSpace Jonathan Markow CSO, DuraSpace Who are we? We are committed to providing open source technologies and services

More information

Developing software to prepare social science research data and code for sharing and preservation

Developing software to prepare social science research data and code for sharing and preservation Developing software to prepare social science research data and code for sharing and preservation Limor Peer Institution for Social and Policy Studies, Yale University Introduction 2 Data sharing Source:

More information

Archiving On-Premise and in the Cloud. March 2015

Archiving On-Premise and in the Cloud. March 2015 Archiving On-Premise and in the Cloud March 2015 Cloud Storage Storage accessed over a network via web services APIs. http://swift.example.com/v1/account/container/object Source: http://docs.openstack.org/admin-guide-cloud/content/objectstorage_characteristics.html

More information

Oracle Reference Architecture and Oracle Cloud

Oracle Reference Architecture and Oracle Cloud Oracle Reference Architecture and Oracle Cloud Anbu Krishnaswamy Anbarasu Enterprise Architect Social. Mobile. Complete. Global Enterprise Architecture Program Safe Harbor Statement The following is intended

More information

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant Backup and Recovery Solutions for Exadata Ľubomír Vaňo Principal Sales Consultant Fundamental Backup and Recovery Data doesn t exist in most organizations until the rule of 3 is complete: Different Media

More information

NetApp Optimizes SharePoint Implementations Date: March 2011 Author: Brian Babineau, Senior Analyst

NetApp Optimizes SharePoint Implementations Date: March 2011 Author: Brian Babineau, Senior Analyst Product Brief NetApp Optimizes SharePoint Implementations Date: March 2011 Author: Brian Babineau, Senior Analyst Abstract: A few years ago, NetApp introduced its first integrated storage and data management

More information

The Australian War Memorial s Digital Asset Management System

The Australian War Memorial s Digital Asset Management System The Australian War Memorial s Digital Asset Management System Abstract The Memorial is currently developing an Enterprise Content Management System (ECM) of which a Digital Asset Management System (DAMS)

More information

M U L T I - T I E R S T O R A G E Joe Little, Electrical Engineering, Stanford University ( revision 1. 0) ABSTRACT

M U L T I - T I E R S T O R A G E Joe Little, Electrical Engineering, Stanford University ( revision 1. 0) ABSTRACT M U L T I - T I E R S T O R A G E Joe Little, Electrical Engineering, Stanford University ( revision 1. 0) ABSTRACT The Electrical Engineering department at Stanford University has often spearheaded the

More information

Bradford Scholars Digital Preservation Policy

Bradford Scholars Digital Preservation Policy DIGITAL PRESERVATION The value of the research outputs produced by staff and research students at the University of Bradford cannot be over emphasised in demonstrating the scientific, societal and economic

More information

W H I T E P A P E R T h e C r i t i c a l N e e d t o P r o t e c t M a i n f r a m e B u s i n e s s - C r i t i c a l A p p l i c a t i o n s

W H I T E P A P E R T h e C r i t i c a l N e e d t o P r o t e c t M a i n f r a m e B u s i n e s s - C r i t i c a l A p p l i c a t i o n s Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com W H I T E P A P E R T h e C r i t i c a l N e e d t o P r o t e c t M a i n f r a m e B u s i n e

More information

Case Study: Centre for e-research (CeRch), King s College London

Case Study: Centre for e-research (CeRch), King s College London Case Study: Centre for e-research (CeRch), King s College London Primary contact for case study: Gareth Knight, Digital Curation Specialist Additional input from: Richard Palmer, System Administrator 1.

More information

Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data

Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data David Minor 1, Reagan Moore 2, Bing Zhu, Charles Cowart 4 1. (88)4-104 minor@sdsc.edu San Diego Supercomputer Center

More information

Metadata Quality Control for Content Migration: The Metadata Migration Project at the University of Houston Libraries

Metadata Quality Control for Content Migration: The Metadata Migration Project at the University of Houston Libraries Metadata Quality Control for Content Migration: The Metadata Migration Project at the University of Houston Libraries Andrew Weidner University of Houston, USA ajweidner@uh.edu Annie Wu University of Houston,

More information

Data Sheet: Archiving Altiris Server Management Suite 7.0 from Symantec Essential server management: Discover, provision, manage, and monitor

Data Sheet: Archiving Altiris Server Management Suite 7.0 from Symantec Essential server management: Discover, provision, manage, and monitor Essential server management: Discover, provision, manage, and monitor Overview Complexity with physical and virtual machine proliferation increases the challenges involved in managing servers. Server administrators

More information

Hitachi Storage Solution for Cloud Computing

Hitachi Storage Solution for Cloud Computing Storage Solution for Cloud Computing Virtual Storage Platform Review Vol. 61 (2012), No. 2 85 Tsutomu Sukigara Naoko Kumagai OVERVIEW: With growing interest in cloud computing driven by major changes in

More information

Factors in Selecting a Digital Asset Management System:

Factors in Selecting a Digital Asset Management System: Factors in Selecting a Digital Asset Management System: Deborah Holmes-Wong, Project Manager University of Southern California Information Services Division Digital Library Federation Spring Forum 2003

More information

Online Storage Replacement Strategy/Solution

Online Storage Replacement Strategy/Solution I. Current Storage Environment Online Storage Replacement Strategy/Solution ISS currently maintains a substantial online storage infrastructure that provides centralized network-accessible storage for

More information

Data Sheet: Server Management Altiris Server Management Suite 7.0 Essential server management: Discover, provision, manage, and monitor

Data Sheet: Server Management Altiris Server Management Suite 7.0 Essential server management: Discover, provision, manage, and monitor Essential server management: Discover, provision, manage, and monitor Overview Complexity with physical and virtual machine proliferation increases the challenges involved in managing servers. Server administrators

More information

Combining Onsite and Cloud Backup

Combining Onsite and Cloud Backup Combining Onsite and Cloud Backup How businesses of all sizes can protect growing volumes of data and their bottom line Copyright Acronis, Inc., 2002 2012 ompanies of all sizes are dealing with large and

More information

Backup and Recovery Solutions for Exadata. Cor Beumer Storage Sales Specialist Oracle Nederland

Backup and Recovery Solutions for Exadata. Cor Beumer Storage Sales Specialist Oracle Nederland Backup and Recovery Solutions for Exadata Cor Beumer Storage Sales Specialist Oracle Nederland Recovery Point and Recovery Time Wks Days Hrs Mins Secs Secs Mins Hrs Days Wks Data Loss (Recovery Point Objective)

More information

Make the Most of Big Data to Drive Innovation Through Reseach

Make the Most of Big Data to Drive Innovation Through Reseach White Paper Make the Most of Big Data to Drive Innovation Through Reseach Bob Burwell, NetApp November 2012 WP-7172 Abstract Monumental data growth is a fact of life in research universities. The ability

More information

Media Cloud Building Practicalities

Media Cloud Building Practicalities Media Cloud Building Practicalities MEDIA-TECH Hamburg May 2012 Damien Bommart Director - Product Marketing www.fpdigital.com Agenda Front Porch Digital DIVASolutions Family What is a Media Content Storage

More information

The Key Elements of Digital Asset Management

The Key Elements of Digital Asset Management The Key Elements of Digital Asset Management The last decade has seen an enormous growth in the amount of digital content, stored on both public and private computer systems. This content ranges from professionally

More information

Backup of NAS devices with Avamar

Backup of NAS devices with Avamar Backup of NAS devices with Avamar Extremely fast / no load Video describing NAS backup using Avamar based on this ppt: https://youtu.be/swg1ejldgmw The most fresh version of this document, you will find

More information

Long-term preservation activities of the Bavarian State Library

Long-term preservation activities of the Bavarian State Library Long-term preservation activities of the Bavarian State Library Latest challenges and developments aêk=qüçã~ë=tçäñjhäçëíéêã~åå=== aáöáí~ä=iáäê~êó=aéé~êíãéåí g~åì~êó OSI=OMNM The Bavarian State Library

More information

Digital Assets Repository 3.0. PASIG User Group Conference Noha Adly Bibliotheca Alexandrina

Digital Assets Repository 3.0. PASIG User Group Conference Noha Adly Bibliotheca Alexandrina Digital Assets Repository 3.0 PASIG User Group Conference Noha Adly Bibliotheca Alexandrina DAR 3.0 DAR manages the full lifecycle of a digital asset: its creation, ingestion, metadata management, storage,

More information

September 2009 Cloud Storage for Cloud Computing

September 2009 Cloud Storage for Cloud Computing September 2009 Cloud Storage for Cloud Computing This paper is a joint production of the Storage Networking Industry Association and the Open Grid Forum. Copyright 2009 Open Grid Forum, Copyright 2009

More information

COAR-SPARC CONFERENCE 2015 Organizational Models for Research Data Management Services. Gerald Beasley Wednesday, April 15 th, 2015 Porto, Portugal

COAR-SPARC CONFERENCE 2015 Organizational Models for Research Data Management Services. Gerald Beasley Wednesday, April 15 th, 2015 Porto, Portugal COAR-SPARC CONFERENCE 2015 Organizational Models for Research Data Management Services Gerald Beasley Wednesday, April 15 th, 2015 Porto, Portugal Hydra North UAL s Next Generation Digital Asset Management

More information

STORAGE CENTER. The Industry s Only SAN with Automated Tiered Storage STORAGE CENTER

STORAGE CENTER. The Industry s Only SAN with Automated Tiered Storage STORAGE CENTER STORAGE CENTER DATASHEET STORAGE CENTER Go Beyond the Boundaries of Traditional Storage Systems Today s storage vendors promise to reduce the amount of time and money companies spend on storage but instead

More information

BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything

BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything BlueArc unified network storage systems 7th TF-Storage Meeting Scale Bigger, Store Smarter, Accelerate Everything BlueArc s Heritage Private Company, founded in 1998 Headquarters in San Jose, CA Highest

More information

White Paper. What is IP SAN?

White Paper. What is IP SAN? White Paper What is IP SAN? Introduction Internet Protocol, or IP, has grown to become the most widely used telecommunications standard worldwide. The technology is well understood, easy to implement and

More information

Solution Brief: Archiving Avid Interplay Projects using NLT and XenData

Solution Brief: Archiving Avid Interplay Projects using NLT and XenData Solution Brief: Archiving Avid Interplay Projects using NLT and XenData Contents 1. Introduction to the Open Interplay Archive 2. Solution Benefits 3. System Architecture 4. How to Archive and Restore

More information

<Insert Picture Here> Infrastructure as a Service (IaaS) Cloud Computing for Enterprises

<Insert Picture Here> Infrastructure as a Service (IaaS) Cloud Computing for Enterprises Infrastructure as a Service (IaaS) Cloud Computing for Enterprises Speaker Title The following is intended to outline our general product direction. It is intended for information

More information

Digital Asset Management in Museums

Digital Asset Management in Museums Digital Asset Management in Museums Workflows and Integration Chris Hoffman (chris.hoffman@berkeley.edu) Research IT, UC Berkeley Introductions Definitions o o Outline How they digital asset management

More information

DXi Accent Technical Background

DXi Accent Technical Background TECHNOLOGY BRIEF NOTICE This Technology Brief contains information protected by copyright. Information in this Technology Brief is subject to change without notice and does not represent a commitment on

More information

Constant Replicator: An Introduction

Constant Replicator: An Introduction Data Availability Storage Software Constant Replicator: An Introduction Configurations, Applications and Solutions of Constant Replicator A White Paper A Constant Data Technology Document August 2004 Copyright

More information

Large Scale Storage. Orlando Richards, Information Services orlando.richards@ed.ac.uk. LCFG Users Day, University of Edinburgh 18 th January 2013

Large Scale Storage. Orlando Richards, Information Services orlando.richards@ed.ac.uk. LCFG Users Day, University of Edinburgh 18 th January 2013 Large Scale Storage Orlando Richards, Information Services orlando.richards@ed.ac.uk LCFG Users Day, University of Edinburgh 18 th January 2013 Overview My history of storage services What is (and is not)

More information

Archiving A Dell Point of View

Archiving A Dell Point of View Archiving A Dell Point of View Dell Product Group 1 THIS POINT OF VIEW PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED

More information