SCFS: A Shared Cloud-backed File System
|
|
- Dennis Moses Hunter
- 8 years ago
- Views:
Transcription
1 USENIX Annual Technical Conference 2014 SCFS: A Shared Cloud-backed File System Alysson Bessani, Ricardo Mendes, Tiago Oliveira, Nuno Neves, Miguel Correia, Marcelo Pasin*, Paulo Veríssimo University of Lisbon - Portugal * now at University of Neuchatel - Switzerland 1
2 Cloud-backed Storage Personal Storage Services (e.g., DropBox, OneDrive) DropBox System Amazon EC2 and S3 Cloud-backed File Systems (e.g., BlueSky, S3FS) Proxy Cloud Storage 2
3 State of the Art 3
4 Shared Cloud-backed File System (SCFS) Client-based Use existing cloud services Cloud Storage DATA DATA Pay-per ownership Each client pays for its own files SCFS Agent SCFS Agent SCFS Agent Strong Consistency Controlled sharing Access control for security and concurrency Redundant Cloud Services 4
5 SCFS Design 5
6 Design Choices Data layout/access pattern Each file is an object (single-block file) Multiple versions of the files are maintained Always write, avoid reading (exploiting free writes) Cache Persistent file cache Local storage is used to hold copies of all/most client files Opened files are also maintained in main-memory Short lived main-memory metadata cache To deal with bursts of metadata requests 6
7 Design Choices Consistency Consistency-on-close semantics Control of durability and consistency Locks used to avoid write-write conflicts Modular coordination Separate data from metadata Metadata is stored in a coordination service E.g., Zookeeper [ATC 10], DepSpace [EuroSys 08] Also used for managing file locks 7
8 SCFS Architecture Coordination Service Lock Service Access Control Metadata Computing clouds SCFS Agent Cache SCFS Agent Cloud storage Storage clouds Cache SCFS Agent Cache 8
9 Consistency 9
10 Strong vs Weak Consistency x.write(v) x.read() è v x.read() è v Strong Consistency (e.g., Paxos-based Systems, Azure Storage) x.write(v) x.read() è? x.read() è v Weak Consistency (e.g., Amazon S3, Rackspace Files) 10
11 Consistency Anchor Problem: How to provide strong consistency on top of weak consistent storage clouds? Composite Storage write Algorithm read strong consistency write read write weak consistency Storage Service strong consistency Consistency Anchor read Key property: the composite storage consistency is the same of the consistency anchor 11
12 Consistency Anchor in SCFS If x is cached, it is only validated! READ fd = open( x, );!! Local Storage Coordination read(fd, );! write(fd, );! 1 2 Service Main Memory! 2 fsync(fd);! Cloud(-of-Clouds)! write(fd, );!! close(fd);! Persistent Storage WRITE 1! 12
13 Implementation and Evaluation 13
14 traces with 1 milared [33]. Without end is that it removes any dependence of a single cloud provider, relying instead on a quorum of providers. It ld require 1 million means that data security is ensured even if f out-of 3f +1 of 1GB of storage of the cloud providers suffer arbitrary faults, which encompasses unavailability and data deletion, corruption or ple is 1KB, assum- 50 thousand tuples creation [15]. SCFS Although cloud Backends providers have their means needed, requiring a to ensure the dependability of their services, the recurring more importantly, occurrence of outages, security incidents (with internal or educe substantially SCFS external can origins) use different and data corruptions backends [19, 24] justifies the tion service, allow- need for this sort of backend in several scenarios. i.e., different cloud storage and a coordination service plugin user-space file syspper to connect the Overall, the SCFS f commented Java ce or storage back- FS in Java mainly e coordination and nd the high latency using a Java-based SCFS% Agent% AWS%Backend% DS% EC2( S3( BFT$SMaRt* SCFS% Agent% DepSky* CoC%Backend% Operation: blocking, non-blocking and non-sharing Figure 5: SCFS with Amazon Web Services (AWS) and Cloudof-Clouds (CoC) backends. Coordination services. The current SCFS prototype sup- DS% DS% DS% DS% RS( WA( GS( S3( 14
15 The Cloud-of-Clouds Backend Figure 6 shows how a file is securely stored in the cloud-of-clouds backend of SCFS using DepSky (see [15] for details). The procedure works as follows: (1) a random key K is generated, (2) this key is used to encrypt the Does not require trust on any single cloud provider file and (3) the encrypted file is encoded and each block is stored in different clouds together with (4) a share of K, obtained through secret sharing. Stored data security (confidentiality, integrity and availability) is ensured by the fact that no single cloud alone has access to the data SCFS works correctly as long as less than a third of the providers misbehave SCFS Agent Cache DepSpace/BFT-SMaRt [EuroSys 08, DSN 14] DepSky CoC Storage [ACM ToS 13] since K can only be recovered with two or more shares and that quorum reasoning is applied to discover the last version written. In the example of the figure, where a single faulty cloud is tolerated, two clouds need to be accessed to recover the file data. 1. gen. key File Data Client% 2. encrypt 4. secret sharing 3. erasure coding Storage%Services% RS( 1 WA( Figure 6: A write in SCFS using the DepSky protocols. 4 Evaluation 2 GS( 3 S3( 4 15 popular open sou and S3FS [6]. Mo system (LocalFS sure a fair compa much better perf all SCFS variants set to 500 ms and ternative configu AWS CoC Blocki SCFS-AW SCFS-Co Table 2: SCFS v 4.2 Micro-b We start with quential reads, s writes, create fil marks are IO-in or close operati intensive. Table 3 systems. The results for show that the beh ilar, with the exc
16 Sharing Latency: SCFS vs DropBox DATA Rackspace Files #! Google Storage?$ DATA DATA Latency (s) Windows Azure Blob % Amazon S3 90% value 50% value CoC-B CoC-NB AWS-B AWS-NB Dropbox CoC-B CoC-NB AWS-B AWS-NB Dropbox DATA CoC-B CoC-NB AWS-B AWS-NB Dropbox 256K 1M 4M 16M Data Size CoC-B CoC-NB AWS-B AWS-NB Dropbox Non-blocking Blocking Figure 10 marks consi ferent perce user. Recall (100%), wit nario. As e of private fi improves. F shared mo 16 study we ar marks decre
17 The benchmark follows the behavior observed in traces cesses to the coordination ser of a real system, which are similar to other modern desktop applications [25]. Typically, the files managed by the file in this system takes aroun the lock files used in this wor with s cloud-backed file system are just copied to a temporary from the usability point ingofth vi is observed in the SCFS-*-B lated as described in [25]. Nonetheless, as can be seen in of a lock file makesmore the system Desktop the benchmark definition Applications (Figure 7), these actions (especially save) still impose a lot of work the file system. We observed that most of file to be pushed to the cloud of blo manipulation of locktially files. Ho Open Action: 1 open(f,rw), 2 read(f), 3-5 open-write-close(lf1), % open-read-close(f), 9-11 open-read-close(lf1) not need to be stored in the SC Save Action: 1-3 open-read-close(f), 4 close(f), 5-7 open-readclose(lf1), 8 delete(lf1), 9-11 open-write-close(lf2), open- ing service already prevents limitaw 40% concurrent lock clients. files We modi read-close(lf2), 15 truncate(f,0), open-write-close(f), 19- sent an application that Shari writes 21 open-fsync-close(f), open-read-close(f), 25 open(f,rw) just to avoid conflicts betwe Close Action: 1 close(f), 2-4 open-read-close(lf2), 5 delete(lf2) 80% ten us machine. The (L) variants i Figure 7: File system operations invoked in the file synchronization benchmark, simulating an OpenOffice document open, 11 CoC ingread/writes the lock files makes the with such local lock files. Th save and closeopen actions (f is the odt file and25 lf isopen a lock file). Save 20 more responsive. The takeaw Save Figure 8 shows Closethe average latency of each of the three of blocking cloud-backed fil 15 Close be av actions of our benchmark for SCFS, S3QL and S3FS, considering a file of 1.2MB, which corresponds to the aver- limitations of accessing remo tially improved if application 10 5 age file size observed in 2004 (189KB) scaled-up 15% per Sharing files. Personal clo year to reach the expected value for [11]. ten used for sharingdropb AWS CoC CoC S3QL files AWS CoC S3FS (NS) way [20]. We designed an 2.5 dedup Open 25 2 Open Non-blocking the time it takes for a share Save 20 Save Blocking 1.5 Close 15 Close be available for reading by (a) Non-blocking. 0.5 *-{NB,B}. We did the sam 5 (b) Blocking. 0 0 Dropbox shared folder illustr (cre Figure 7: File system operations invoked in the file synchronization benchmark, simulating an OpenOffice document open, save and close actions (f is the odt file and lf is a lock file). Benchmarking (Unmodified) directory on the local file system where they are manipu- Figure 8 shows the average latency of each of the three actions of our benchmark for SCFS, S3QL and S3FS, considering a file of 1.2MB, which corresponds to the average file OpenOffice size observed in 2004 (189KB) scaled-up 15% per Writer year to reach the expected value for 2013 [11]. Latency (s) S3QL S3QL(L). CoC-NS CoC-NS(L). CoC-NB CoC-NB(L) AWS-NB(L) AWS-NB Latency (s). S3QL S3QL. CoC- CoC-. CoC- CoC- AWS- AWS- Latency (s) Latency (s). AWS AWS S3FS(L) S3FS. CoC-B(L) CoC-B. AWS-B(L) AWS-B CoC CoC. S3F S3F machi way [2 the tim *-{NB sign [2
18 Financial Evaluation VM Instance EC2 EC2 4 CoC Capacity Large $6.24 $24.96 $ M files Extra Large $12.96 $51.84 $ M files (a) Operation costs/day and expected coordination service capacity. Cost/op (microdollar) read CoC read AWS read CoC write AWS write write File size (MB) (b) Cost per operation (log scale). Cost/day (microdollar) CoC AWS File size (MB) (c) Cost per file per day. +50% Figure 11: The (fixed) operation and (variable) usage costs of SCFS. The costs include outbound traffic generated by the coor- 18 Complex proxies) a coordin lock man port stron a cloud-o Cloud-o ified) clo described techniqu avoid ve in the pas DepSky [ ing and B
19 Wrap Up SCFS is a cloud-backed file systems that can be used for backup, disaster recovery and sharing data Key design principles: Always write, avoid reading (very cheap in terms of $$$) Strong consistency (despite storage cloud weak consistency) Experience so far Multi-cloud replication is feasible (CoC not slower!) This is a case for BFT crash-only solution will not make things better Being employed for sharing dataset metadata among Biobanks 19
20 Timeline of this work Summer 2011 initial idea for two MsCs October 2012 MsCs concluded November Demo at the 2 nd TClouds FP7 project review April 2013 first submission (C2FS) September 2013 second submission January 2014 third submission 20
21 Thanks! SCFS code available at DepSky and DepSpace/BFT-SMaRt also available
SCFS: A Shared Cloud-backed File System
SCFS: A Shared Cloud-backed File System Alysson Bessani, Ricardo Mendes, Tiago Oliveira, and Nuno Neves, Faculdade de Ciências and LaSIGE; Miguel Correia, INESC-ID and Instituto Superior Técnico, University
More informationSharing Files Using Cloud Storage Services
Sharing Files Using Cloud Storage Services Tiago Oliveira, Ricardo Mendes, and Alysson Bessani {toliveira,rmendes}@lasige.di.fc.ul.pt, bessani@di.fc.ul.pt Universidade de Lisboa, Faculdade de Ciências,
More informationDepSky Dependable and Secure Storage in a Cloud-of-Clouds Alysson Bessani, Miguel Correia, Bruno Quaresma, Fernando André, Paulo Sousa
epsky ependable and Secure Storage in a Cloud-of-Clouds Alysson Bessani, Miguel Correia, Bruno Quaresma, Fernando André, Paulo Sousa University of Lisbon, Faculty of Sciences 1 Moving to Clouds ata is
More informationRecent Advances in Cloud
Recent Advances in Cloud Computing Dependability pjv@di.fc.ul.pt Paulo Veríssimo http://www.di.fc.ul.pt/~pjv joint work with: Alysson Bessani, Miguel Correia, Pedro Costa, Bernhard Kauer, Marcelo Pasin,
More informationOutline. Clouds of Clouds lessons learned from n years of research Miguel Correia
Dependability and Security with Clouds of Clouds lessons learned from n years of research Miguel Correia WORKSHOP ON DEPENDABILITY AND INTEROPERABILITY IN HETEROGENEOUS CLOUDS (DIHC13) August 27 th 2013,
More informationD2.2.4 Adaptive Cloud-of-Clouds Architecture, Services and Protocols
D2.2.4 Adaptive Cloud-of-Clouds Architecture, Services and Protocols Project number: 257243 Project acronym: Project title: TClouds Start date of the project: 1 st October, 2010 Duration: Programme: Deliverable
More informationBiobankCloud a PaaS for Biobanking
The PaaS for Biobanking A Platform-as-a-Service as a for Biobanking www.biobankcloud.com b Presented by: Paulo Esteves Veríssimo Univ. de Lisboa, Faculdade de Ciências (FCUL), LaSIGE, Portugal, pjv@di.fc.ul.pt
More informationSecure Framework for Data Storage from Single to Multi clouds in Cloud Networking
Secure Framework for Data Storage from Single to Multi clouds in Cloud Networking B.Sujana 1, P.Tejaswini 2, G.Srinivasulu 3, Sk.Karimulla 4 1,2,3,4 QUBA COLLEGE OF ENGINEERING & TECH, NELLORE Abstract:
More informationKeywords-Cloud, backup, Storage, PVFS2, SAN. 1. INTRODUCTION
Storage and Backing Up Of Data in a Cloud Environment Using File System Shruti Sigi M.tech Student Dept of Computer Science and Eng LAEC Bidar EMAIL ID: shrutisigi35@gmail.com Nirupama Sheelwant Assistant
More informationCloud Sync White Paper. Based on DSM 6.0
Cloud Sync White Paper Based on DSM 6.0 1 Table of Contents Introduction 3 Product Features 4 Synchronization 5 Architecture File System Monitor (Local change notification) Event/List Monitor (Remote change
More informationData Storage in Clouds
Data Storage in Clouds Jan Stender Zuse Institute Berlin contrail is co-funded by the EC 7th Framework Programme 1 Overview Introduction Motivation Challenges Requirements Cloud Storage Systems XtreemFS
More informationHow swift is your Swift? Ning Zhang, OpenStack Engineer at Zmanda Chander Kant, CEO at Zmanda
How swift is your Swift? Ning Zhang, OpenStack Engineer at Zmanda Chander Kant, CEO at Zmanda 1 Outline Build a cost-efficient Swift cluster with expected performance Background & Problem Solution Experiments
More informationThe State of Cloud Storage
205 Industry Report A Benchmark Comparison of Speed, Availability and Scalability Executive Summary Both 203 and 204 were record-setting years for adoption of cloud services in the enterprise. More than
More informationFIT-aware. T owards scheduling policies. Cloud Computing. for Vinicius Vielmo Cogo Marcelo Pasin 1/30
FIT-aware T owards scheduling policies Cloud Computing for Vinicius Vielmo Cogo Marcelo Pasin 1/30 The Motivation: Cloud Computing managers deal with large amounts of globally distributed resources. 2/30
More informationIMPLEMENTING DATA SECURITY IN MULTI CLOUD
IMPLEMENTING DATA SECURITY IN MULTI CLOUD Ms. Renu Nagendra Shinde Information Technology SKNCOE Pune 41,India renunikhilp@gmail.com Prof. Mrs. Varsha Khandekar Information Technology SKNCOE Pune 41, India
More informationOutline. Failure Types
Outline Database Management and Tuning Johann Gamper Free University of Bozen-Bolzano Faculty of Computer Science IDSE Unit 11 1 2 Conclusion Acknowledgements: The slides are provided by Nikolaus Augsten
More informationSecure Cloud Computing with FlexCloud
Department of Computer Science Institute of Systems Architecture Chair of Computer Networks Secure Cloud Computing with FlexCloud Dr.-Ing. Anja Strunk DAAD Summer School CTDS 2012 Sousse, Tunisia 07.09.2012
More informationCloud Computing Trends
UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered
More informationHow To Use Arcgis For Free On A Gdb 2.2.2 (For A Gis Server) For A Small Business
Esri Middle East and Africa User Conference December 10 12 Abu Dhabi, UAE Understanding ArcGIS in Virtualization and Cloud Environments Marwa Mabrouk Powerful GIS capabilities Delivered as Web services
More informationMassive Data Storage
Massive Data Storage Storage on the "Cloud" and the Google File System paper by: Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung presentation by: Joshua Michalczak COP 4810 - Topics in Computer Science
More informationA Resilient Protection Device for SIEM Systems
A Resilient Protection Device for SIEM Systems Nuno Neves University of Lisboa, Portugal http://www.di.fc.ul.pt/~nuno Work with: Alysson Bessani, Miguel Garcia, Eric Vial, Ricardo Fonseca, Paulo Veríssimo
More informationA Multi-Cloud based Approach to Enhance Data Security and Availability in Cloud Storage
A Multi-Cloud based Approach to Enhance Data Security and Availability in Cloud Storage Siva Rama Krishna T. a, * Dr. A. S. N. Chakravarthy a, Naveen Kumar G. b a Department of Computer Science and Engineering,
More informationIntroduction to Windows Azure Cloud Computing Futures Group, Microsoft Research Roger Barga, Jared Jackson,Nelson Araujo, Dennis Gannon, Wei Lu, and
Introduction to Windows Azure Cloud Computing Futures Group, Microsoft Research Roger Barga, Jared Jackson,Nelson Araujo, Dennis Gannon, Wei Lu, and Jaliya Ekanayake Range in size from edge facilities
More informationConfiguring Apache Derby for Performance and Durability Olav Sandstå
Configuring Apache Derby for Performance and Durability Olav Sandstå Database Technology Group Sun Microsystems Trondheim, Norway Overview Background > Transactions, Failure Classes, Derby Architecture
More informationMIGRATION FROM SINGLE TO MULTI-CLOUDS TO SHRIVEL SECURITY RISKS IN CLOUD COMPUTING. K.Sireesha 1 and S. Suresh 2
IJCITP Volume.8* Number 2* December 2013, pp. 53-58 Serials Publications MIGRATION FROM SINGLE TO MULTI-CLOUDS TO SHRIVEL SECURITY RISKS IN CLOUD COMPUTING K.Sireesha 1 and S. Suresh 2 1 M.Tech. Student,
More informationInside Dropbox: Understanding Personal Cloud Storage Services
Inside Dropbox: Understanding Personal Cloud Storage Services Idilio Drago Marco Mellia Maurizio M. Munafò Anna Sperotto Ramin Sadre Aiko Pras IRTF Vancouver Motivation and goals 1 Personal cloud storage
More informationMeeting Management Solution. Technology and Security Overview. 10012 N. Dale Mabry Hwy Suite 115 Tampa, FL 33618 800-274-5624 Ext 702
Meeting Management Solution Technology and Security Overview 10012 N. Dale Mabry Hwy Suite 115 Tampa, FL 33618 800-274-5624 Ext 702 Technology SaaS Software as a Service is offered as well. Client may
More informationCUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com
` CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS Review Business and Technology Series www.cumulux.com Table of Contents Cloud Computing Model...2 Impact on IT Management and
More informationDistributed File System. MCSN N. Tonellotto Complements of Distributed Enabling Platforms
Distributed File System 1 How do we get data to the workers? NAS Compute Nodes SAN 2 Distributed File System Don t move data to workers move workers to the data! Store data on the local disks of nodes
More informationCloud Computing: Meet the Players. Performance Analysis of Cloud Providers
BASEL UNIVERSITY COMPUTER SCIENCE DEPARTMENT Cloud Computing: Meet the Players. Performance Analysis of Cloud Providers Distributed Information Systems (CS341/HS2010) Report based on D.Kassman, T.Kraska,
More informationSimple Storage Service (S3)
Simple Storage Service (S3) Amazon S3 is storage for the Internet. It is designed to make web-scale computing easier for developers. Amazon S3 provides a simple web services interface that can be used
More informationCompanies are moving more and more IT services and
Adding High Availability to the Cloud Paul J. Holenstein Executive Vice President Gravic, Inc. Companies are moving more and more IT services and utility applications to public clouds to take advantage
More informationSHARPCLOUD SECURITY STATEMENT
SHARPCLOUD SECURITY STATEMENT Summary Provides details of the SharpCloud Security Architecture Authors: Russell Johnson and Andrew Sinclair v1.8 (December 2014) Contents Overview... 2 1. The SharpCloud
More informationDemystifying the Cloud Computing 02.22.2012
Demystifying the Cloud Computing 02.22.2012 Speaker Introduction Victor Lang Enterprise Technology Consulting Services Victor Lang joined Smartbridge in early 2003 as the company s third employee and currently
More informationCloud Service Model. Selecting a cloud service model. Different cloud service models within the enterprise
Cloud Service Model Selecting a cloud service model Different cloud service models within the enterprise Single cloud provider AWS for IaaS Azure for PaaS Force fit all solutions into the cloud service
More informationEnhancing Coordination in Cloud Infrastructures with an Extendable Coordination Service
Enhancing Coordination in Cloud Infrastructures with an Extendable Coordination Service Tobias Distler 1, Frank Fischer 1, Rüdiger Kapitza 2, and Siqi Ling 1 1 Friedrich Alexander University Erlangen Nuremberg
More informationApproaches for Cloud and Mobile Computing
Joint CLEEN and ACROSS Workshop on Cloud Technology and Energy Efficiency in Mobile Communications at EUCNC 15, Paris, France - 29 June, 2015 Interoperable Data Management Approaches for Cloud and Mobile
More informationEXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1.
CONTENTS 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix EXECUTIVE SUMMARY Tenzing Managed IT services has recently partnered with Amazon Web Services
More informationDistributed Data Stores
Distributed Data Stores 1 Distributed Persistent State MapReduce addresses distributed processing of aggregation-based queries Persistent state across a large number of machines? Distributed DBMS High
More informationData Centers and Cloud Computing. Data Centers
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationAssignment # 1 (Cloud Computing Security)
Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual
More informationHow To Write A Blog Post On Dropbox
Inside Dropbox: Understanding Personal Cloud Storage Services Idilio Drago Marco Mellia Maurizio M. Munafò Anna Sperotto Ramin Sadre Aiko Pras IMC 2012 Boston Motivation and goals 1/14 Personal cloud storage
More informationService Level Agreement for Windows Azure operated by 21Vianet
Service Level Agreement for Windows Azure operated by 21Vianet Last updated: November 2015 1. Introduction This Service Level Agreement for Windows Azure (this SLA ) is made by 21Vianet in connection with,
More informationLeveraging Public Clouds to Ensure Data Availability
Systems Engineering at MITRE CLOUD COMPUTING SERIES Leveraging Public Clouds to Ensure Data Availability Toby Cabot Lawrence Pizette The MITRE Corporation manages federally funded research and development
More informationTowards Trustworthy Clouds
IBM Research Zurich Christian Cachin 12 September 2013 Towards Trustworthy Clouds 2009 IBM Corporation Cloud computing? 2 Cloud services are convenient No investment cost Pay only for consumption Scalable
More informationAmazon Cloud Storage Options
Amazon Cloud Storage Options Table of Contents 1. Overview of AWS Storage Options 02 2. Why you should use the AWS Storage 02 3. How to get Data into the AWS.03 4. Types of AWS Storage Options.03 5. Object
More informationStretching A Wolfpack Cluster Of Servers For Disaster Tolerance. Dick Wilkins Program Manager Hewlett-Packard Co. Redmond, WA dick_wilkins@hp.
Stretching A Wolfpack Cluster Of Servers For Disaster Tolerance Dick Wilkins Program Manager Hewlett-Packard Co. Redmond, WA dick_wilkins@hp.com Motivation WWW access has made many businesses 24 by 7 operations.
More informationfiles without borders
files without borders exploring Internet-connected storage for research Fabio Hernandez fabio@in2p3.fr IN2P3 / CNRS computing center, Lyon, France FJPPL compu+ng workshop, Lyon, March 11th 2015 2 Preamble
More informationDatabase Replication with MySQL and PostgreSQL
Database Replication with MySQL and PostgreSQL Fabian Mauchle Software and Systems University of Applied Sciences Rapperswil, Switzerland www.hsr.ch/mse Abstract Databases are used very often in business
More informationEverything you need to know about flash storage performance
Everything you need to know about flash storage performance The unique characteristics of flash make performance validation testing immensely challenging and critically important; follow these best practices
More informationA Legal and Technical Perspective on Secure Cloud Storage
A Legal and Technical Perspective on Secure Cloud Storage Sebastian Graf, Jörg Eisele and Marcel Waldvogel University of Konstanz Marc Strittmatter HTWG Konstanz Cloud Services from a customers point of
More informationCloud Computing Is In Your Future
Cloud Computing Is In Your Future Michael Stiefel www.reliablesoftware.com development@reliablesoftware.com http://www.reliablesoftware.com/dasblog/default.aspx Cloud Computing is Utility Computing Illusion
More informationOn the Efficiency of Durable State Machine Replication
On the Efficiency of Durable State Machine Replication Alysson Bessani, Marcel Santos,João Felix, Nuno Neves, Miguel Correia { FCUL/LaSIGE, INESC-ID/IST}, University of Lisbon Portugal Abstract State Machine
More informationAzure VM Performance Considerations Running SQL Server
Azure VM Performance Considerations Running SQL Server Your company logo here Vinod Kumar M @vinodk_sql http://blogs.extremeexperts.com Session Objectives And Takeaways Session Objective(s): Learn the
More informationA Trustworthy and Resilient Event Broker for Monitoring Cloud Infrastructures
A Trustworthy and Resilient Event Broker for Monitoring Cloud Infrastructures Diego Kreutz, António Casimiro, Marcelo Pasin LaSIGE, Faculty of Sciences, University of Lisbon, Portugal kreutz@lasige.di.fc.ul.pt,
More informationECE6130 Grid and Cloud Computing
ECE6130 Grid and Cloud Computing Howie Huang Department of Electrical and Computer Engineering School of Engineering and Applied Science Cloud Computing Hardware Software Outline Research Challenges 2
More informationDatabase as a Service (DaaS) Version 1.02
Database as a Service (DaaS) Version 1.02 Table of Contents Database as a Service (DaaS) Overview... 4 Database as a Service (DaaS) Benefit... 4 Feature Description... 4 Database Types / Supported Versions...
More informationCS2510 Computer Operating Systems
CS2510 Computer Operating Systems HADOOP Distributed File System Dr. Taieb Znati Computer Science Department University of Pittsburgh Outline HDF Design Issues HDFS Application Profile Block Abstraction
More informationCS2510 Computer Operating Systems
CS2510 Computer Operating Systems HADOOP Distributed File System Dr. Taieb Znati Computer Science Department University of Pittsburgh Outline HDF Design Issues HDFS Application Profile Block Abstraction
More informationAgeneral truism is that SharePoint environments
by Colin Spence DECEMBER 2012 Migrating SharePoint Environments to the Cloud Ageneral truism is that SharePoint environments are only as valuable as the data that they contain. A Share- Point environment
More informationLecture 11. RFS A Network File System for Mobile Devices and the Cloud
Lecture 11 RFS A Network File System for Mobile Devices and the Cloud Yuan Dong, Jinzhan Peng, Dawei Wang, Haiyang Zhu, Fang Wang, Sun C. Chan, Michael P. Mesnier Advanced Operating Systems January 4th,
More informationCloud computing in a nutshell
Segurança na Nuvem da Confidencialidade à isponibilidade dos ados Miguel Correia Trabalho conjunto com Alysson Bessani, Francisco Rocha, P. Sousa, B. Quaresma, F. André, S. Abreu Jornadas Técnicas de Computação
More informationBerkeley Ninja Architecture
Berkeley Ninja Architecture ACID vs BASE 1.Strong Consistency 2. Availability not considered 3. Conservative 1. Weak consistency 2. Availability is a primary design element 3. Aggressive --> Traditional
More informationPractical Data Integrity Protection in Network-Coded Cloud Storage
Practical Data Integrity Protection in Network-Coded Cloud Storage Henry C. H. Chen Department of Computer Science and Engineering The Chinese University of Hong Kong Outline Introduction FMSR in NCCloud
More informationSteelFusion with AWS Hybrid Cloud Storage
Solution Guide SteelFusion with AWS Hybrid Cloud Storage March 2016 The Challenge According to IDC, to meet the demands of global customer and global talent requirements, companies have to maintain remote
More informationCitrix Training. Course: Citrix Training. Duration: 40 hours. Mode of Training: Classroom (Instructor-Led)
Citrix Training Course: Citrix Training Duration: 40 hours Mode of Training: Classroom (Instructor-Led) Virtualization has redefined the way IT resources are consumed and services are delivered. It offers
More informationAspera Direct-to-Cloud Storage WHITE PAPER
Transport Direct-to-Cloud Storage and Support for Third Party April 2014 WHITE PAPER TABLE OF CONTENTS OVERVIEW 3 1 - THE PROBLEM 3 2 - A FUNDAMENTAL SOLUTION - ASPERA DIRECT-TO-CLOUD TRANSPORT 5 3 - VALIDATION
More informationHigh Availability Storage
High Availability Storage High Availability Extensions Goldwyn Rodrigues High Availability Storage Engineer SUSE High Availability Extensions Highly available services for mission critical systems Integrated
More informationBuilding Cost-Effective Storage Clouds A Metrics-based Approach
Building Cost-Effective Storage Clouds A Metrics-based Approach Ning Zhang #1, Chander Kant 2 # Computer Sciences Department, University of Wisconsin Madison Madison, WI, USA 1 nzhang@cs.wisc.edu Zmanda
More informationNCTA Cloud Architecture
NCTA Cloud Architecture Course Specifications Course Number: 093019 Course Length: 5 days Course Description Target Student: This course is designed for system administrators who wish to plan, design,
More informationCS848 Project Presentation Cloud Personal Data Management. Robert Robinson
CS848 Project Presentation Cloud Personal Data Management Robert Robinson Personal File Management Proliferation of files individuals have to manage at home Tax information Family photos Plus many others
More informationCERN Cloud Storage Evaluation Geoffray Adde, Dirk Duellmann, Maitane Zotes CERN IT
SS Data & Storage CERN Cloud Storage Evaluation Geoffray Adde, Dirk Duellmann, Maitane Zotes CERN IT HEPiX Fall 2012 Workshop October 15-19, 2012 Institute of High Energy Physics, Beijing, China SS Outline
More informationData Management in the Cloud
Data Management in the Cloud Ryan Stern stern@cs.colostate.edu : Advanced Topics in Distributed Systems Department of Computer Science Colorado State University Outline Today Microsoft Cloud SQL Server
More informationCLOUD SERVICES FOR EMS
CLOUD SERVICES FOR EMS Greg Biegen EMS Software Director Cloud Operations and Security September 12-14, 2016 Agenda EMS Cloud Services Definitions Hosted Service Managed Services Governance Service Delivery
More informationDISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2
DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing Slide 1 Slide 3 A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet.
More informationBookKeeper. Flavio Junqueira Yahoo! Research, Barcelona. Hadoop in China 2011
BookKeeper Flavio Junqueira Yahoo! Research, Barcelona Hadoop in China 2011 What s BookKeeper? Shared storage for writing fast sequences of byte arrays Data is replicated Writes are striped Many processes
More informationCloud S ecurity Security Processes & Practices Jinesh Varia
Cloud Security Processes & Practices Jinesh Varia Overview Certifications Physical Security Backups EC2 Security S3 Security SimpleDB Security SQS Security Best Practices AWS Security White Paper Available
More informationReferences. Introduction to Database Systems CSE 444. Motivation. Basic Features. Outline: Database in the Cloud. Outline
References Introduction to Database Systems CSE 444 Lecture 24: Databases as a Service YongChul Kwon Amazon SimpleDB Website Part of the Amazon Web services Google App Engine Datastore Website Part of
More informationIntroduction to Database Systems CSE 444
Introduction to Database Systems CSE 444 Lecture 24: Databases as a Service YongChul Kwon References Amazon SimpleDB Website Part of the Amazon Web services Google App Engine Datastore Website Part of
More informationBig Data Primer. 1 Why Big Data? Alex Sverdlov alex@theparticle.com
Big Data Primer Alex Sverdlov alex@theparticle.com 1 Why Big Data? Data has value. This immediately leads to: more data has more value, naturally causing datasets to grow rather large, even at small companies.
More informationSDFS Overview. By Sam Silverberg
SDFS Overview By Sam Silverberg Why did I do this? I had an Idea that I needed to see if it worked. Design Goals Create a dedup file system capable of effective inline deduplication for Virtual Machines
More informationCDStore: Toward Reliable, Secure, and Cost- Efficient Cloud Storage via Convergent Dispersal
CDStore: Toward Reliable, Secure, and Cost- Efficient Cloud Storage via Convergent Dispersal Mingqiang Li, Chuan Qin, and Patrick P. C. Lee, The Chinese University of Hong Kong https://www.usenix.org/conference/atc15/technical-session/presentation/li-mingqiang
More informationOn Limitations of Using Cloud Storage for Data Replication
On Limitations of Using Cloud Storage for Data Replication Christian Cachin IBM Research - Zurich Säumerstr. 4 CH-8803 Rüschlikon, Switzerland cca@zurich.ibm.com Birgit Junker 1 Open Systems AG Räffelstrasse
More informationAppDev OnDemand Cloud Computing Learning Library
AppDev OnDemand Cloud Computing Learning Library A full year of access to our cloud computing courses, plus future course releases included free! The AppDev OnDemand Cloud Computing Learning Library includes
More informationNeverfail for Windows Applications June 2010
Neverfail for Windows Applications June 2010 Neverfail, from Neverfail Ltd. (www.neverfailgroup.com), ensures continuity of user services provided by Microsoft Windows applications via data replication
More informationData In The Cloud: Who Owns It, and How Do You Get it Back?
Data In The Cloud: Who Owns It, and How Do You Get it Back? Presented by Dave Millier, Soban Bhatti, and Oleg Sotnikov 2013 Sentry Metrics Inc. Agenda Reasons for Cloud Adoption How Did My Data Get There?
More informationNoSQL and Hadoop Technologies On Oracle Cloud
NoSQL and Hadoop Technologies On Oracle Cloud Vatika Sharma 1, Meenu Dave 2 1 M.Tech. Scholar, Department of CSE, Jagan Nath University, Jaipur, India 2 Assistant Professor, Department of CSE, Jagan Nath
More informationGraph Database Proof of Concept Report
Objectivity, Inc. Graph Database Proof of Concept Report Managing The Internet of Things Table of Contents Executive Summary 3 Background 3 Proof of Concept 4 Dataset 4 Process 4 Query Catalog 4 Environment
More informationAlfresco Enterprise on Azure: Reference Architecture. September 2014
Alfresco Enterprise on Azure: Reference Architecture Page 1 of 14 Abstract Microsoft Azure provides a set of services for deploying critical enterprise workloads on its highly reliable cloud platform.
More informationDistributed File Systems
Distributed File Systems Paul Krzyzanowski Rutgers University October 28, 2012 1 Introduction The classic network file systems we examined, NFS, CIFS, AFS, Coda, were designed as client-server applications.
More informationCloud Computing Disaster Recovery (DR)
Cloud Computing Disaster Recovery (DR) Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Need for Disaster Recovery (DR) What happens when you
More informationExperimental Investigation Decentralized IaaS Cloud Architecture Open Stack with CDT
Experimental Investigation Decentralized IaaS Cloud Architecture Open Stack with CDT S. Gobinath, S. Saravanan PG Scholar, CSE Dept, M.Kumarasamy College of Engineering, Karur, India 1 Assistant Professor,
More informationLow-cost Open Data As-a-Service in the Cloud
Low-cost Open Data As-a-Service in the Cloud Marin Dimitrov, Alex Simov, Yavor Petkov Ontotext AD, Bulgaria {first.last}@ontotext.com Abstract. In this paper we present the architecture and prototype of
More informationFITCH: Supporting Adaptive Replicated Services in the Cloud
FITCH: Supporting Adaptive Replicated Services in the Cloud Vinicius V. Cogo 1, André Nogueira 1,João Sousa 1, Marcelo Pasin 2, Hans P. Reiser 3, and Alysson Bessani 1 1 University of Lisbon, Faculty of
More informationDistributed Systems (CS236351) Exercise 3
Distributed Systems (CS236351) Winter, 2014-2015 Exercise 3 Due date: 11/1/15, 23:59 1 System overview In this exercise, you are going to develop another version of the basic resource management service,
More informationCloud Computing. Up until now
Cloud Computing Lecture 20 Cloud Platform Comparison & Load Balancing 2010-2011 Up until now Introduction, Definition of Cloud Computing Pre-Cloud Large Scale Computing: Grid Computing Content Distribution
More informationThe Google File System
The Google File System By Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung (Presented at SOSP 2003) Introduction Google search engine. Applications process lots of data. Need good file system. Solution:
More informationA SURVEY OF POPULAR CLUSTERING TECHNOLOGIES
A SURVEY OF POPULAR CLUSTERING TECHNOLOGIES By: Edward Whalen Performance Tuning Corporation INTRODUCTION There are a number of clustering products available on the market today, and clustering has become
More information