Distributed Architectures. Distributed Databases. Distributed Databases. Distributed Databases
|
|
- Shanon Preston
- 8 years ago
- Views:
Transcription
1 Distributed Architectures Distributed Databases Simplest: client-server Distributed databases: two or more database servers connected to a network that can perform transactions independently and together Parallel databases: use of parallel machines as database servers 2 Distributed Databases Decentralized management of data Evolution of the centralized strategy used up to the 80 Advantages: Reflects the distributed nature of organizations Easier expandability Higher reliability (degradation of performances in case of a failure rather than service interruption) Distributed Databases Classes wrt DBMS software: Homogeneous: same DBMS software on all servers Heterogeneous: different DBMS software on the servers Classes wrt network: LAN WAN 3 4
2 Distributed Databases Applications Where is the Data? Homogeneous Heterogeneous LAN Finance and administration applications Administrative applications across functions WAN Booking systems and finance applications Integrated booking systems, interbank systems Data is split in fragments and distributed across the servers Given a table T Horizontal fragmentation: the fragments are subsets of tuples of T obtained from a selection on T Vertical fragmentation: the fragments are vertical portions of T obtained from a projection on T. They usually share the primary key 5 6 Horizontal Fragmentation Relation Employee(ENum,Name,DepNum,Sal) Horizontal fragmentation Employee1=σ ENum<=3 Employee Employee2=σ ENum>3 Employee Reconstruction Employee= Employee1 Employee2 Vertical Fragmentation Relation Employee(ENum,Name,DepNum,Sal) Horizontal fragmentation Employee1=π ENum,Name Employee Employee2=π ENum,DepNum,Sal Employee Reconstruction Employee= Employee1 Employee2 7 8
3 Allocation Schemes Fragments are distributed across servers according to an allocation scheme Types of allocation schemes: Non redundant: every fragment is allocated to only one server Redundant: a fragment can be replicated in more than one server Transparency Levels Levels of the transparency of query languages with respect to the fragmentation/allocation of data Fragmentation transparency: the user does not have to know that the DB is distributed and fragmented. The query she writes are the same as those she would write for a centralized server, e.g. SELECT * FROM Employee WHERE Sal> Allocation Transparency The user knows the structure of fragments but he does not know where they are allocated E.g. (horizontal fragmentation) SELECT * FROM Employee1 WHERE Sal>1000 UNION SELECT * FROM Employee2 WHERE Sal>1000 Language Transparency The user knows the structure of fragments and the server where they are allocated E.g. (horizontal fragmentation) SELECT * FROM Employee1@Server1 WHERE Sal>1000 UNION SELECT * FROM Employee2@Server2 WHERE Sal>
4 No Transparency The DB is heterogeneous and the user has to use a different SQL dialect for every server Distributed Query Optimization Cost-based approach; consider all plans, pick cheapest; similar to centralized optimization. Difference 1: Communication costs must be considered. Difference 2: Local site autonomy must be respected. Difference 3: New distributed join methods. Query site constructs global plan, with suggested local plans describing processing at each site. If a site can improve suggested local plan, free to do so Distributed Locking How do we manage locks for objects across many sites? Centralized: One site does all locking. Vulnerable to single site failure. Primary Copy: All locking for an object done at the primary copy site for this object. Reading requires access to locking site as well as site where the object is stored. Fully Distributed: Locking for a copy done at site where the copy is stored. Locks at all sites while writing an object. Distributed Deadlock Detection Each site maintains a local waits-for graph. A global deadlock might exist even if the local graphs contain no cycles: T1 T2 T1 T2 T1 T2 SITE A SITE B GLOBAL Three solutions: Centralized (send all local graphs to one site); Hierarchical (organize sites into a hierarchy and send local graphs to parent in the hierarchy); Timeout (abort transaction if it waits too long). 15
5 Distributed Recovery Two new issues: New kinds of failure, e.g., links and remote sites. If sub-transactions of a transaction execute at different sites, all or none must commit. Need a commit protocol to achieve this. A log is maintained at each site, as in a centralized DBMS, and commit protocol actions are additionally logged. Two-Phase Commit (2PC) Site at which the transaction originates is coordinator; other sites at which it executes are subordinates. When a transaction wants to commit: 1. Coordinator force-write prepare log record 2. Coordinator sends prepare msg to each subordinate. 3. Subordinate force-writes an abort or prepare log record and then sends a no or yes msg to coordinator. Two-Phase Commit (2PC) Two-Phase Commit (2PC) 4. If coordinator gets unanimous yes votes, force-writes a commit log record and sends commit msg to all subs. Else, force-writes abort log rec, and sends abort msg. 5. Subordinates force-write abort/commit log rec based on msg they get and then send ack msg to coordinator 6. Coordinator writes end log rec after getting all acks. coord prepare prepare yes/no global decision (abort/commit) abort/ commit ack end sub prepare local decision (abort/commit) 20
6 Comments on 2PC Two rounds of communication: first, voting; then, termination. Both initiated by coordinator. Any site can decide to abort an transaction. Every msg reflects a decision by the sender; to ensure that this decision survives failures, it is first recorded in the local log. All commit protocol log recs for a transaction contain Transactionid and Coordinatorid. The coordinator s abort/commit record also includes ids of all subordinates. Restart After a Failure of a Sub If we have a commit or abort log rec for transaction T after the last checkpoint, must redo/undo T. If we have a prepare log rec for transaction T, but not commit/abort, Repeatedly contact the coordinator to find status of T, then write commit/abort log rec; redo/undo T; and write end log rec. If we don t have even a prepare log rec for T, unilaterally abort and undo T. Restart After a Failure at the Coordinator If we have a commit or abort log rec for transaction T, but not an end rec, must redo/undo T. keep sending commit/abort msgs to subs until acks received. If we have a prepare log rec for transaction T, but not commit/abort, Write abort on the log and repeat the second phase or Repeat the first phase hoping that the subs are still in the prepare state and a commit can be reached Restart After a Failure at the Coordinator If we don t have even a prepare log rec for T, unilaterally abort and undo T.
7 Blocking If coordinator for transaction T fails, subordinates who have voted yes cannot decide whether to commit or abort T until coordinator recovers. T is blocked. Even if all subordinates know each other (extra overhead in prepare msg) they are blocked unless one of them voted no. Link and Remote Site Failures If a remote site does not respond during the commit protocol for transaction T, either because the site failed or the link failed: If the current site is the coordinator for T, should abort T. If the current site is a subordinate, and has not yet voted yes, it should abort T. If the current site is a subordinate and has voted yes, it is blocked until the coordinator responds. Observations on 2PC Ack msgs used to let coordinator know when it can forget a transaction; until it receives all acks, it must keep T in the transaction Table. If coordinator fails after sending prepare msgs but before writing commit/abort log recs, when it comes back up it aborts the transaction. If a subtransaction does no updates, its commit or abort status is irrelevant. Data Replication Data (entire tables or fragments) can be replicated on different servers The consistency among the different copies is ensured by a data replicator 28
8 Updating Distributed Data Synchronous Replication Synchronous Replication: All copies of a modified relation (fragment) must be updated before the modifying transaction commits. Data distribution is made transparent to users. Asynchronous Replication: Copies of a modified relation are only periodically updated; different copies may get out of synch in the meantime. Users must be aware of data distribution. Current products follow this approach. Voting: the transaction must write a majority of copies to modify an object; must read enough copies to be sure of seeing at least one most recent copy. E.g., 10 copies; 7 written for update; 4 copies read. Each copy has version number. Not attractive usually because reads are common. Read-any Write-all: Writes are slower and reads are faster, relative to Voting. Most common approach to synchronous replication. Choice of technique determines which locks to set. Cost of Synchronous Replication Before an update transaction can commit, it must obtain locks on all modified copies. Sends lock requests to remote sites, and while waiting for the response, holds on to other locks! If sites or links fail, transaction cannot commit until they are back up. Even if there is no failure, committing must follow an expensive commit protocol with many msgs. So the alternative of asynchronous replication is becoming widely used. Asynchronous Replication Allows the modifying transaction to commit before all copies have been changed (and readers nonetheless look at just one copy). Users must be aware of which copy they are reading, and that copies may be out-of-sync for short periods of time. Two approaches: Primary Site and Peer-to-Peer replication. Difference lies in how many copies are ``updatable or ``master copies.
9 Primary Site Replication Implementing the Capture Step Exactly one copy of a relation is designated the primary or master copy. Replicas at other sites cannot be directly updated. The primary copy is published. Other sites subscribe to (fragments of) this relation; these are secondary copies. Main issue: How are changes to the primary copy propagated to the secondary copies? Done in two steps. First, capture changes made by committed transactions; then apply these changes. Log-Based Capture: The log (kept for recovery) is used to generate a Change Data Table (CDT). If this is done when the log tail is written to disk, must somehow remove changes due to subsequently aborted transaction. Procedural Capture: A trigger does the capture; Log-Based Capture is better (cheaper, faster) but relies on proprietary log details. Peer-to to-peer Replication More than one of the copies of an object can be a master in this approach. Changes to a master copy must be propagated to other copies somehow. If two master copies are changed in a conflicting manner, this must be resolved. (e.g., Site 1: Joe s age changed to 35; Site 2: to 36) Best used when conflicts do not arise: E.g., Updating rights owned by one master at a time.
Topics. Distributed Databases. Desirable Properties. Introduction. Distributed DBMS Architectures. Types of Distributed Databases
Topics Distributed Databases Chapter 21, Part B Distributed DBMS architectures Data storage in a distributed DBMS Distributed catalog management Distributed query processing Updates in a distributed DBMS
More informationDistributed Data Management
Introduction Distributed Data Management Involves the distribution of data and work among more than one machine in the network. Distributed computing is more broad than canonical client/server, in that
More informationAn Overview of Distributed Databases
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 4, Number 2 (2014), pp. 207-214 International Research Publications House http://www. irphouse.com /ijict.htm An Overview
More informationDistributed Databases. Concepts. Why distributed databases? Distributed Databases Basic Concepts
Distributed Databases Basic Concepts Distributed Databases Concepts. Advantages and disadvantages of distributed databases. Functions and architecture for a DDBMS. Distributed database design. Levels of
More informationDistributed Database Management Systems
Distributed Database Management Systems (Distributed, Multi-database, Parallel, Networked and Replicated DBMSs) Terms of reference: Distributed Database: A logically interrelated collection of shared data
More informationDistributed Databases
Distributed Databases Chapter 1: Introduction Johann Gamper Syllabus Data Independence and Distributed Data Processing Definition of Distributed databases Promises of Distributed Databases Technical Problems
More informationchapater 7 : Distributed Database Management Systems
chapater 7 : Distributed Database Management Systems Distributed Database Management System When an organization is geographically dispersed, it may choose to store its databases on a central database
More informationDISTRIBUTED AND PARALLELL DATABASE
DISTRIBUTED AND PARALLELL DATABASE SYSTEMS Tore Risch Uppsala Database Laboratory Department of Information Technology Uppsala University Sweden http://user.it.uu.se/~torer PAGE 1 What is a Distributed
More informationDistributed Databases
C H A P T E R19 Distributed Databases Practice Exercises 19.1 How might a distributed database designed for a local-area network differ from one designed for a wide-area network? Data transfer on a local-area
More informationObjectives. Distributed Databases and Client/Server Architecture. Distributed Database. Data Fragmentation
Objectives Distributed Databases and Client/Server Architecture IT354 @ Peter Lo 2005 1 Understand the advantages and disadvantages of distributed databases Know the design issues involved in distributed
More informationChapter 18: Database System Architectures. Centralized Systems
Chapter 18: Database System Architectures! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types 18.1 Centralized Systems! Run on a single computer system and
More informationDistributed Database Systems
Distributed Database Systems Vera Goebel Department of Informatics University of Oslo 2011 1 Contents Review: Layered DBMS Architecture Distributed DBMS Architectures DDBMS Taxonomy Client/Server Models
More informationAppendix A Core Concepts in SQL Server High Availability and Replication
Appendix A Core Concepts in SQL Server High Availability and Replication Appendix Overview Core Concepts in High Availability Core Concepts in Replication 1 Lesson 1: Core Concepts in High Availability
More informationCentralized Systems. A Centralized Computer System. Chapter 18: Database System Architectures
Chapter 18: Database System Architectures Centralized Systems! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types! Run on a single computer system and do
More informationData Management in the Cloud
Data Management in the Cloud Ryan Stern stern@cs.colostate.edu : Advanced Topics in Distributed Systems Department of Computer Science Colorado State University Outline Today Microsoft Cloud SQL Server
More informationOracle Database Links Part 2 - Distributed Transactions Written and presented by Joel Goodman October 15th 2009
Oracle Database Links Part 2 - Distributed Transactions Written and presented by Joel Goodman October 15th 2009 About Me Email: Joel.Goodman@oracle.com Blog: dbatrain.wordpress.com Application Development
More informationDistributed Commit Protocols
Distributed Commit Protocols We know: There is no distributed Atomic Commit Protocol (ACP) in an asynchronous system with properties: Uniform agreement, uniform validity, stability (A1-3) Non-triviality,
More information(Pessimistic) Timestamp Ordering. Rules for read and write Operations. Pessimistic Timestamp Ordering. Write Operations and Timestamps
(Pessimistic) stamp Ordering Another approach to concurrency control: Assign a timestamp ts(t) to transaction T at the moment it starts Using Lamport's timestamps: total order is given. In distributed
More informationConcepts of Database Management Seventh Edition. Chapter 7 DBMS Functions
Concepts of Database Management Seventh Edition Chapter 7 DBMS Functions Objectives Introduce the functions, or services, provided by a DBMS Describe how a DBMS handles updating and retrieving data Examine
More informationTransaction Management in Distributed Database Systems: the Case of Oracle s Two-Phase Commit
Transaction Management in Distributed Database Systems: the Case of Oracle s Two-Phase Commit Ghazi Alkhatib Senior Lecturer of MIS Qatar College of Technology Doha, Qatar Alkhatib@qu.edu.sa and Ronny
More informationDistributed Systems LEEC (2005/06 2º Sem.)
Distributed Systems LEEC (2005/06 2º Sem.) Introduction João Paulo Carvalho Universidade Técnica de Lisboa / Instituto Superior Técnico Outline Definition of a Distributed System Goals Connecting Users
More informationAdvanced Database Group Project - Distributed Database with SQL Server
Advanced Database Group Project - Distributed Database with SQL Server Hung Chang, Qingyi Zhu Erasmus Mundus IT4BI 1. Introduction 1.1 Motivation Distributed database is vague for us. How to differentiate
More informationDr Markus Hagenbuchner markus@uow.edu.au CSCI319. Distributed Systems
Dr Markus Hagenbuchner markus@uow.edu.au CSCI319 Distributed Systems CSCI319 Chapter 8 Page: 1 of 61 Fault Tolerance Study objectives: Understand the role of fault tolerance in Distributed Systems. Know
More informationA distributed system is defined as
A distributed system is defined as A collection of independent computers that appears to its users as a single coherent system CS550: Advanced Operating Systems 2 Resource sharing Openness Concurrency
More informationDatabase Replication Techniques: a Three Parameter Classification
Database Replication Techniques: a Three Parameter Classification Matthias Wiesmann Fernando Pedone André Schiper Bettina Kemme Gustavo Alonso Département de Systèmes de Communication Swiss Federal Institute
More informationChapter-15 -------------------------------------------- Replication in SQL Server
Important Terminologies: What is Replication? Replication is the process where data is copied between databases on the same server or different servers connected by LANs, WANs, or the Internet. Microsoft
More informationInternational Journal of Advanced Research in Computer Science and Software Engineering
ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: Transaction Management in Homogenous Distributed Real-Time Replicated
More informationChapter 10: Distributed DBMS Reliability
Chapter 10: Distributed DBMS Reliability Definitions and Basic Concepts Local Recovery Management In-place update, out-of-place update Distributed Reliability Protocols Two phase commit protocol Three
More informationAvailability Digest. MySQL Clusters Go Active/Active. December 2006
the Availability Digest MySQL Clusters Go Active/Active December 2006 Introduction MySQL (www.mysql.com) is without a doubt the most popular open source database in use today. Developed by MySQL AB of
More informationIn Memory Accelerator for MongoDB
In Memory Accelerator for MongoDB Yakov Zhdanov, Director R&D GridGain Systems GridGain: In Memory Computing Leader 5 years in production 100s of customers & users Starts every 10 secs worldwide Over 15,000,000
More informationVII. Database System Architecture
VII. Database System Lecture Topics Monolithic systems Client/Server systems Parallel database servers Multidatabase systems CS338 1 Monolithic System DBMS File System Each component presents a well-defined
More informationPrinciples of Distributed Database Systems
M. Tamer Özsu Patrick Valduriez Principles of Distributed Database Systems Third Edition
More informationReal-time Data Replication
Real-time Data Replication from Oracle to other databases using DataCurrents WHITEPAPER Contents Data Replication Concepts... 2 Real time Data Replication... 3 Heterogeneous Data Replication... 4 Different
More informationSoftware Concepts. Uniprocessor Operating Systems. System software structures. CIS 505: Software Systems Architectures of Distributed Systems
CIS 505: Software Systems Architectures of Distributed Systems System DOS Software Concepts Description Tightly-coupled operating system for multiprocessors and homogeneous multicomputers Main Goal Hide
More informationMicrokernels & Database OSs. Recovery Management in QuickSilver. DB folks: Stonebraker81. Very different philosophies
Microkernels & Database OSs Recovery Management in QuickSilver. Haskin88: Roger Haskin, Yoni Malachi, Wayne Sawdon, Gregory Chan, ACM Trans. On Computer Systems, vol 6, no 1, Feb 1988. Stonebraker81 OS/FS
More informationComparing Microsoft SQL Server 2005 Replication and DataXtend Remote Edition for Mobile and Distributed Applications
Comparing Microsoft SQL Server 2005 Replication and DataXtend Remote Edition for Mobile and Distributed Applications White Paper Table of Contents Overview...3 Replication Types Supported...3 Set-up &
More informationWhen an organization is geographically dispersed, it. Distributed Databases. Chapter 13-1 LEARNING OBJECTIVES INTRODUCTION
Chapter 13 Distributed Databases LEARNING OBJECTIVES After studying this chapter, you should be able to: Concisely define each of the following key terms: distributed database, decentralized database,
More informationDistributed Databases
C H A P T E R 12 Distributed Databases Learning Objectives After studying this chapter, you should be able to: Concisely define the following key terms: distributed database, decentralized database, location
More information1. INTRODUCTION TO RDBMS
Oracle For Beginners Page: 1 1. INTRODUCTION TO RDBMS What is DBMS? Data Models Relational database management system (RDBMS) Relational Algebra Structured query language (SQL) What Is DBMS? Data is one
More informationLecture 7: Concurrency control. Rasmus Pagh
Lecture 7: Concurrency control Rasmus Pagh 1 Today s lecture Concurrency control basics Conflicts and serializability Locking Isolation levels in SQL Optimistic concurrency control Transaction tuning Transaction
More informationCHAPTER 6: DISTRIBUTED FILE SYSTEMS
CHAPTER 6: DISTRIBUTED FILE SYSTEMS Chapter outline DFS design and implementation issues: system structure, access, and sharing semantics Transaction and concurrency control: serializability and concurrency
More informationAn Integrated Approach to Recovery and High Availability in an Updatable, Distributed Data Warehouse
An Integrated Approach to Recovery and High Availability in an Updatable, Distributed Data Warehouse Edmond Lau MIT CSAIL edmondlau@alum.mit.edu Samuel Madden MIT CSAIL madden@csail.mit.edu ABSTRACT Any
More informationHow To Understand The Concept Of A Distributed System
Distributed Operating Systems Introduction Ewa Niewiadomska-Szynkiewicz and Adam Kozakiewicz ens@ia.pw.edu.pl, akozakie@ia.pw.edu.pl Institute of Control and Computation Engineering Warsaw University of
More informationTECHNIQUES FOR DATA REPLICATION ON DISTRIBUTED DATABASES
Constantin Brâncuşi University of Târgu Jiu ENGINEERING FACULTY SCIENTIFIC CONFERENCE 13 th edition with international participation November 07-08, 2008 Târgu Jiu TECHNIQUES FOR DATA REPLICATION ON DISTRIBUTED
More informationIntroduction to Parallel and Distributed Databases
Advanced Topics in Database Systems Introduction to Parallel and Distributed Databases Computer Science 600.316/600.416 Notes for Lectures 1 and 2 Instructor Randal Burns 1. Distributed databases are the
More informationEvolution of Distributed Database Management System
Evolution of Distributed Database Management System During the 1970s, corporations implemented centralized database management systems to meet their structured information needs. Structured information
More informationChapter 3. Database Environment - Objectives. Multi-user DBMS Architectures. Teleprocessing. File-Server
Chapter 3 Database Architectures and the Web Transparencies Database Environment - Objectives The meaning of the client server architecture and the advantages of this type of architecture for a DBMS. The
More informationAgenda. Transaction Manager Concepts ACID. DO-UNDO-REDO Protocol DB101
Concepts Agenda Database Concepts Overview ging, REDO and UNDO Two Phase Distributed Processing Dr. Nick Bowen, VP UNIX and xseries SW Development October 17, 2003 Yale Oct 2003 Database System ACID index
More informationData Replication and Snapshot Isolation. Example: Cluster Replication
Postgres-R(SI) Data Replication and Snapshot Isolation Shuqing Wu McGill University Montreal, Canada Eample: Cluster Replication Cluster of DB replicas Read-one-Write-All- Available Performance Distribute
More informationBBM467 Data Intensive ApplicaAons
Hace7epe Üniversitesi Bilgisayar Mühendisliği Bölümü BBM467 Data Intensive ApplicaAons Dr. Fuat Akal akal@hace7epe.edu.tr FoundaAons of Data[base] Clusters Database Clusters Hardware Architectures Data
More informationInformix Dynamic Server May 2007. Availability Solutions with Informix Dynamic Server 11
Informix Dynamic Server May 2007 Availability Solutions with Informix Dynamic Server 11 1 Availability Solutions with IBM Informix Dynamic Server 11.10 Madison Pruet Ajay Gupta The addition of Multi-node
More informationOutline. Distributed DBMSPage 4. 1
Outline Introduction Background Distributed DBMS Architecture Datalogical Architecture Implementation Alternatives Component Architecture Distributed DBMS Architecture Distributed Database Design Semantic
More informationDatabase Concurrency Control and Recovery. Simple database model
Database Concurrency Control and Recovery Pessimistic concurrency control Two-phase locking (2PL) and Strict 2PL Timestamp ordering (TSO) and Strict TSO Optimistic concurrency control (OCC) definition
More informationB.Com(Computers) II Year DATABASE MANAGEMENT SYSTEM UNIT- V
B.Com(Computers) II Year DATABASE MANAGEMENT SYSTEM UNIT- V 1 1) What is Distributed Database? A) A database that is distributed among a network of geographically separated locations. A distributed database
More informationDatabase Replication with Oracle 11g and MS SQL Server 2008
Database Replication with Oracle 11g and MS SQL Server 2008 Flavio Bolfing Software and Systems University of Applied Sciences Chur, Switzerland www.hsr.ch/mse Abstract Database replication is used widely
More informationThe ConTract Model. Helmut Wächter, Andreas Reuter. November 9, 1999
The ConTract Model Helmut Wächter, Andreas Reuter November 9, 1999 Overview In Ahmed K. Elmagarmid: Database Transaction Models for Advanced Applications First in Andreas Reuter: ConTracts: A Means for
More informationTier Architectures. Kathleen Durant CS 3200
Tier Architectures Kathleen Durant CS 3200 1 Supporting Architectures for DBMS Over the years there have been many different hardware configurations to support database systems Some are outdated others
More informationTransaction Management Overview
Transaction Management Overview Chapter 16 Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke 1 Transactions Concurrent execution of user programs is essential for good DBMS performance. Because
More informationChapter Outline. Chapter 2 Distributed Information Systems Architecture. Middleware for Heterogeneous and Distributed Information Systems
Prof. Dr.-Ing. Stefan Deßloch AG Heterogene Informationssysteme Geb. 36, Raum 329 Tel. 0631/205 3275 dessloch@informatik.uni-kl.de Chapter 2 Architecture Chapter Outline Distributed transactions (quick
More informationMIRROR: A State-Conscious Concurrency Control Protocol for. Replicated Real-Time Databases
: A State-Conscious Concurrency Control Protocol for Ming Xiong, Krithi Ramamritham Replicated Real-Time Databases Jayant R. Haritsa John A. Stankovic Department of Computer Science SERC Department of
More informationTransactions and the Internet
Transactions and the Internet Week 12-13 Week 12-13 MIE253-Consens 1 Schedule Week Date Lecture Topic 1 Jan 9 Introduction to Data Management 2 Jan 16 The Relational Model 3 Jan. 23 Constraints and SQL
More informationA Shared-nothing cluster system: Postgres-XC
Welcome A Shared-nothing cluster system: Postgres-XC - Amit Khandekar Agenda Postgres-XC Configuration Shared-nothing architecture applied to Postgres-XC Supported functionalities: Present and Future Configuration
More informationClient Server Architecture
Client Server Architecture Key concepts: - client server architecture - Functional requirements in the 2-tier structures - Functional distribution in the 2-tier structures - Implementation of Business
More informationAtomic Commitment in Grid Database Systems
Atomic Commitment in Grid Database Systems Sushant Goel 1 Hema Sharda 2 David Taniar 3 1,2 School of Electrical and Computer Systems Engineering, Royal Melbourne Institute of Technology, Australia 1 s2013070@student.rmit.edu.au
More informationThe Future of PostgreSQL High Availability Robert Hodges - Continuent, Inc. Simon Riggs - 2ndQuadrant
The Future of PostgreSQL High Availability Robert Hodges - Continuent, Inc. Simon Riggs - 2ndQuadrant Agenda / Introductions / Framing the High Availability (HA) Problem / Hot Standby + Log Streaming /
More informationIntroduction to Database Management Systems
Database Administration Transaction Processing Why Concurrency Control? Locking Database Recovery Query Optimization DB Administration 1 Transactions Transaction -- A sequence of operations that is regarded
More informationTushar Joshi Turtle Networks Ltd
MySQL Database for High Availability Web Applications Tushar Joshi Turtle Networks Ltd www.turtle.net Overview What is High Availability? Web/Network Architecture Applications MySQL Replication MySQL Clustering
More informationData Distribution with SQL Server Replication
Data Distribution with SQL Server Replication Introduction Ensuring that data is in the right place at the right time is increasingly critical as the database has become the linchpin in corporate technology
More informationRemote Copy Technology of ETERNUS6000 and ETERNUS3000 Disk Arrays
Remote Copy Technology of ETERNUS6000 and ETERNUS3000 Disk Arrays V Tsutomu Akasaka (Manuscript received July 5, 2005) This paper gives an overview of a storage-system remote copy function and the implementation
More informationSmooth and Flexible ERP Migration between both Homogeneous and Heterogeneous ERP Systems/ERP Modules
28.8.2008 Smooth and Flexible ERP Migration between both Homogeneous and Heterogeneous ERP Systems/ERP Modules Lars Frank Department of Informatics, Copenhagen Business School, Howitzvej 60, DK-2000 Frederiksberg,
More informationConflict-Aware Scheduling for Dynamic Content Applications
Conflict-Aware Scheduling for Dynamic Content Applications Cristiana Amza Ý, Alan L. Cox Ý, Willy Zwaenepoel Þ Ý Department of Computer Science, Rice University, Houston, TX, USA Þ School of Computer and
More informationA SURVEY OF POPULAR CLUSTERING TECHNOLOGIES
A SURVEY OF POPULAR CLUSTERING TECHNOLOGIES By: Edward Whalen Performance Tuning Corporation INTRODUCTION There are a number of clustering products available on the market today, and clustering has become
More informationClient/Server Computing Distributed Processing, Client/Server, and Clusters
Client/Server Computing Distributed Processing, Client/Server, and Clusters Chapter 13 Client machines are generally single-user PCs or workstations that provide a highly userfriendly interface to the
More informationCrash Recovery. Chapter 18. Database Management Systems, 3ed, R. Ramakrishnan and J. Gehrke
Crash Recovery Chapter 18 Database Management Systems, 3ed, R. Ramakrishnan and J. Gehrke Review: The ACID properties A tomicity: All actions in the Xact happen, or none happen. C onsistency: If each Xact
More informationReplication on Virtual Machines
Replication on Virtual Machines Siggi Cherem CS 717 November 23rd, 2004 Outline 1 Introduction The Java Virtual Machine 2 Napper, Alvisi, Vin - DSN 2003 Introduction JVM as state machine Addressing non-determinism
More information1.5 Distributed Systems
1.5 Distributed Systems A network, in the simplest terms, is a communication path between two or more systems. Distributed systems depend on networking for their functionality. By being able to communicate,
More informationReview: The ACID properties
Recovery Review: The ACID properties A tomicity: All actions in the Xaction happen, or none happen. C onsistency: If each Xaction is consistent, and the DB starts consistent, it ends up consistent. I solation:
More informationDistributed Databases
Distributed Databases Dr. Julian Bunn Center for Advanced Computing Research Caltech Based on material provided by: Jim Gray (Microsoft), Heinz Stockinger (CERN), Raghu Ramakrishnan (Wisconsin) Outline
More informationMobile and Heterogeneous databases Database System Architecture. A.R. Hurson Computer Science Missouri Science & Technology
Mobile and Heterogeneous databases Database System Architecture A.R. Hurson Computer Science Missouri Science & Technology 1 Note, this unit will be covered in four lectures. In case you finish it earlier,
More informationChapter 14: Recovery System
Chapter 14: Recovery System Chapter 14: Recovery System Failure Classification Storage Structure Recovery and Atomicity Log-Based Recovery Remote Backup Systems Failure Classification Transaction failure
More informationConcurrency Control. Chapter 17. Comp 521 Files and Databases Fall 2010 1
Concurrency Control Chapter 17 Comp 521 Files and Databases Fall 2010 1 Conflict Serializable Schedules Recall conflicts (WR, RW, WW) were the cause of sequential inconsistency Two schedules are conflict
More informationDatabase Tuning and Physical Design: Execution of Transactions
Database Tuning and Physical Design: Execution of Transactions David Toman School of Computer Science University of Waterloo Introduction to Databases CS348 David Toman (University of Waterloo) Transaction
More informationReplication. Training Division New Delhi
Replication Training Division New Delhi Replication Allows you to make duplicate copies of your data Move the copies to different locations, and synchronize the data automatically so that all the copies
More informationSurvey on Comparative Analysis of Database Replication Techniques
72 Survey on Comparative Analysis of Database Replication Techniques Suchit Sapate, Student, Computer Science and Engineering, St. Vincent Pallotti College, Nagpur, India Minakshi Ramteke, Student, Computer
More informationSODDA A SERVICE-ORIENTED DISTRIBUTED DATABASE ARCHITECTURE
SODDA A SERVICE-ORIENTED DISTRIBUTED DATABASE ARCHITECTURE Breno Mansur Rabelo Centro EData Universidade do Estado de Minas Gerais, Belo Horizonte, MG, Brazil breno.mansur@uemg.br Clodoveu Augusto Davis
More informationRecovery Principles in MySQL Cluster 5.1
Recovery Principles in MySQL Cluster 5.1 Mikael Ronström Senior Software Architect MySQL AB 1 Outline of Talk Introduction of MySQL Cluster in version 4.1 and 5.0 Discussion of requirements for MySQL Cluster
More informationDerby: Replication and Availability
Derby: Replication and Availability Egil Sørensen Master of Science in Computer Science Submission date: June 2007 Supervisor: Svein Erik Bratsberg, IDI Norwegian University of Science and Technology Department
More informationCluster Computing. ! Fault tolerance. ! Stateless. ! Throughput. ! Stateful. ! Response time. Architectures. Stateless vs. Stateful.
Architectures Cluster Computing Job Parallelism Request Parallelism 2 2010 VMware Inc. All rights reserved Replication Stateless vs. Stateful! Fault tolerance High availability despite failures If one
More informationDistributed System Principles
Distributed System Principles 1 What is a Distributed System? Definition: A distributed system consists of a collection of autonomous computers, connected through a network and distribution middleware,
More informationHigh Availability Design Patterns
High Availability Design Patterns Kanwardeep Singh Ahluwalia 81-A, Punjabi Bagh, Patiala 147001 India kanwardeep@gmail.com +91 98110 16337 Atul Jain 135, Rishabh Vihar Delhi 110092 India jain.atul@wipro.com
More informationHigh Availability for Database Systems in Cloud Computing Environments. Ashraf Aboulnaga University of Waterloo
High Availability for Database Systems in Cloud Computing Environments Ashraf Aboulnaga University of Waterloo Acknowledgments University of Waterloo Prof. Kenneth Salem Umar Farooq Minhas Rui Liu (post-doctoral
More informationDatabase replication for commodity database services
Database replication for commodity database services Gustavo Alonso Department of Computer Science ETH Zürich alonso@inf.ethz.ch http://www.iks.ethz.ch Replication as a problem Gustavo Alonso. ETH Zürich.
More informationDistributed Databases
Chapter 12 Distributed Databases Learning Objectives After studying this chapter, you should be able to: Concisely define the following key terms: distributed database, decentralized database, location
More informationOverview of Storage and Indexing
Overview of Storage and Indexing Chapter 8 How index-learning turns no student pale Yet holds the eel of science by the tail. -- Alexander Pope (1688-1744) Database Management Systems 3ed, R. Ramakrishnan
More informationDDB Functionalities by Major DMBS Products. Haibin Liu Shcherbak Maryna Nassrat Hatem
DDB Functionalities by Major DMBS Products Haibin Liu Shcherbak Maryna Nassrat Hatem Outline Introduction Distributed Security Distributed Concurrency Control Distributed Query Optimization Introduction
More informationSCALABILITY AND AVAILABILITY
SCALABILITY AND AVAILABILITY Real Systems must be Scalable fast enough to handle the expected load and grow easily when the load grows Available available enough of the time Scalable Scale-up increase
More information14 Databases. Source: Foundations of Computer Science Cengage Learning. Objectives After studying this chapter, the student should be able to:
14 Databases 14.1 Source: Foundations of Computer Science Cengage Learning Objectives After studying this chapter, the student should be able to: Define a database and a database management system (DBMS)
More informationMTCache: Mid-Tier Database Caching for SQL Server
MTCache: Mid-Tier Database Caching for SQL Server Per-Åke Larson Jonathan Goldstein Microsoft {palarson,jongold}@microsoft.com Hongfei Guo University of Wisconsin guo@cs.wisc.edu Jingren Zhou Columbia
More informationTransaction Processing Monitors
Chapter 24: Advanced Transaction Processing! Transaction-Processing Monitors! Transactional Workflows! High-Performance Transaction Systems! Main memory databases! Real-Time Transaction Systems! Long-Duration
More informationLesson 12: Recovery System DBMS Architectures
Lesson 12: Recovery System DBMS Architectures Contents Recovery after transactions failure Data access and physical disk operations Log-Based Recovery Checkpoints Recovery With Concurrent Transactions
More information