NoSQL in der Cloud Why? Andreas Hartmann

Transcription

1 NoSQL in der Cloud Why? Andreas Hartmann

2 NoSQL in der Cloud Why? Quelle:

3 Why Cloud??? NoSQL in der Cloud Why?

4 What does Big Data mean??? NoSQL in der Cloud Why?

5 What is the Problem with Big Data Quelle: NoSQL in der Cloud Why?

6 NoSQL Basics CAP Theorem Consistency Each client always has the same view of the data Availability All clients can always read and write Partition tolerance The System continues to operate despite arbitrary message loss Quelle: NoSQL in der Cloud Why?

7 ACID-BASE ACID Atomicity all or nothing rule Consistency any transaction the database performs will take it from one consistent state to another Isolation no transaction should be able to interfere with another transaction at all Durability once a transaction has been committed, it will remain so Quelle: BASE Basically Available the system does guarantee availability, in terms of the CAP theorem Soft-State the state of the system may change over time, even without input Eventual Consistency the system will become consistent over time, given that the system doesn't receive input during that time Quelle: NoSQL in der Cloud Why?

8 Things to think about!!! Scalability High Availability Caching Architecture Load Balancing Queuing Data Handling Federation Serving Files Storing Files Quelle: NoSQL in der Cloud Why?

9 Open Your Mind;-) Quelle: NoSQL in der Cloud Why?

10 NoSQL Tagcloud NoSQL in der Cloud Why?

11 Datastore Types Key/Value Store Document Store Extensible Record Stores (Widecolumn Stores) Graph Database NoSQL in der Cloud Why?

12 What it means Query Data is easily and quickly read/stored using primary key Denormalize data for commonly used queries Shema Design is optimized for the most common Use-Cases Developer More technologies to have fun with Broader choice of persistence stores Probably Polyglot Persistence Store name, firstname etc in RDBMS Store followers in Graph database Store Content in RDBMS Store User Generated Content in Document database Quelle: NoSQL in der Cloud Why?

13 Wich is the right one Quelle: NoSQL in der Cloud Why?

14 Wich is the right one Quelle: NoSQL in der Cloud Why?

15 Architecture Requirements Business Critical Data Read/Write Data should be consistent Rarley Changed Data / Various Reads / Slight inconsistencies are OK NoSQL in der Cloud Why?

16 mongodb as an Example Documentoriented & schemaless JSON like documents written in C++ Open Source with a AGPL- Licence v NoSQL in der Cloud Why?

17 mongodb in Detail MongoDB Basics Security and Authentication Indexes Replication Scaling Map/Reduce Binary Data Sets Monitoring Backup Schema Design Connectivity Ecosystem NoSQL in der Cloud Why?

18 mongodb Replication Replica Sets A replica set consists of two or more nodes that are copies of each other The replica set automatically selects a primary (master). Drivers can automatically detect when a replica set primary changes and will begin sending writes to the new primary Why Replica Sets Automated Failover Read Scaling (slaveokay Method) Maintenance Disaster Recovery Quelle: NoSQL in der Cloud Why?

19 mongodb Scaling Sharding Horizontal scaling across multiple nodes Sharding Key Characteristics Inserts are balanced between shards Common queries are routed to a subset of the shards NoSQL in der Cloud Why?

20 mongodb Scaling Replica Sets comes together with Sharding Quelle: NoSQL in der Cloud Why?

21 mongodb Map/Reduce Parallel processing huge datasets on distributed systems Data Data Data Data M A P R E D U C E NoSQL in der Cloud Why?

22 mongodb Map/Reduce Map XXX var map = function() { Map Reduce Execute }; emit( this.author, { pages: this.pages } ); NoSQL in der Cloud Why?

23 mongodb Map/Reduce Reduce Map Reduce Execute var reduce = function( key, values ) { var sum = 0; values.foreach( function( doc ) { sum += doc.pages; } ); }; return { "pages": sum }; NoSQL in der Cloud Why?

24 mongodb Map/Reduce Execute Map Reduce Execute db.bookstore.mapreduce( map, reduce, { out: "myresultcollection" } ); { "result" : "myresultcollection", "timemillis" : 156, "counts" : { "input" : 7, "emit" : 7, "reduce" : 3, "output" : 3 }, "ok" : 1, } NoSQL in der Cloud Why?

25 Case Studies NoSQL in der Cloud Why? Quelle: Quelle:

26 Vielen Dank für Ihre Aufmerksamkeit.