Saturday, 13 June CouchDB. Apache

Size: px

Start display at page:

Download "Saturday, 13 June 2009. CouchDB. Apache"

Erik Adams
10 years ago
Views:

1 CouchDB Apache

2 Seen REST talk Seen DB talk Hi! Jan Lehnardt / CouchDB Committer *bragging* [email protected] since October 2001 [email protected] since February 2008 <commercial> Director at couch.io </commercial>

jan@php.net since October 2001 jan@apache.

3 Relax!

5 Agenda Learn how to use CouchDB replication for load-balancing, fault tolerance, offline work and backup. We are showing how to set up each and what you need to look out for.

6 Agenda Finally, this talk is sprinkled with neat tricks and best practices for deploying CouchDB. Which load balancers are people using, how to make the best use of caching, etc.

8 Agenda Basics Replication Mind shifting

9 Documents

10 Documents Self contained Schema is optional Feel natural

11 Schema Free (JSON) { "_id": "BCCD12CBB", "_rev": "1-AB764C", "type": "person", "name": "Darth Vader", "age": 63, "headware": ["Helmet", "Sombrero"], "dark_side": true }

12 Schema Free (JSON) { "_id": "BCCD12CBB", "_rev": "2-AB764C", "type": "person", "name": "Darth Vader", "age": 63, "headware": ["Helmet", "Sombrero"], "dark_side": true }

13 Schema Free (JSON) { "_id": "BCCD12CBB", "_rev": "3-AB764C", "type": "person", "name": "Darth Vader", "age": 63, "headware": ["Helmet", "Sombrero"], "dark_side": true } Access Tokens for MVCC, no locking

14 Access Tokens for MVCC attachments Schema Free (JSON) { "_id": "BCCD12CBB", "_rev": "3-AB764C", "type": "person", "name": "Darth Vader", "age": 63, "headware": ["Helmet", "Sombrero"], "dark_side": true }

15 RESTful HTTP API CRUD Create HTTP PUT /db/mydocid Read HTTP GET /db/mydocid Update HTTP PUT /db/mydocid Delete HTTP DELETE /db/mydocid

16 HTTP Infrastructure Your browser curl / wget ext/curl, Net_HTTP, Zend_Http_Client PHPIllow (by Kore Nordmann) Apache mod_proxy (couch.io) Varnish (BBC demo) nginx ( + custom consistent hashing plugin, meebo.com) Custom (Tomcat, BBC)

17 Replication

25 periodic, notifier system

26 Amsterdam San Francisco

27 P2P apps

28 Conflicts

29 Conflict resolution by example A B

30 Conflict resolution by example A B

31 Conflict resolution by example A B

32 Conflict resolution by example A B

33 Conflict resolution by example A B

34 Conflict resolution by example A B

35 Conflict resolution by example A B

36 Conflict resolution by example A B

37 Conflict resolution by example A B

38 Conflict resolution by example A B

39 Conflict resolution by example A B

40 Mind Shifting

42 Where is my auto_increment?

44 ?

46 MOAR RANDOM 128 random bits!

47 UUIDs for identification Natural keys for sorting

48 dropbox Accept Conflicts

49 Referential Integrity, JOINs and related data

50 Referential Integrity When in doubt, look at The Web*: Links can point to 404 (*Yeah, talk

51 JOINs Use the power of Views to create an index that sorts related rows next to each other.

52 JOINs function(doc) { if(doc.type == "post") { emit([doc._id, doc.date], doc); } else if(doc.type == "comment" { emit([doc.post_id, doc.date], doc); }

53 JOINs function(doc) { if(doc.type == "post") { emit([doc._id, doc.date], doc); } else if(doc.type == "comment" { emit([doc.post_id, doc.date], doc); }

54 JOINs emit([doc._id, doc.date], doc); key value ["53421", " "] {"type":"post" } ["53421", " "] {"type":"comment" } ["53421", " "] {"type":"comment" }

55 GET /db/_design/dname/_view/vname? startkey=["53421", null]& endkey=["53421", {}]

56 Evaluating CouchDB

57 make your own cloud resilient storage Evaluating K/V-Stores Technical suitability Healthy (open source) project Failure behaviour Operational complexity Commercial support Speed / Concurrency

58 9k docs, 4 writers, 16 readers CouchDB: 2400 reads/s, 800 writes/s BBC CouchDB reads CouchDB writes MDB reads MDB writes

60 Web: IRC: #couchdb on Freenode Hosting: (invite only) Support: I can haz feedback? *hugs*

61 erlang Questions?

62 ank You!

Database Concepts for a new generation of CMS

Database Concepts for a new generation of CMS Drupal - ezpublish -... Young Media Concepts GmbH November 3, 2008 1 Intro 2 Static database schemes On Flexibility 3 ez Publish Content Model 4 Improvements on ez Publish Linking objects Keys 5 Java Content