(relationship database management. Wang Xiaojiao, Zhang Zhizhong

Size: px
Start display at page:

Download "(relationship database management. Wang Xiaojiao, Zhang Zhizhong"

Transcription

1 NoSQL ( ) NoSQL NoSQL ; NoSQL RDBMS ; ; NoSQL NoSQL;RDBMS; A doi: /j.issn (relationship database management system,rdbms) 5,,. E1 [ ], ;., 2011, 35(5): 113~116 NGN 2G/3G/B3G Research and Implementation of IP Traffic Generation Technology for LTE Network Tester Wang Xiaojiao, Zhang Zhizhong (Key Lab on Communication Networks and Testing Technology, Chongqing University of Posts and Telecommunications, Chongqing , China) Abstract For the test requirements for LTE network tester, the IP traffic generation technology was researched and a double-mode IP traffic generator design scheme was provided. The overall platform design architecture, and working principle, the flow control algorithm in performance mode and the software control method of the data update while sending by the use of reading and writing index in simulation mode were introduced. Practical tests and application demonstrated that the IP traffic generator can send the specified IP packets with fixed quantities and speed, and can simulate high-speed network traffic, which has good performance and can well satisfy the demand for IP data acquisition and simulation test. Key words IP traffic generator, performance mode, flow control, simulation mode, reading and writing index ( : ) 23

2 RDBMS :, NoSQL NoSQL, A B Web not only SQL, non-relational database non-sql ( ), 2 NoSQL NoSQL IT Facebook Google (replica) RDBMS, CAP NoSQL NoSQL :CAP Brewer CAP 3, BASE, 1 NoSQL,Brewer,, NoSQL 2.1 CAP NoSQL, Eric Brewer ACM PODC, Brewer, 3 2 Robust CAP CAP Amazon NoSQL 2.2 BASE CAP (consistency) (availability) wikis blogs (partition tolerance) :,CAP, :,, ( ),, ( ) 1 CAP + ( ) 2PC LDAP xfs + ( ) + ( ) Coda( ) DNS 24

3 3 ACID CAP + Postgres MySQL Vertica Aster Data Greenplum + BigTable Hypertable HBase BerkleyDB Scalars Redias MongoDB Terrastore + Dynamo Voldemort TokyoCabinet KAI SimpleDB CouchDB Riak Cassandra Key-value ACID, CAP, BASE BASE ACID BASE DBMS ACID ACID, (A): BASE ACID BASE 2.3 (C): ; (I):, (D): ACID,,, BASE CAP AP, ACID BASE BASE 3 : BASE ( ) ( ) ( ) ACID BASE, 3 /,, ACID, ( ) ( 2PC 25

4 Paxos) CAP quorum) query,,, Cassandra N (0 1 ) (1 ),, Dynamo 2.4 DNS name NoSQL RDBMS, CAP Read Your Own Writes (RYOW)Consistency, CAP ACID BASE BASE ACID Session Consistency ( ), CAP Casual Consistency X, Y Y X Monotonic Read Consistency, RDBMS, RDBMS,NoSQL GFS,, 3 NoSQL Dynamo sloppy quorum, Quorum, NoSQL NoSQL 4 N 4 NoSQL RDBMS,Dynamo Hinted-handoff ( sloppy NoSQL,,NoSQL 26

5 NoSQL GFS GFS chunk metadata server master-slave Big Table multi-dimensional map row index (B + tree like) dependon GFS Cassandra multi-dimensional map row hash/index optional MongoDB document (JSON) document index master-slave CouchDB document (BSON) document index master-master Dynamo blob blob hash sloppy quorum RDBMS,NoSQL 2PC NoSQL?, RDBMS NoSQL? NoSQL RDBMS? NoSQL RDBMS 4.1 RDBMS, 3 : ( ) T P, RDBMS (scale-up) (3),RDBMS, (scale-out) RDBMS, (1) RDBMS, SQL 30 shared-nothing ACID NoSQL 2PC, I/O SQL,SQL ; BI SQL, (2) WAL DBMS Vertica Greenplum BI IBM DB2 RDBMS BI SQL SQL 27

6 KB ps, (2) RDBMS,NoSQL,,,NoSQL (3), RDBMS NoSQL,, 4.3 NoSQL, ; NoSQL, 3 (1)? RDBMS, RDBMS, NoSQL NoSQL,, 4.2 NoSQL NoSQL,NoSQL (2) RDBMS NoSQL OSS, ACID ACID NoSQL NoSQL 3 (1),NoSQL RDBMS,NoSQL,, RDBMS,NoSQL,,,NoSQL NoSQL OSS (open source software), License RDBMS,,NoSQL NHN Cassandra, NoSQL,,NoSQL, RDBMS OSS (3) 5 4 RDBMS NoSQL? 28

7 RDBMS RDBMS, Oracle SQL NoSQL RDBMS YCSB,RDBMS 6.1 ACID NoSQL RDBMS,,RDBMS NoSQL sharding,, OwFS ( ARCUS ) Web Grennplum Aster PostSQL 5.2 NoSQL RDBMS NoSQL? NoSQL RDBMS, NoSQL NoSQL, NoSQL RDBMS ORM 6.2 YCSB YCSB(Yahoo! cloud server benchmark) NoSQL YCSB Yahoo! NoSQL HBase Cassandra MongoDB,Dynamo BigTable NoSQL API RDBMS YCSB,,Hadoop MapReduce 6 NoSQL Benchmarking,, NoSQL YCSB,, NoSQL,, NoSQL NoSQL YCSB,, 29

8 YCSB, NoSQL Internetional Journal of Advanced Engineerin Sceince and Tecnologies, 2011,11(1) VoltDB, 2 Christof S. NoSQL Database. Hochschule Der Medien, Stuttgart, 2011,, 3 Lee K J. What is NoSQL for , 4. : NoSQL, 2011(34) 5 Tudorica B G. A comparison between several NoSQL databases with comments and notes. Roedunet International Conference 7 (RoEduNet), Iasi, Romania, Cattell R. Scalable SQL and NoSQL Data Stores. ACM SIGMOD NoSQL Record, 2011 NoSQL RDBMS 7. NoSQL, NoSQL RDBMS, 2011, 4(7) 8 Michael S. SQL databases vs NoSQL databases. Communications of the ACM, 2010, 53(4) HadoopDB SQL 9 Laurent A, Sala M, Laurent B, et al. Reduce, you say: what, ASTER query MapReduce NoSQL can do for data aggregation and BI in large repositories. NoSQL, 22nd International Workshop on Database and Expert Systems, Applications (DEXA), Tauro C J M, Aravindh S, Shreeharsha A B. Comparative study of thenewgeneration,agile,scalable,highperformance NoSQL databases., International Journal of Computer Applications, 2012, 48(20) 11 Schneider S A. Big data: big challenge, big opportunity Padhy R P, Patra M R, Satapathy S C. RDBMS to NoSQL: reviewing some next-generation non-relational database s... [ ], ; Study on NoSQL Theory and Database Li Fengxiao,Luo Gaosong (Guangzhou Useease Information Technology Co., Ltd., Guangzhou , China) Abstract NoSQL is becoming a popular term among web developers of large corporations, and it seems to be universalization soon. This article focused on the basic concept of NoSQL, based on which a compare between RDBMS and NoSQL was given, then the choice of database in different context was discussed. At last, NoSQL benchmarking was showed to help users to choose NoSQL databases. Key words NoSQL, RDBMS, data management system ( : ) 30

Structured Data Storage

Structured Data Storage Structured Data Storage Xgen Congress Short Course 2010 Adam Kraut BioTeam Inc. Independent Consulting Shop: Vendor/technology agnostic Staffed by: Scientists forced to learn High Performance IT to conduct

More information

Lecture Data Warehouse Systems

Lecture Data Warehouse Systems Lecture Data Warehouse Systems Eva Zangerle SS 2013 PART C: Novel Approaches in DW NoSQL and MapReduce Stonebraker on Data Warehouses Star and snowflake schemas are a good idea in the DW world C-Stores

More information

extensible record stores document stores key-value stores Rick Cattel s clustering from Scalable SQL and NoSQL Data Stores SIGMOD Record, 2010

extensible record stores document stores key-value stores Rick Cattel s clustering from Scalable SQL and NoSQL Data Stores SIGMOD Record, 2010 System/ Scale to Primary Secondary Joins/ Integrity Language/ Data Year Paper 1000s Index Indexes Transactions Analytics Constraints Views Algebra model my label 1971 RDBMS O tables sql-like 2003 memcached

More information

Cloud Scale Distributed Data Storage. Jürmo Mehine

Cloud Scale Distributed Data Storage. Jürmo Mehine Cloud Scale Distributed Data Storage Jürmo Mehine 2014 Outline Background Relational model Database scaling Keys, values and aggregates The NoSQL landscape Non-relational data models Key-value Document-oriented

More information

SQL VS. NO-SQL. Adapted Slides from Dr. Jennifer Widom from Stanford

SQL VS. NO-SQL. Adapted Slides from Dr. Jennifer Widom from Stanford SQL VS. NO-SQL Adapted Slides from Dr. Jennifer Widom from Stanford 55 Traditional Databases SQL = Traditional relational DBMS Hugely popular among data analysts Widely adopted for transaction systems

More information

Introduction to NOSQL

Introduction to NOSQL Introduction to NOSQL Université Paris-Est Marne la Vallée, LIGM UMR CNRS 8049, France January 31, 2014 Motivations NOSQL stands for Not Only SQL Motivations Exponential growth of data set size (161Eo

More information

Mobile + HA + Cloud. Eugene Ciurana! ! pr3d4t0r - irc.freenode.net! ##java, ##security, #awk, #python, #bitcoin! irc.oftc.net: #tor, #tor-dev, #tails!

Mobile + HA + Cloud. Eugene Ciurana! ! pr3d4t0r - irc.freenode.net! ##java, ##security, #awk, #python, #bitcoin! irc.oftc.net: #tor, #tor-dev, #tails! Mobile + HA + Cloud Eugene Ciurana!! pr3d4t0r - irc.freenode.net! ##java, ##security, #awk, #python, #bitcoin! irc.oftc.net: #tor, #tor-dev, #tails!! qcon2014@cime.net About Eugene... 15+ years building

More information

Preparing Your Data For Cloud

Preparing Your Data For Cloud Preparing Your Data For Cloud Narinder Kumar Inphina Technologies 1 Agenda Relational DBMS's : Pros & Cons Non-Relational DBMS's : Pros & Cons Types of Non-Relational DBMS's Current Market State Applicability

More information

NoSQL Databases. Institute of Computer Science Databases and Information Systems (DBIS) DB 2, WS 2014/2015

NoSQL Databases. Institute of Computer Science Databases and Information Systems (DBIS) DB 2, WS 2014/2015 NoSQL Databases Institute of Computer Science Databases and Information Systems (DBIS) DB 2, WS 2014/2015 Database Landscape Source: H. Lim, Y. Han, and S. Babu, How to Fit when No One Size Fits., in CIDR,

More information

Can the Elephants Handle the NoSQL Onslaught?

Can the Elephants Handle the NoSQL Onslaught? Can the Elephants Handle the NoSQL Onslaught? Avrilia Floratou, Nikhil Teletia David J. DeWitt, Jignesh M. Patel, Donghui Zhang University of Wisconsin-Madison Microsoft Jim Gray Systems Lab Presented

More information

Databases : Lecture 11 : Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2014. Apologies to Martin Fowler ( NoSQL Distilled )

Databases : Lecture 11 : Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2014. Apologies to Martin Fowler ( NoSQL Distilled ) Databases : Lecture 11 : Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2014 Rise of Web and cluster-based computing NoSQL Movement Relationships vs. Aggregates Key-value store XML or JSON

More information

The NoSQL Ecosystem, Relaxed Consistency, and Snoop Dogg. Adam Marcus MIT CSAIL marcua@csail.mit.edu / @marcua

The NoSQL Ecosystem, Relaxed Consistency, and Snoop Dogg. Adam Marcus MIT CSAIL marcua@csail.mit.edu / @marcua The NoSQL Ecosystem, Relaxed Consistency, and Snoop Dogg Adam Marcus MIT CSAIL marcua@csail.mit.edu / @marcua About Me Social Computing + Database Systems Easily Distracted: Wrote The NoSQL Ecosystem in

More information

wow CPSC350 relational schemas table normalization practical use of relational algebraic operators tuple relational calculus and their expression in a declarative query language relational schemas CPSC350

More information

nosql and Non Relational Databases

nosql and Non Relational Databases nosql and Non Relational Databases Image src: http://www.pentaho.com/big-data/nosql/ Matthias Lee Johns Hopkins University What NoSQL? Yes no SQL.. Atleast not only SQL Large class of Non Relaltional Databases

More information

NoSQL Databases. Nikos Parlavantzas

NoSQL Databases. Nikos Parlavantzas !!!! NoSQL Databases Nikos Parlavantzas Lecture overview 2 Objective! Present the main concepts necessary for understanding NoSQL databases! Provide an overview of current NoSQL technologies Outline 3!

More information

How To Write A Database Program

How To Write A Database Program SQL, NoSQL, and Next Generation DBMSs Shahram Ghandeharizadeh Director of the USC Database Lab Outline A brief history of DBMSs. OSs SQL NoSQL 1960/70 1980+ 2000+ Before Computers Database DBMS/Data Store

More information

NoSQL Systems for Big Data Management

NoSQL Systems for Big Data Management NoSQL Systems for Big Data Management Venkat N Gudivada East Carolina University Greenville, North Carolina USA Venkat Gudivada NoSQL Systems for Big Data Management 1/28 Outline 1 An Overview of NoSQL

More information

NewSQL: Towards Next-Generation Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management

NewSQL: Towards Next-Generation Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management NewSQL: Towards Next-Generation Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management A B M Moniruzzaman Department of Computer Science and Engineering, Daffodil International

More information

Advanced Data Management Technologies

Advanced Data Management Technologies ADMT 2014/15 Unit 15 J. Gamper 1/44 Advanced Data Management Technologies Unit 15 Introduction to NoSQL J. Gamper Free University of Bozen-Bolzano Faculty of Computer Science IDSE ADMT 2014/15 Unit 15

More information

LARGE-SCALE DATA STORAGE APPLICATIONS

LARGE-SCALE DATA STORAGE APPLICATIONS BENCHMARKING AVAILABILITY AND FAILOVER PERFORMANCE OF LARGE-SCALE DATA STORAGE APPLICATIONS Wei Sun and Alexander Pokluda December 2, 2013 Outline Goal and Motivation Overview of Cassandra and Voldemort

More information

Slave. Master. Research Scholar, Bharathiar University

Slave. Master. Research Scholar, Bharathiar University Volume 3, Issue 7, July 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper online at: www.ijarcsse.com Study on Basically, and Eventually

More information

Choosing the right NoSQL database for the job: a quality attribute evaluation

Choosing the right NoSQL database for the job: a quality attribute evaluation Lourenço et al. Journal of Big Data (2015) 2:18 DOI 10.1186/s40537-015-0025-0 RESEARCH Choosing the right NoSQL database for the job: a quality attribute evaluation João Ricardo Lourenço 1*, Bruno Cabral

More information

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect IT Insight podcast This podcast belongs to the IT Insight series You can subscribe to the podcast through

More information

Big Data Technologies. Prof. Dr. Uta Störl Hochschule Darmstadt Fachbereich Informatik Sommersemester 2015

Big Data Technologies. Prof. Dr. Uta Störl Hochschule Darmstadt Fachbereich Informatik Sommersemester 2015 Big Data Technologies Prof. Dr. Uta Störl Hochschule Darmstadt Fachbereich Informatik Sommersemester 2015 Situation: Bigger and Bigger Volumes of Data Big Data Use Cases Log Analytics (Web Logs, Sensor

More information

3 Case Studies of NoSQL and Java Apps in the Real World

3 Case Studies of NoSQL and Java Apps in the Real World Eugene Ciurana geecon@ciurana.eu - pr3d4t0r ##java, irc.freenode.net 3 Case Studies of NoSQL and Java Apps in the Real World This presentation is available from: http://ciurana.eu/geecon-2011 About Eugene...

More information

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world Analytics March 2015 White paper Why NoSQL? Your database options in the new non-relational world 2 Why NoSQL? Contents 2 New types of apps are generating new types of data 2 A brief history of NoSQL 3

More information

BRAC. Investigating Cloud Data Storage UNIVERSITY SCHOOL OF ENGINEERING. SUPERVISOR: Dr. Mumit Khan DEPARTMENT OF COMPUTER SCIENCE AND ENGEENIRING

BRAC. Investigating Cloud Data Storage UNIVERSITY SCHOOL OF ENGINEERING. SUPERVISOR: Dr. Mumit Khan DEPARTMENT OF COMPUTER SCIENCE AND ENGEENIRING BRAC UNIVERSITY SCHOOL OF ENGINEERING DEPARTMENT OF COMPUTER SCIENCE AND ENGEENIRING 12-12-2012 Investigating Cloud Data Storage Sumaiya Binte Mostafa (ID 08301001) Firoza Tabassum (ID 09101028) BRAC University

More information

Applications for Big Data Analytics

Applications for Big Data Analytics Smarter Healthcare Applications for Big Data Analytics Multi-channel sales Finance Log Analysis Homeland Security Traffic Control Telecom Search Quality Manufacturing Trading Analytics Fraud and Risk Retail:

More information

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1 Why NoSQL? Your database options in the new non- relational world 2015 IBM Cloudant 1 Table of Contents New types of apps are generating new types of data... 3 A brief history on NoSQL... 3 NoSQL s roots

More information

Amr El Abbadi. Computer Science, UC Santa Barbara amr@cs.ucsb.edu

Amr El Abbadi. Computer Science, UC Santa Barbara amr@cs.ucsb.edu Amr El Abbadi Computer Science, UC Santa Barbara amr@cs.ucsb.edu Collaborators: Divy Agrawal, Sudipto Das, Aaron Elmore, Hatem Mahmoud, Faisal Nawab, and Stacy Patterson. Client Site Client Site Client

More information

Introduction to NoSQL

Introduction to NoSQL Introduction to NoSQL NoSQL Seminar 2012 @ TUT Arto Salminen What is NoSQL? Class of database management systems (DBMS) "Not only SQL" Does not use SQL as querying language Distributed, fault-tolerant

More information

NoSQL Evaluation. A Use Case Oriented Survey

NoSQL Evaluation. A Use Case Oriented Survey 2011 International Conference on Cloud and Service Computing NoSQL Evaluation A Use Case Oriented Survey Robin Hecht Chair of Applied Computer Science IV University ofbayreuth Bayreuth, Germany robin.hecht@uni

More information

Yahoo! Cloud Serving Benchmark

Yahoo! Cloud Serving Benchmark Yahoo! Cloud Serving Benchmark Overview and results March 31, 2010 Brian F. Cooper cooperb@yahoo-inc.com Joint work with Adam Silberstein, Erwin Tam, Raghu Ramakrishnan and Russell Sears System setup and

More information

NoSQL Databases: a step to database scalability in Web environment

NoSQL Databases: a step to database scalability in Web environment NoSQL Databases: a step to database scalability in Web environment Jaroslav Pokorny Charles University, Faculty of Mathematics and Physics, Malostranske n. 25, 118 00 Praha 1 Czech Republic +420-221914265

More information

An Approach to Implement Map Reduce with NoSQL Databases

An Approach to Implement Map Reduce with NoSQL Databases www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 8 Aug 2015, Page No. 13635-13639 An Approach to Implement Map Reduce with NoSQL Databases Ashutosh

More information

New database architectures: steps toward Big Data processing

New database architectures: steps toward Big Data processing New database architectures: steps toward Big Data processing J. Pokorný Faculty of Mathematics and Physics, Charles University, Prague Czech Republic Griffith Uni, Feb 13, 2014 1 Where Prague is? Prague

More information

What Next for DBAs in the Big Data Era

What Next for DBAs in the Big Data Era What Next for DBAs in the Big Data Era February 21 st, 2015 Copyright 2013. Apps Associates LLC. 1 Satyendra Kumar Pasalapudi Associate Practice Director IMS @ Apps Associates Co Founder & President of

More information

CPS 516: Data-intensive Computing Systems. Instructor: Shivnath Babu TA: Zilong (Eric) Tan

CPS 516: Data-intensive Computing Systems. Instructor: Shivnath Babu TA: Zilong (Eric) Tan CPS 516: Data-intensive Computing Systems Instructor: Shivnath Babu TA: Zilong (Eric) Tan The World of Big Data ebay had 6.5 PB of user data + 50 TB/day in 2009 From http://www.umiacs.umd.edu/~jimmylin/

More information

Composite Data Virtualization Composite Data Virtualization And NOSQL Data Stores

Composite Data Virtualization Composite Data Virtualization And NOSQL Data Stores Composite Data Virtualization Composite Data Virtualization And NOSQL Data Stores Composite Software October 2010 TABLE OF CONTENTS INTRODUCTION... 3 BUSINESS AND IT DRIVERS... 4 NOSQL DATA STORES LANDSCAPE...

More information

The Research and Application of a Big Data Storage Model

The Research and Application of a Big Data Storage Model , pp.319-330 http://dx.doi.org/10.14257/ijdta.2015.8.4.32 The Research and Application of a Big Data Storage Model Na Liu 1 and Jianfei Zhou 2 1 School of Information Engineering, Chongqing Industry Polytechnic

More information

INTERNATIONAL JOURNAL of RESEARCH GRANTHAALAYAH A knowledge Repository

INTERNATIONAL JOURNAL of RESEARCH GRANTHAALAYAH A knowledge Repository A NOVEL TECHNIQUE IN NoSQL DATA EXTRACTION Renu Chaudhary * 1, Gagangeet Singh 2 *1 Computer, Chandigarh Engineering College, Landran, Punjab, INDIA 2 Computer, Chandigarh Engineering College, Landran,

More information

Not Relational Models For The Management of Large Amount of Astronomical Data. Bruno Martino (IASI/CNR), Memmo Federici (IAPS/INAF)

Not Relational Models For The Management of Large Amount of Astronomical Data. Bruno Martino (IASI/CNR), Memmo Federici (IAPS/INAF) Not Relational Models For The Management of Large Amount of Astronomical Data Bruno Martino (IASI/CNR), Memmo Federici (IAPS/INAF) What is a DBMS A Data Base Management System is a software infrastructure

More information

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE @GEOFFLANE WHAT IS NOSQL? NON-RELATIONAL DATA STORAGE USUALLY SCHEMA-FREE ACCESS DATA WITHOUT SQL (THUS... NOSQL) WIDE-COLUMN / TABULAR

More information

Study and Comparison of Elastic Cloud Databases : Myth or Reality?

Study and Comparison of Elastic Cloud Databases : Myth or Reality? Université Catholique de Louvain Ecole Polytechnique de Louvain Computer Engineering Department Study and Comparison of Elastic Cloud Databases : Myth or Reality? Promoters: Peter Van Roy Sabri Skhiri

More information

How To Scale Out Of A Nosql Database

How To Scale Out Of A Nosql Database Firebird meets NoSQL (Apache HBase) Case Study Firebird Conference 2011 Luxembourg 25.11.2011 26.11.2011 Thomas Steinmaurer DI +43 7236 3343 896 thomas.steinmaurer@scch.at www.scch.at Michael Zwick DI

More information

The Quest for Extreme Scalability

The Quest for Extreme Scalability The Quest for Extreme Scalability In times of a growing audience, very successful internet applications have all been facing the same database issue: while web servers can be multiplied without too many

More information

MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15

MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15 MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15 1 MongoDB in the NoSQL and SQL world. NoSQL What? Why? - How? Say goodbye to ACID, hello BASE You

More information

NoSQL Database Options

NoSQL Database Options NoSQL Database Options Introduction For this report, I chose to look at MongoDB, Cassandra, and Riak. I chose MongoDB because it is quite commonly used in the industry. I chose Cassandra because it has

More information

Introduction to NoSQL Databases. Tore Risch Information Technology Uppsala University 2013-03-05

Introduction to NoSQL Databases. Tore Risch Information Technology Uppsala University 2013-03-05 Introduction to NoSQL Databases Tore Risch Information Technology Uppsala University 2013-03-05 UDBL Tore Risch Uppsala University, Sweden Evolution of DBMS technology Distributed databases SQL 1960 1970

More information

DISTRIBUTED DATABASES SOME APPROACHES, MODELS AND CURRENT TRENDS

DISTRIBUTED DATABASES SOME APPROACHES, MODELS AND CURRENT TRENDS Trakia Journal of Sciences, Vol. 13, Suppl. 1, pp 414-419, 2015 Copyright 2015 Trakia University Available online at: http://www.uni-sz.bg ISSN 1313-7069 (print) doi:10.15547/tjs.2015.s.01.071 ISSN 1313-3551

More information

Performance Analysis for NoSQL and SQL

Performance Analysis for NoSQL and SQL Available online at www.ijiere.com International Journal of Innovative and Emerging Research in Engineering e-issn: 2394-3343 p-issn: 2394-5494 Performance Analysis for NoSQL and SQL Ms. Megha Katkar ME

More information

An Open Source NoSQL solution for Internet Access Logs Analysis

An Open Source NoSQL solution for Internet Access Logs Analysis An Open Source NoSQL solution for Internet Access Logs Analysis A practical case of why, what and how to use a NoSQL Database Management System instead of a relational one José Manuel Ciges Regueiro

More information

Performance Evaluation of NoSQL Systems Using YCSB in a resource Austere Environment

Performance Evaluation of NoSQL Systems Using YCSB in a resource Austere Environment International Journal of Applied Information Systems (IJAIS) ISSN : 2249-868 Performance Evaluation of NoSQL Systems Using YCSB in a resource Austere Environment Yusuf Abubakar Department of Computer Science

More information

Big Data Management. Big Data Management. (BDM) Autumn 2013. Povl Koch September 30, 2013 29-09-2013 1

Big Data Management. Big Data Management. (BDM) Autumn 2013. Povl Koch September 30, 2013 29-09-2013 1 Big Data Management Big Data Management (BDM) Autumn 2013 Povl Koch September 30, 2013 29-09-2013 1 Overview Today s program 1. Little more practical details about this course 2. Recap from last time 3.

More information

Introduction to Big Data Training

Introduction to Big Data Training Introduction to Big Data Training The quickest way to be introduce with NOSQL/BIG DATA offerings Learn and experience Big Data Solutions including Hadoop HDFS, Map Reduce, NoSQL DBs: Document Based DB

More information

Cloud & Big Data a perfect marriage? Patrick Valduriez

Cloud & Big Data a perfect marriage? Patrick Valduriez Cloud & Big Data a perfect marriage? Patrick Valduriez Cloud & Big Data: the hype! 2 Cloud & Big Data: the hype! 3 Behind the Hype? Every one who wants to make big money Intel, IBM, Microsoft, Oracle,

More information

NoSQL Data Base Basics

NoSQL Data Base Basics NoSQL Data Base Basics Course Notes in Transparency Format Cloud Computing MIRI (CLC-MIRI) UPC Master in Innovation & Research in Informatics Spring- 2013 Jordi Torres, UPC - BSC www.jorditorres.eu HDFS

More information

Survey of NoSQL Database Engines for Big Data

Survey of NoSQL Database Engines for Big Data Aalto University School of Science Master s Programme in ICT Innovation Kuldeep Singh Survey of NoSQL Database Engines for Big Data Master s Thesis Espoo, May 11, 2015 Supervisor: Advisor: Assoc. Prof.

More information

A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA

A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA Ompal Singh Assistant Professor, Computer Science & Engineering, Sharda University, (India) ABSTRACT In the new era of distributed system where

More information

Crazy NoSQL Data Integration with Pentaho

Crazy NoSQL Data Integration with Pentaho Crazy NoSQL Data Integration with Pentaho NoSQL Matters, Cologne Germany May 30 th, 2012 Matt Casters About Matt Chief of Data Integration at Pentaho Lead Development Project manager Community contact

More information

Comparing Scalable NOSQL Databases

Comparing Scalable NOSQL Databases Comparing Scalable NOSQL Databases Functionalities and Measurements Dory Thibault UCL Contact : thibault.dory@student.uclouvain.be Sponsor : Euranova Website : nosqlbenchmarking.com February 15, 2011 Clarications

More information

Cassandra A Decentralized Structured Storage System

Cassandra A Decentralized Structured Storage System Cassandra A Decentralized Structured Storage System Avinash Lakshman, Prashant Malik LADIS 2009 Anand Iyer CS 294-110, Fall 2015 Historic Context Early & mid 2000: Web applicaoons grow at tremendous rates

More information

Institutionen för datavetenskap Department of Computer and Information Science

Institutionen för datavetenskap Department of Computer and Information Science Institutionen för datavetenskap Department of Computer and Information Science Final thesis Exploration of NoSQL Technologies for managing hotel reservations by Sylvain Coulombel LiTH-IDA/ERASMUS-A--15/001--SE

More information

Scalable SQL and NoSQL Data Stores

Scalable SQL and NoSQL Data Stores Scalable SQL and NoSQL Data Stores Rick Cattell Cattell.Net Software Email: rick@cattell.net ABSTRACT In this paper, we examine a number of SQL and socalled NoSQL data stores designed to scale simple OLTP-style

More information

Benchmarking and Analysis of NoSQL Technologies

Benchmarking and Analysis of NoSQL Technologies Benchmarking and Analysis of NoSQL Technologies Suman Kashyap 1, Shruti Zamwar 2, Tanvi Bhavsar 3, Snigdha Singh 4 1,2,3,4 Cummins College of Engineering for Women, Karvenagar, Pune 411052 Abstract The

More information

NoSQL and Hadoop Technologies On Oracle Cloud

NoSQL and Hadoop Technologies On Oracle Cloud NoSQL and Hadoop Technologies On Oracle Cloud Vatika Sharma 1, Meenu Dave 2 1 M.Tech. Scholar, Department of CSE, Jagan Nath University, Jaipur, India 2 Assistant Professor, Department of CSE, Jagan Nath

More information

Introduction to NoSQL

Introduction to NoSQL Introduction to NoSQL Gabriele Pozzani April 24, 2013 Outline NoSQL Definition Categories Related concepts Modeling NoSQL stores Properties Performance Relational vs NoSQL DBMSs Applications What does

More information

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research &

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & Innovation 04-08-2011 to the EC 8 th February, Luxembourg Your Atos business Research technologists. and Innovation

More information

Big Data Analytics: Hadoop-Map Reduce & NoSQL Databases

Big Data Analytics: Hadoop-Map Reduce & NoSQL Databases Big Data Analytics: Hadoop-Map Reduce & NoSQL Databases Abinav Pothuganti Computer Science and Engineering, CBIT,Hyderabad, Telangana, India Abstract Today, we are surrounded by data like oxygen. The exponential

More information

Application of NoSQL Database in Web Crawling

Application of NoSQL Database in Web Crawling Application of NoSQL Database in Web Crawling College of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, 210044, China doi:10.4156/jdcta.vol5.issue6.31 Abstract

More information

Evaluating Google App Engine for Enterprise Application Development

Evaluating Google App Engine for Enterprise Application Development Master Thesis Software Engineering Thesis no: MSE-2011:50 June 2011 Evaluating Google App Engine for Enterprise Application Development Comparison of Performance and Development Environment Kashif Khan

More information

Hurtownie Danych i Business Intelligence: Big Data

Hurtownie Danych i Business Intelligence: Big Data Hurtownie Danych i Business Intelligence: Big Data Robert Wrembel Politechnika Poznańska Instytut Informatyki Robert.Wrembel@cs.put.poznan.pl www.cs.put.poznan.pl/rwrembel Outline Introduction to Big Data

More information

NoSQL Database Systems and their Security Challenges

NoSQL Database Systems and their Security Challenges NoSQL Database Systems and their Security Challenges Morteza Amini amini@sharif.edu Data & Network Security Lab (DNSL) Department of Computer Engineering Sharif University of Technology September 25 2

More information

CISC 432/CMPE 432/CISC 832 Advanced Database Systems

CISC 432/CMPE 432/CISC 832 Advanced Database Systems CISC 432/CMPE 432/CISC 832 Advanced Database Systems Course Info Instructor: Patrick Martin Goodwin Hall 630 613 533 6063 martin@cs.queensu.ca Office Hours: Wednesday 11:00 1:00 or by appointment Schedule:

More information

Survey of Large-Scale Data Management Systems for Big Data Applications

Survey of Large-Scale Data Management Systems for Big Data Applications Wu L, Yuan L, You J. Survey of large-scale data management systems for big data applications. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 30(1): 163 183 Jan. 2015. DOI 10.1007/s11390-015-1511-8 Survey of

More information

MASTER PROJECT. Resource Provisioning for NoSQL Datastores

MASTER PROJECT. Resource Provisioning for NoSQL Datastores Vrije Universiteit Amsterdam MASTER PROJECT - Parallel and Distributed Computer Systems - Resource Provisioning for NoSQL Datastores Scientific Adviser Dr. Guillaume Pierre Author Eng. Mihai-Dorin Istin

More information

Making Sense ofnosql A GUIDE FOR MANAGERS AND THE REST OF US DAN MCCREARY MANNING ANN KELLY. Shelter Island

Making Sense ofnosql A GUIDE FOR MANAGERS AND THE REST OF US DAN MCCREARY MANNING ANN KELLY. Shelter Island Making Sense ofnosql A GUIDE FOR MANAGERS AND THE REST OF US DAN MCCREARY ANN KELLY II MANNING Shelter Island contents foreword preface xvii xix acknowledgments xxi about this book xxii Part 1 Introduction

More information

NoSQL replacement for SQLite (for Beatstream) Antti-Jussi Kovalainen Seminar OHJ-1860: NoSQL databases

NoSQL replacement for SQLite (for Beatstream) Antti-Jussi Kovalainen Seminar OHJ-1860: NoSQL databases NoSQL replacement for SQLite (for Beatstream) Antti-Jussi Kovalainen Seminar OHJ-1860: NoSQL databases Background Inspiration: postgresapp.com demo.beatstream.fi (modern desktop browsers without

More information

An Oracle White Paper February 2011. Hadoop and NoSQL Technologies and the Oracle Database

An Oracle White Paper February 2011. Hadoop and NoSQL Technologies and the Oracle Database An Oracle White Paper February 2011 Hadoop and NoSQL Technologies and the Oracle Database Disclaimer The following is intended to outline our general product direction. It is intended for information purposes

More information

The CAP theorem and the design of large scale distributed systems: Part I

The CAP theorem and the design of large scale distributed systems: Part I The CAP theorem and the design of large scale distributed systems: Part I Silvia Bonomi University of Rome La Sapienza www.dis.uniroma1.it/~bonomi Great Ideas in Computer Science & Engineering A.A. 2012/2013

More information

The Cloud Trade Off IBM Haifa Research Storage Systems

The Cloud Trade Off IBM Haifa Research Storage Systems The Cloud Trade Off IBM Haifa Research Storage Systems 1 Fundamental Requirements form Cloud Storage Systems The Google File System first design consideration: component failures are the norm rather than

More information

NoSQL Database: New Era of Databases for Big data Analytics - Classification, Characteristics and Comparison

NoSQL Database: New Era of Databases for Big data Analytics - Classification, Characteristics and Comparison NoSQL Database: New Era of Databases for Big data Analytics - Classification, Characteristics and Comparison A B M Moniruzzaman and Syed Akhter Hossain Department of Computer Science and Engineering Daffodil

More information

<Insert Picture Here> Oracle NoSQL Database A Distributed Key-Value Store

<Insert Picture Here> Oracle NoSQL Database A Distributed Key-Value Store Oracle NoSQL Database A Distributed Key-Value Store Charles Lamb, Consulting MTS The following is intended to outline our general product direction. It is intended for information

More information

MongoDB Developer and Administrator Certification Course Agenda

MongoDB Developer and Administrator Certification Course Agenda MongoDB Developer and Administrator Certification Course Agenda Lesson 1: NoSQL Database Introduction What is NoSQL? Why NoSQL? Difference Between RDBMS and NoSQL Databases Benefits of NoSQL Types of NoSQL

More information

Composite Software Data Virtualization Turbocharge Analytics with Big Data and Data Virtualization

Composite Software Data Virtualization Turbocharge Analytics with Big Data and Data Virtualization Composite Software Data Virtualization Turbocharge Analytics with Big Data and Data Virtualization Composite Software, Inc. June 2011 TABLE OF CONTENTS INTRODUCTION... 3 PROBLEM ANALYTICS PUSH THE LIMITS

More information

Open source large scale distributed data management with Google s MapReduce and Bigtable

Open source large scale distributed data management with Google s MapReduce and Bigtable Open source large scale distributed data management with Google s MapReduce and Bigtable Ioannis Konstantinou Email: ikons@cslab.ece.ntua.gr Web: http://www.cslab.ntua.gr/~ikons Computing Systems Laboratory

More information

Evaluating NoSQL for Enterprise Applications. Dirk Bartels VP Strategy & Marketing

Evaluating NoSQL for Enterprise Applications. Dirk Bartels VP Strategy & Marketing Evaluating NoSQL for Enterprise Applications Dirk Bartels VP Strategy & Marketing Agenda The Real Time Enterprise The Data Gold Rush Managing The Data Tsunami Analytics and Data Case Studies Where to go

More information

Scalable Cloud Computing

Scalable Cloud Computing Scalable Cloud Computing Keijo Heljanko Department of Information and Computer Science School of Science Aalto University keijo.heljanko@aalto.fi 10.10-2012 1/57 Guest Lecturer Guest Lecturer: Prof. Keijo

More information

Overview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB

Overview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB Overview of Databases On MacOS Karl Kuehn Automation Engineer RethinkDB Session Goals Introduce Database concepts Show example players Not Goals: Cover non-macos systems (Oracle) Teach you SQL Answer what

More information

NoSQL. What Is NoSQL? Why NoSQL?

NoSQL. What Is NoSQL? Why NoSQL? SYSADMIN NoSQL GREG BURD Greg Burd is a Developer Advocate for Basho Technologies, makers of Riak. Before Basho, Greg spent nearly ten years as the product manager for Berkeley DB at Sleepycat Software

More information

Parallel Techniques for Big Data. Patrick Valduriez INRIA, Montpellier

Parallel Techniques for Big Data. Patrick Valduriez INRIA, Montpellier Parallel Techniques for Big Data Patrick Valduriez INRIA, Montpellier 1 Outline of the Talk Big data: problem and issues Parallel data processing Parallel architectures Parallel techniques Cloud data mgt

More information

NoSQL. Thomas Neumann 1 / 22

NoSQL. Thomas Neumann 1 / 22 NoSQL Thomas Neumann 1 / 22 What are NoSQL databases? hard to say more a theme than a well defined thing Usually some or all of the following: no SQL interface no relational model / no schema no joins,

More information

A Scalable Relational Database Model for Cloud Computing

A Scalable Relational Database Model for Cloud Computing A Scalable Relational Database Model for Cloud Computing Otara Paul Richard Reg. No: 2005/HD18/0105U B.Sc (Computer Science, Mathematics)(Mak), OCP A Dissertation Submitted to the Directorate of Research

More information

Scalable SQL and NoSQL Data Stores

Scalable SQL and NoSQL Data Stores Scalable SQL and NoSQL Data Stores Rick Cattell Originally published in 2010, last revised December 2011 ABSTRACT In this paper, we examine a number of SQL and socalled NoSQL data stores designed to scale

More information

Big Systems, Big Data

Big Systems, Big Data Big Systems, Big Data When considering Big Distributed Systems, it can be noted that a major concern is dealing with data, and in particular, Big Data Have general data issues (such as latency, availability,

More information

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Dave Dykstra dwd@fnal.gov Fermilab is operated by the Fermi Research Alliance, LLC under contract No. DE-AC02-07CH11359

More information

MapReduce with Apache Hadoop Analysing Big Data

MapReduce with Apache Hadoop Analysing Big Data MapReduce with Apache Hadoop Analysing Big Data April 2010 Gavin Heavyside gavin.heavyside@journeydynamics.com About Journey Dynamics Founded in 2006 to develop software technology to address the issues

More information

So What s the Big Deal?

So What s the Big Deal? So What s the Big Deal? Presentation Agenda Introduction What is Big Data? So What is the Big Deal? Big Data Technologies Identifying Big Data Opportunities Conducting a Big Data Proof of Concept Big Data

More information

Parallel Techniques for Big Data. Patrick Valduriez

Parallel Techniques for Big Data. Patrick Valduriez Parallel Techniques for Big Data Patrick Valduriez 1 1 Outline of the Talk Big data: problem and solution Parallel data processing Data-based parallelism Parallel architectures Parallel techniques NoSQL

More information

NOSQL VS RDBMS - WHY THERE IS ROOM FOR BOTH

NOSQL VS RDBMS - WHY THERE IS ROOM FOR BOTH NOSQL VS RDBMS - WHY THERE IS ROOM FOR BOTH Cory Nance cory_a_nance@georgiasouthern.edu Travis Losser travis_w_losser@georgiasouthern.edu Reenu Iype reenu_m_iype@georgiasouthern.edu Gary Harmon gary_r_harmon@georgiasouthern.edu

More information