How To Write A Free Software Program In Java.Org (For Free)

Size: px
Start display at page:

Download "How To Write A Free Software Program In Java.Org (For Free)"

Transcription

1 für Java Entwickler und Architekten - Schema Evolution und Maintenance { } "name" : "Timmo Freudl-Gierke", "twitter" : "@timmo_gierke", "blog" : "

2

3

4 humongous enorm gigantisch riesig

5 Schema Free

6 Hierarchie

7 BSON Open Source GNU AGPL v3.0. Apache License v2.0.

8 Ziel Platformen

9 Mongo Konsole

10

11

12 Continuous Deployment Später mehr...

13

14 Application Domain Model Schema / JSON Structure { } name : "Schulze", strasse : "Sonntagstr. 20", plz : "10245", ort : "Berlin",

15 MongoDB Java Driver DBObject document = new BasicDBObject("name", "Schulze"); document.put("strasse", "Sonntagstr. 20");... { } "_id" : ObjectId("4f7258da dfe6a1a8"), "name" : "Schulze", "strasse" : "Sonntagstr. 20"

16 Unit Test - Setup

17 Unit Test - Mongo Driver

18 Object - Document Mapper Spring Data MongoDB Jackson Mapper MongoTemplate Exception Translation Rich Object Mapping Lifecycle Events Repository Support Wraps Mongo DB + Collection API Full Jackson Extensibility Fast javax.persistence style Annotation Based Mapping DAO Support

19 Unit Test

20

21 1) 3) 2) 1)

22 1) { name : "Schulze", strasse : "Sonntagstr. 20", plz : "10245", ort : "Berlin", } 2) { name : "Schulze", adresse : { strasse : "Sonntagstr. 20", plz : "10245", ort : "Berlin", } } 1) 3) { name : "Schulze", adresse : { strasse : "Sonntagstr.", hausnummer : "20", plz : "10245", ort : "Berlin", } }

23 1 Javascript

24 1 Javascript Field Renaming {$rename : {"oldfieldname" : "newfieldname"} } db.personen.update({},{$rename:{"strasse":"adresse.strasse"}},0,1) db.personen.update({},{$rename:{"plz":"adresse.plz"}},0,1) db.personen.update({},{$rename:{"ort":"adresse.ort"}},0,1)

25 1 Javascript Field Splitting var personen = db.personen.find({}) personen.foreach( function(p) { if (p.adresse!= null) { var original = p.adresse.strasse var strasse = original.match(/[a-za-z\.]+/)[0] var nummer = original.match(/[0-9]+[a-z]*/)[0] p.adresse.strasse = strasse p.adresse.hausnummer = nummer db.personen.save(p) }})

26 1 Javascript Console Skripting > mongo setup.js migrate.js teardown.js

27 1 Javascript Console Skripting D E M O

28 2 Java

29 2 Java MigrateAdresse.java DBObject person =... DBObject adresse = new BasicDBObject(); adresse.put("strasse", person.get("strasse")); adresse.put("plz", person.get("plz")); adresse.put("ort", person.get("ort")); person.put("adresse", adresse); person.removefield("strasse"); person.removefield("plz"); person.removefield("ort"); collection.save(person);

30 2 Java MigrateAdresse.java copy(person, "strasse", "adresse.strasse") copy(person, "plz", "adresse.plz") copy(person, "ort", "adresse.ort") collection.save(person);

31 2 Java public void testmigrateadresse() { // given String json = getfileasjson(this.getclass(), "person_v1.json"); DBObject person = (DBObject) JSON.parse(json); // when new MigrateAdresse().migrate(person); // then DBObject adresse = (DBObject) person.get("adresse"); assertthat(adresse.get("plz")).isequalto("10245"); }

32 Migration vor Deployment (1) Produktiv System (2)

33 Continuous Deployment Produktiv System 25 / Tag

34 Continuous Deployment

35

36 On the fly version conversion 3 Java On the fly conversion

37 3 Java On the fly conversion { "class" : "Person", { "name":"schulze", "strasse":"sonntagstr. "class":"person", 20", "plz":"10245", "name":"schulze", { "ort":"berlin" "adresse":{ } "class":"person", "strasse":"sonntagstr. 20", "name":"schulze", "plz":"10245", "adresse":{ "ort":"berlin" }}"strasse":"sonntagstr.", "hausnummer":"20", "plz":"10245", "ort":"berlin" }} v1 v2 v3

38 3 Java On the fly conversion

39 3 Java On the fly conversion Version Converter Beispiel

40 3 Java On the fly conversion Version Converter Unit Test

41 3 Java On the fly conversion Composite Version Converter Beispiel public class PersonVersionConverter extends CompositeVersionConverter { model Version.txt 3 public PersonVersionConverter() { setcurrentversion(getfilecontent("/domainmodel-version.txt")); registerconverter(new VersionConverter_1to2_Adresse()); registerconverter(new VersionConverter_2to3_HausnummerExtraktion()); //... }

42 3 Java On the fly conversion Composite Version Converter Integrations Test { "class" : "Person", "name":"schulze", "strasse":"sonntagstr. 20", "plz":"10245", "ort":"berlin" } v1 { "class":"person", "name":"schulze", "adresse":{ "strasse":"sonntagstr. 20", "plz":"10245", "ort":"berlin" }} v2 { "class":"person", "name":"schulze", "adresse":{ "strasse":"sonntagstr.", "hausnummer":"20", "plz":"10245", "ort":"berlin" }} v3

43 3 Java On the fly conversion Version Conversion Integrations Test

44 3 Java On the fly conversion Queries personen = getcollection().find(querybuilder().put("name").is("schulze")) personen.addall( getcollection().find(querybuilder().put("name").is("schulze")) ) personen.addall( getcollection().find(querybuilder().put("neuername").is("schulze")) )

45

46

47

48

49 Domain Model JSON Structure

50 Schema Evolution 1 Javascript 2 Java 3 Java On the fly

51 Ausblick VersionConversion integration in OD Mapper MongoDB User Group Berlin in

52 für Java Entwickler und Architekten - Schema Evolution und Maintenance { } "name" : "Timmo Freudl-Gierke", "twitter" : "@timmo_gierke", "blog" : "

Spring Data, Jongo & Co. Java Persistenz-Frameworks für MongoDB

Spring Data, Jongo & Co. Java Persistenz-Frameworks für MongoDB Spring Data, Jongo & Co. Java Persistenz-Frameworks für MongoDB Tobias.Trelle@codecentric.de @tobiastrelle codecentric AG 1 Tobias Trelle - Senior IT Consultant @ codecentric AG (Düsseldorf) - Organisator

More information

Programming Against Hybrid Databases with Java Handling SQL and NoSQL. Brian Hughes IBM

Programming Against Hybrid Databases with Java Handling SQL and NoSQL. Brian Hughes IBM Programming Against Hybrid Databases with Java Handling SQL and NoSQL Brian Hughes IBM 1 Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services

More information

MongoDB. Or how I learned to stop worrying and love the database. Mathias Stearn. N*SQL Berlin October 22th, 2009. 10gen

MongoDB. Or how I learned to stop worrying and love the database. Mathias Stearn. N*SQL Berlin October 22th, 2009. 10gen What is? Or how I learned to stop worrying and love the database 10gen N*SQL Berlin October 22th, 2009 What is? 1 What is? Document Oriented JavaScript Enabled Fast, Scalable, Available, and Reliable 2

More information

Department of Software Systems. Presenter: Saira Shaheen, 227233 saira.shaheen@tut.fi 0417016438 Dated: 02-10-2012

Department of Software Systems. Presenter: Saira Shaheen, 227233 saira.shaheen@tut.fi 0417016438 Dated: 02-10-2012 1 MongoDB Department of Software Systems Presenter: Saira Shaheen, 227233 saira.shaheen@tut.fi 0417016438 Dated: 02-10-2012 2 Contents Motivation : Why nosql? Introduction : What does NoSQL means?? Applications

More information

NoSQL web apps. w/ MongoDB, Node.js, AngularJS. Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013

NoSQL web apps. w/ MongoDB, Node.js, AngularJS. Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013 NoSQL web apps w/ MongoDB, Node.js, AngularJS Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013 About us Passionate (web) dev. since fallen in love with Sinclair ZX Spectrum Academic background in natural

More information

MongoDB Developer and Administrator Certification Course Agenda

MongoDB Developer and Administrator Certification Course Agenda MongoDB Developer and Administrator Certification Course Agenda Lesson 1: NoSQL Database Introduction What is NoSQL? Why NoSQL? Difference Between RDBMS and NoSQL Databases Benefits of NoSQL Types of NoSQL

More information

Attacking MongoDB. Firstov Mihail

Attacking MongoDB. Firstov Mihail Attacking MongoDB Firstov Mihail What is it? MongoDB is an open source document-oriented database system. Features : 1. Ad hoc queries. 2. Indexing 3. Replication 4. Load balancing 5. File storage 6. Aggregation

More information

NoSQL Database - mongodb

NoSQL Database - mongodb NoSQL Database - mongodb Andreas Hartmann 19.10.11 Agenda NoSQL Basics MongoDB Basics Map/Reduce Binary Data Sets Replication - Scaling Monitoring - Backup Schema Design - Ecosystem 19.10.11 2 NoSQL Database

More information

Sisense. Product Highlights. www.sisense.com

Sisense. Product Highlights. www.sisense.com Sisense Product Highlights Introduction Sisense is a business intelligence solution that simplifies analytics for complex data by offering an end-to-end platform that lets users easily prepare and analyze

More information

Apache Sling A REST-based Web Application Framework Carsten Ziegeler cziegeler@apache.org ApacheCon NA 2014

Apache Sling A REST-based Web Application Framework Carsten Ziegeler cziegeler@apache.org ApacheCon NA 2014 Apache Sling A REST-based Web Application Framework Carsten Ziegeler cziegeler@apache.org ApacheCon NA 2014 About cziegeler@apache.org @cziegeler RnD Team at Adobe Research Switzerland Member of the Apache

More information

MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15

MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15 MongoDB in the NoSQL and SQL world. Horst Rechner horst.rechner@fokus.fraunhofer.de Berlin, 2012-05-15 1 MongoDB in the NoSQL and SQL world. NoSQL What? Why? - How? Say goodbye to ACID, hello BASE You

More information

How SourceForge is Using MongoDB

How SourceForge is Using MongoDB How SourceForge is Using MongoDB Rick Copeland @rick446 rick@geek.net Geeknet, page 1 SF.net BlackOps : FossFor.us User Editable! Web 2.0! (ish) Not Ugly! Geeknet, page 2 Moving to NoSQL FossFor.us used

More information

CSCC09F Programming on the Web. Mongo DB

CSCC09F Programming on the Web. Mongo DB CSCC09F Programming on the Web Mongo DB A document-oriented Database, mongoose for Node.js, DB operations 52 MongoDB CSCC09 Programming on the Web 1 CSCC09 Programming on the Web 1 What s Different in

More information

Querying MongoDB without programming using FUNQL

Querying MongoDB without programming using FUNQL Querying MongoDB without programming using FUNQL FUNQL? Federated Unified Query Language What does this mean? Federated - Integrates different independent stand alone data sources into one coherent view

More information

Cloud Powered Mobile Apps with Azure

Cloud Powered Mobile Apps with Azure Cloud Powered Mobile Apps with Azure Malte Lantin Technical Evanglist Microsoft Azure Agenda Mobile Services Features and Demos Advanced Features Scaling and Pricing 2 What is Mobile Services? Storage

More information

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE @GEOFFLANE WHAT IS NOSQL? NON-RELATIONAL DATA STORAGE USUALLY SCHEMA-FREE ACCESS DATA WITHOUT SQL (THUS... NOSQL) WIDE-COLUMN / TABULAR

More information

NoSQL - What we ve learned with mongodb. Paul Pedersen, Deputy CTO paul@10gen.com DAMA SF December 15, 2011

NoSQL - What we ve learned with mongodb. Paul Pedersen, Deputy CTO paul@10gen.com DAMA SF December 15, 2011 NoSQL - What we ve learned with mongodb Paul Pedersen, Deputy CTO paul@10gen.com DAMA SF December 15, 2011 DW2.0 and NoSQL management decision support intgrated access - local v. global - structured v.

More information

MongoDB: document-oriented database

MongoDB: document-oriented database MongoDB: document-oriented database Software Languages Team University of Koblenz-Landau Ralf Lämmel, Sebastian Jackel and Andrei Varanovich Motivation Need for a flexible schema High availability Scalability

More information

Building Your First MongoDB Application

Building Your First MongoDB Application Building Your First MongoDB Application Ross Lawley Python Engineer @ 10gen Web developer since 1999 Passionate about open source Agile methodology email: ross@10gen.com twitter: RossC0 Today's Talk Quick

More information

Document Oriented Database

Document Oriented Database Document Oriented Database What is Document Oriented Database? What is Document Oriented Database? Not Really What is Document Oriented Database? The central concept of a document-oriented database is

More information

MONGODB - THE NOSQL DATABASE

MONGODB - THE NOSQL DATABASE MONGODB - THE NOSQL DATABASE Akhil Latta Software Engineer Z Systems, Mohali, Punjab MongoDB is an open source document-oriented database system developed and supported by 10gen. It is part of the NoSQL

More information

Big Data & Data Science Course Example using MapReduce. Presented by Juan C. Vega

Big Data & Data Science Course Example using MapReduce. Presented by Juan C. Vega Big Data & Data Science Course Example using MapReduce Presented by What is Mongo? Why Mongo? Mongo Model Mongo Deployment Mongo Query Language Built-In MapReduce Demo Q & A Agenda Founders Max Schireson

More information

MongoDB. An introduction and performance analysis. Seminar Thesis

MongoDB. An introduction and performance analysis. Seminar Thesis MongoDB An introduction and performance analysis Seminar Thesis Master of Science in Engineering Major Software and Systems HSR Hochschule für Technik Rapperswil www.hsr.ch/mse Advisor: Author: Prof. Stefan

More information

Getting Started with MongoDB

Getting Started with MongoDB Getting Started with MongoDB TCF IT Professional Conference March 14, 2014 Michael P. Redlich @mpredli about.me/mpredli/ 1 1 Who s Mike? BS in CS from Petrochemical Research Organization Ai-Logix, Inc.

More information

Lessons learned from a large scale OSGi web app. Jago de Vreede Paul Bakker

Lessons learned from a large scale OSGi web app. Jago de Vreede Paul Bakker Lessons learned from a large scale OSGi web app Jago de Vreede Paul Bakker Paul Bakker @pbakker Jago de Vreede Agenda! High level architecture Modular architecture Modularity with OSGi Cloud deployments

More information

Overview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB

Overview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB Overview of Databases On MacOS Karl Kuehn Automation Engineer RethinkDB Session Goals Introduce Database concepts Show example players Not Goals: Cover non-macos systems (Oracle) Teach you SQL Answer what

More information

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect IT Insight podcast This podcast belongs to the IT Insight series You can subscribe to the podcast through

More information

Multimedia im Netz (Online Multimedia) Wintersemester 2014/15. Übung 08 (Hauptfach)

Multimedia im Netz (Online Multimedia) Wintersemester 2014/15. Übung 08 (Hauptfach) Multimedia im Netz (Online Multimedia) Wintersemester 2014/15 Übung 08 (Hauptfach) Ludwig-Maximilians-Universität München Online Multimedia WS 2014/15 - Übung 08-1 Today s Agenda Quiz Preparation NodeJS

More information

Big Data Solutions. Portal Development with MongoDB and Liferay. Solutions

Big Data Solutions. Portal Development with MongoDB and Liferay. Solutions Big Data Solutions Portal Development with MongoDB and Liferay Solutions Introduction Companies have made huge investments in Business Intelligence and analytics to better understand their clients and

More information

Tobias.Trelle@codecentric.de @tobiastrelle. codecentric AG 1

Tobias.Trelle@codecentric.de @tobiastrelle. codecentric AG 1 NoSQL Unit & Travis CI Test Automation for NoSQL Databases Tobias.Trelle@codecentric.de @tobiastrelle codecentric AG 1 Tobias Trelle Senior IT Consultant @ codecentric AG Organizer of MongoDB User Group

More information

BIG DATA TOOLS. Top 10 open source technologies for Big Data

BIG DATA TOOLS. Top 10 open source technologies for Big Data BIG DATA TOOLS Top 10 open source technologies for Big Data We are in an ever expanding marketplace!!! With shorter product lifecycles, evolving customer behavior and an economy that travels at the speed

More information

Visualizing MongoDB Objects in Concept and Practice

Visualizing MongoDB Objects in Concept and Practice Washington DC 2013 Visualizing MongoDB Objects in Concept and Practice https://github.com/cvitter/ikanow.mongodc2013.presentation Introduction Do you have a MongoDB database full of BSON documents crying

More information

L7_L10. MongoDB. Big Data and Analytics by Seema Acharya and Subhashini Chellappan Copyright 2015, WILEY INDIA PVT. LTD.

L7_L10. MongoDB. Big Data and Analytics by Seema Acharya and Subhashini Chellappan Copyright 2015, WILEY INDIA PVT. LTD. L7_L10 MongoDB Agenda What is MongoDB? Why MongoDB? Using JSON Creating or Generating a Unique Key Support for Dynamic Queries Storing Binary Data Replication Sharding Terms used in RDBMS and MongoDB Data

More information

Software Design April 26, 2013

Software Design April 26, 2013 Software Design April 26, 2013 1. Introduction 1.1.1. Purpose of This Document This document provides a high level description of the design and implementation of Cypress, an open source certification

More information

Humongous MongoDB. Sean Corfield World Singles llc

Humongous MongoDB. Sean Corfield World Singles llc Humongous MongoDB Sean Corfield World Singles llc 1 Agenda Scaling MongoDB - Concepts Replica Sets & Sharding Read Preference, Write Concern, Etc Map/Reduce Aggregation 2 You Might Prefer... Queries and

More information

HOW CAN I TRANSFORM AN ONLINE SERVICE TO TRULY MULTILINGUAL?

HOW CAN I TRANSFORM AN ONLINE SERVICE TO TRULY MULTILINGUAL? HOW CAN I TRANSFORM AN ONLINE SERVICE TO TRULY MULTILINGUAL? 10 ways to become truly multilingual The Best Practices were defined in the context of www.organic-lingua.eu project based on the experience

More information

Frictionless Persistence in.net with MongoDB. Mogens Heller Grabe Trifork mhg@trifork.com

Frictionless Persistence in.net with MongoDB. Mogens Heller Grabe Trifork mhg@trifork.com Frictionless Persistence in.net with MongoDB Mogens Heller Grabe Trifork mhg@trifork.com Agenda Document-oriented databases Introduction to MongoDB JavaScript, baby! How to do it with C# Tiny web app sample

More information

How To Write A Nosql Database In Spring Data Project

How To Write A Nosql Database In Spring Data Project Spring Data Modern Data Access for Enterprise Java Mark Pollack, Oliver Gierke, Thomas Risberg, Jon Brisbin, and Michael Hunger O'REILLY* Beijing Cambridge Farnham Koln Sebastopol Tokyo Table of Contents

More information

Application of NoSQL Database in Web Crawling

Application of NoSQL Database in Web Crawling Application of NoSQL Database in Web Crawling College of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, 210044, China doi:10.4156/jdcta.vol5.issue6.31 Abstract

More information

Visual Statement. NoSQL Data Storage. MongoDB Project. April 10, 2014. Bobby Esfandiari Stefan Schielke Nicole Saat

Visual Statement. NoSQL Data Storage. MongoDB Project. April 10, 2014. Bobby Esfandiari Stefan Schielke Nicole Saat Visual Statement NoSQL Data Storage April 10, 2014 Bobby Esfandiari Stefan Schielke Nicole Saat Contents Table of Contents 1 Timeline... 5 Requirements... 8 Document History...8 Revision History... 8 Introduction...9

More information

PostgreSQL as a Schemaless Database. Christophe Pettus PostgreSQL Experts, Inc. OSCON 2013

PostgreSQL as a Schemaless Database. Christophe Pettus PostgreSQL Experts, Inc. OSCON 2013 PostgreSQL as a Schemaless Database. Christophe Pettus PostgreSQL Experts, Inc. OSCON 2013 Welcome! I m Christophe. PostgreSQL person since 1997. Consultant with PostgreSQL Experts, Inc. cpettus@pgexperts.com

More information

Service Oriented Architecture (SOA) Architecture, Governance, Standards and Technologies

Service Oriented Architecture (SOA) Architecture, Governance, Standards and Technologies Service Oriented Architecture (SOA) Architecture, Governance, Standards and Technologies 3-day seminar Give Your Business the Competitive Edge SOA has rapidly seized the momentum and center stage because

More information

Time series IoT data ingestion into Cassandra using Kaa

Time series IoT data ingestion into Cassandra using Kaa Time series IoT data ingestion into Cassandra using Kaa Andrew Shvayka ashvayka@cybervisiontech.com Agenda Data ingestion challenges Why Kaa? Why Cassandra? Reference architecture overview Hands-on Sandbox

More information

A Performance Analysis of Distributed Indexing using Terrier

A Performance Analysis of Distributed Indexing using Terrier A Performance Analysis of Distributed Indexing using Terrier Amaury Couste Jakub Kozłowski William Martin Indexing Indexing Used by search

More information

Scaling with MongoDB. by Michael Schurter 2011 @schmichael. Scaling with MongoDB by Michael Schurter - OS Bridge, 2011.06.22

Scaling with MongoDB. by Michael Schurter 2011 @schmichael. Scaling with MongoDB by Michael Schurter - OS Bridge, 2011.06.22 Scaling with MongoDB by Michael Schurter 2011 @schmichael What is MongoDB? Community Developer by 10gen AGPL Database Apache drivers JIRA issue tracking On GitHub What is MongoDB? Architecture Server Database

More information

Health Care Claims System Prototype

Health Care Claims System Prototype SGT WHITE PAPER Health Care Claims System Prototype MongoDB and Hadoop 2015 SGT, Inc. All Rights Reserved 7701 Greenbelt Road, Suite 400, Greenbelt, MD 20770 Tel: (301) 614-8600 Fax: (301) 614-8601 www.sgt-inc.com

More information

FUSE-ESB4 An open-source OSGi based platform for EAI and SOA

FUSE-ESB4 An open-source OSGi based platform for EAI and SOA FUSE-ESB4 An open-source OSGi based platform for EAI and SOA Introduction to FUSE-ESB4 It's a powerful OSGi based multi component container based on ServiceMix4 http://servicemix.apache.org/smx4/index.html

More information

NoSQL and Agility. Why Document and Graph Stores Rock November 12th, 2015 COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED

NoSQL and Agility. Why Document and Graph Stores Rock November 12th, 2015 COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED NoSQL and Agility Why Document and Graph Stores Rock November 12th, 2015 COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED Description We have all heard about how NoSQL databases are being adopted

More information

DbSchema Tutorial with Introduction in MongoDB

DbSchema Tutorial with Introduction in MongoDB DbSchema Tutorial with Introduction in MongoDB Contents MySql vs MongoDb... 2 Connect to MongoDb... 4 Insert and Query Data... 5 A Schema for MongoDb?... 7 Relational Data Browse... 8 Virtual Relations...

More information

Big Data Analytics with Cassandra, Spark & MLLib

Big Data Analytics with Cassandra, Spark & MLLib Big Data Analytics with Cassandra, Spark & MLLib Matthias Niehoff AGENDA Spark Basics In A Cluster Cassandra Spark Connector Use Cases Spark Streaming Spark SQL Spark MLLib Live Demo CQL QUERYING LANGUAGE

More information

RESTful web applications with Apache Sling

RESTful web applications with Apache Sling RESTful web applications with Apache Sling Bertrand Delacrétaz Senior Developer, R&D, Day Software, now part of Adobe Apache Software Foundation Member and Director http://grep.codeconsult.ch - twitter:

More information

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 1 Copyright 2011, Oracle and/or its affiliates. All rights ORACLE PRODUCT LOGO Session ID: 17202 Oracle Fusion Applications - Technology Essentials Overview Nadia Bendjedou Senior Director Product Strategy,

More information

Benchmarking Couchbase Server for Interactive Applications. By Alexey Diomin and Kirill Grigorchuk

Benchmarking Couchbase Server for Interactive Applications. By Alexey Diomin and Kirill Grigorchuk Benchmarking Couchbase Server for Interactive Applications By Alexey Diomin and Kirill Grigorchuk Contents 1. Introduction... 3 2. A brief overview of Cassandra, MongoDB, and Couchbase... 3 3. Key criteria

More information

Introduction to NoSQL and MongoDB. Kathleen Durant Lesson 20 CS 3200 Northeastern University

Introduction to NoSQL and MongoDB. Kathleen Durant Lesson 20 CS 3200 Northeastern University Introduction to NoSQL and MongoDB Kathleen Durant Lesson 20 CS 3200 Northeastern University 1 Outline for today Introduction to NoSQL Architecture Sharding Replica sets NoSQL Assumptions and the CAP Theorem

More information

Amazon Glacier. Developer Guide API Version 2012-06-01

Amazon Glacier. Developer Guide API Version 2012-06-01 Amazon Glacier Developer Guide Amazon Glacier: Developer Guide Copyright 2016 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used in

More information

HO5604 Deploying MongoDB. A Scalable, Distributed Database with SUSE Cloud. Alejandro Bonilla. Sales Engineer abonilla@suse.com

HO5604 Deploying MongoDB. A Scalable, Distributed Database with SUSE Cloud. Alejandro Bonilla. Sales Engineer abonilla@suse.com HO5604 Deploying MongoDB A Scalable, Distributed Database with SUSE Cloud Alejandro Bonilla Sales Engineer abonilla@suse.com Agenda SUSE Cloud Overview What is MongoDB? 2 Getting familiar with the Cloud

More information

Drupal CMS for marketing sites

Drupal CMS for marketing sites Drupal CMS for marketing sites Intro Sample sites: End to End flow Folder Structure Project setup Content Folder Data Store (Drupal CMS) Importing/Exporting Content Database Migrations Backend Config Unit

More information

Cloud Powered Mobile Apps with Microsoft Azure

Cloud Powered Mobile Apps with Microsoft Azure Cloud Powered Mobile Apps with Microsoft Azure Malte Lantin Technical Evanglist Microsoft Azure Malte Lantin Technical Evangelist, Microsoft Deutschland Fokus auf Microsoft Azure, App-Entwicklung Student

More information

Spring Data JDBC Extensions Reference Documentation

Spring Data JDBC Extensions Reference Documentation Reference Documentation ThomasRisberg Copyright 2008-2015The original authors Copies of this document may be made for your own use and for distribution to others, provided that you do not charge any fee

More information

Please ask questions! Have people used non-relational dbs before? MongoDB?

Please ask questions! Have people used non-relational dbs before? MongoDB? Kristina Chodorow Please ask questions! Have people used non-relational dbs before? MongoDB? Software Engineer at $ whoami Scaling a Pre-WWW DB literally scale literally scale (Courtesy of Ask Bjorn Hansen)

More information

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013 Database Management System Choices Introduction To Database Systems CSE 373 Spring 2013 Outline Introduction PostgreSQL MySQL Microsoft SQL Server Choosing A DBMS NoSQL Introduction There a lot of options

More information

The MongoDB Tutorial Introduction for MySQL Users. Stephane Combaudon April 1st, 2014

The MongoDB Tutorial Introduction for MySQL Users. Stephane Combaudon April 1st, 2014 The MongoDB Tutorial Introduction for MySQL Users Stephane Combaudon April 1st, 2014 Agenda 2 Introduction Install & First Steps CRUD Aggregation Framework Performance Tuning Replication and High Availability

More information

Data Management in the Cloud

Data Management in the Cloud With thanks to Michael Grossniklaus! Data Management in the Cloud Lecture 8 Data Models Document: MongoDB I ve failed over and over and over again in my life. And that is why I succeed. Michael Jordan

More information

iway Roadmap: 2011 and Beyond Dave Watson SVP, iway Software

iway Roadmap: 2011 and Beyond Dave Watson SVP, iway Software iway Roadmap: 2011 and Beyond Dave Watson SVP, iway Software iway Software Products DataMigrator Core Integration Server iway Service Manager Information Management/Data Governance B2B Gateway Managed

More information

Introducing Apache Pivot. Greg Brown, Todd Volkert 6/10/2010

Introducing Apache Pivot. Greg Brown, Todd Volkert 6/10/2010 Introducing Apache Pivot Greg Brown, Todd Volkert 6/10/2010 Speaker Bios Greg Brown Senior Software Architect 15 years experience developing client and server applications in both services and R&D Apache

More information

Spring Data MongoDB - Reference Documentation

Spring Data MongoDB - Reference Documentation Spring Data MongoDB - Reference Documentation Mark Pollack, Thomas Risberg, Oliver Gierke, Costin Leau, Jon Brisbin Copyright 2011 Copies of this document may be made for your own use and for distribution

More information

An Approach to Implement Map Reduce with NoSQL Databases

An Approach to Implement Map Reduce with NoSQL Databases www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 8 Aug 2015, Page No. 13635-13639 An Approach to Implement Map Reduce with NoSQL Databases Ashutosh

More information

QL Integration into Scala and Excel. Martin Dietrich

QL Integration into Scala and Excel. Martin Dietrich QL Integration into Scala and Excel Martin Dietrich E.ON Global Commodities Over 1000 professionals, active on over 20 exchanges in more than 40 countries Over 1000 counterparties in more than 50 countries

More information

Big Data. Facebook Wall Data using Graph API. Presented by: Prashant Patel-2556219 Jaykrushna Patel-2619715

Big Data. Facebook Wall Data using Graph API. Presented by: Prashant Patel-2556219 Jaykrushna Patel-2619715 Big Data Facebook Wall Data using Graph API Presented by: Prashant Patel-2556219 Jaykrushna Patel-2619715 Outline Data Source Processing tools for processing our data Big Data Processing System: Mongodb

More information

The Oracle Fusion Development Platform

The Oracle Fusion Development Platform The Oracle Fusion Development Platform Juan Camilo Ruiz Senior Product Manager Development Tools 1 The preceding is intended to outline our general product direction. It is intended for information purposes

More information

How graph databases started the multi-model revolution

How graph databases started the multi-model revolution How graph databases started the multi-model revolution Luca Garulli Author and CEO @OrientDB QCon Sao Paulo - March 26, 2015 Welcome to Big Data 90% of the data in the world today has been created in the

More information

Continuous Integration

Continuous Integration Continuous Integration WITH FITNESSE AND SELENIUM By Brian Kitchener briank@ecollege.com Intro Who am I? Overview Continuous Integration The Tools Selenium Overview Fitnesse Overview Data Dependence My

More information

DevOps Best Practices for Mobile Apps. Sanjeev Sharma IBM Software Group

DevOps Best Practices for Mobile Apps. Sanjeev Sharma IBM Software Group DevOps Best Practices for Mobile Apps Sanjeev Sharma IBM Software Group Me 18 year in the software industry 15+ years he has been a solution architect with IBM Areas of work: o DevOps o Enterprise Architecture

More information

ORM IN WEB PROGRAMMING. Course project report for 6WW Erik Wang

ORM IN WEB PROGRAMMING. Course project report for 6WW Erik Wang ORM IN WEB PROGRAMMING Course project report for 6WW Erik Wang Problems with web programming When people do the web design Design from functional aspects Programmer also needs to understand database Code

More information

Introduction to MongoDB. Kristina Chodorow kristina@mongodb.org

Introduction to MongoDB. Kristina Chodorow kristina@mongodb.org Introduction to MongoDB Kristina Chodorow kristina@mongodb.org Application PHP Apache Database Linux Application PHP IIS Windows Application PHP Apache Linux Application PHP Apache Linux Application PHP

More information

The presentation explains how to create and access the web services using the user interface. WebServices.ppt. Page 1 of 14

The presentation explains how to create and access the web services using the user interface. WebServices.ppt. Page 1 of 14 The presentation explains how to create and access the web services using the user interface. Page 1 of 14 The aim of this presentation is to familiarize you with the processes of creating and accessing

More information

WS-PGRADE Portal Introduction

WS-PGRADE Portal Introduction WS-PGRADE Portal Introduction WS-PGRADE Customization: Portlets Eduardo Lostal Zaragoza, 17 th May 2012 Structure of the presentation SCI-BUS Development Liferay Portal Portlets Conclusion 2 What is being

More information

Java and RDBMS. Married with issues. Database constraints

Java and RDBMS. Married with issues. Database constraints Java and RDBMS Married with issues Database constraints Speaker Jeroen van Schagen Situation Java Application store retrieve JDBC Relational Database JDBC Java Database Connectivity Data Access API ( java.sql,

More information

ControVol: A Framework for Controlled Schema Evolution in NoSQL Application Development

ControVol: A Framework for Controlled Schema Evolution in NoSQL Application Development ControVol: A Framework for Controlled Schema Evolution in NoSQL Application Development Stefanie Scherzinger, Thomas Cerqueus, Eduardo Cunha de Almeida To cite this version: Stefanie Scherzinger, Thomas

More information

Alfresco. Wiley Publishing, Inc. PROFESSIONAL. PRACTICAL SOLUTIONS FOR ENTERPRISE. John Newton CONTENT MANAGEMENT. Michael Farman Michael G.

Alfresco. Wiley Publishing, Inc. PROFESSIONAL. PRACTICAL SOLUTIONS FOR ENTERPRISE. John Newton CONTENT MANAGEMENT. Michael Farman Michael G. PROFESSIONAL. Alfresco PRACTICAL SOLUTIONS FOR ENTERPRISE CONTENT MANAGEMENT David Caruana John Newton Michael Farman Michael G. Uzquiano Kevin Roast WILEY Wiley Publishing, Inc. INTRODUCTION xxix CHAPTER

More information

MarkLogic Server. Reference Application Architecture Guide. MarkLogic 8 February, 2015. Copyright 2015 MarkLogic Corporation. All rights reserved.

MarkLogic Server. Reference Application Architecture Guide. MarkLogic 8 February, 2015. Copyright 2015 MarkLogic Corporation. All rights reserved. Reference Application Architecture Guide 1 MarkLogic 8 February, 2015 Last Revised: 8.0-1, February, 2015 Copyright 2015 MarkLogic Corporation. All rights reserved. Table of Contents Table of Contents

More information

2007 to 2010 SharePoint Migration - Take Time to Reorganize

2007 to 2010 SharePoint Migration - Take Time to Reorganize 2007 to 2010 SharePoint Migration - Take Time to Reorganize by Mark Klinchin CTO, MetaVis Technologies May 2010 Phone: (610)-717-0413 Email: info@metavistech.com Website: www.metavistech.com Introduction

More information

Mjolnirr: private PaaS as distributed computing evolution

Mjolnirr: private PaaS as distributed computing evolution Mjolnirr: private PaaS as distributed computing evolution Gleb Radchenko, Dmitry Savchenko gleb.radchenko@susu.ru South Ural State University, Russia Problem definition Cloud computing enables resource

More information

MongoDB Security Guide

MongoDB Security Guide MongoDB Security Guide Release 2.6.11 MongoDB, Inc. December 09, 2015 2 MongoDB, Inc. 2008-2015 This work is licensed under a Creative Commons Attribution-NonCommercial- ShareAlike 3.0 United States License

More information

Salesforce Admin Course Content: Chapter 1 CRM Introduction Introduction to CRM? Why CRM?

Salesforce Admin Course Content: Chapter 1 CRM Introduction Introduction to CRM? Why CRM? Salesforce Admin Course Content: Chapter 1 CRM Introduction Introduction to CRM? Why CRM? Chapter 2 Introduction to Cloud Computing & Salesforce.com Cloud Computing - Overview What is Software-as-a-Service

More information

Open Source Technologies on Microsoft Azure

Open Source Technologies on Microsoft Azure Open Source Technologies on Microsoft Azure A Survey @DChappellAssoc Copyright 2014 Chappell & Associates The Main Idea i Open source technologies are a fundamental part of Microsoft Azure The Big Questions

More information

Big Data: Using ArcGIS with Apache Hadoop. Erik Hoel and Mike Park

Big Data: Using ArcGIS with Apache Hadoop. Erik Hoel and Mike Park Big Data: Using ArcGIS with Apache Hadoop Erik Hoel and Mike Park Outline Overview of Hadoop Adding GIS capabilities to Hadoop Integrating Hadoop with ArcGIS Apache Hadoop What is Hadoop? Hadoop is a scalable

More information

No SQL! no injection? A talk on the state of NoSQL security

No SQL! no injection? A talk on the state of NoSQL security No SQL! no injection? A talk on the state of NoSQL security IBM Cyber Security Center of Excellence Aviv Ron Alexandra Shulman-Peleg Anton Puzanov Aviv Ron Security Researcher for IBM Cyber Security Center

More information

02267: Software Development of Web Services

02267: Software Development of Web Services 02267: Software Development of Web Services Week 8 Hubert Baumeister huba@dtu.dk Department of Applied Mathematics and Computer Science Technical University of Denmark Fall 2015 1 Recap I BPEL: I Doing

More information

Avaya Inventory Management System

Avaya Inventory Management System Avaya Inventory Management System June 15, 2015 Jordan Moser Jin Oh Erik Ponder Gokul Natesan Table of Contents 1. Introduction 1 2. Requirements 2-3 3. System Architecture 4 4. Technical Design 5-6 5.

More information

CQCON 2013: five Sling features you should know

CQCON 2013: five Sling features you should know CQCON 2013: five Sling features you should know Olaf Otto 19.06.2013 1: Write custom tag libraries Use current XSD Fully qualified identifier

More information

Design REST Services with CXF JAX- RS implementation: best practices and lessons learned

Design REST Services with CXF JAX- RS implementation: best practices and lessons learned Design REST Services with CXF JAX- RS implementation: best practices and lessons learned Andrei Shakirin, Talend ashakirin@talend.com ashakirin.blogspot.com Agenda REST architectural style Design of REST

More information

NextRow - AEM Training Program Course Catalog

NextRow - AEM Training Program Course Catalog NextRow - AEM Training Program Course Catalog Adobe Experience Manager Training Program Course Catalog NextRow provides Adobe CQ training solutions designed to meet your unique project demands. To optimize

More information

A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA

A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA A COMPARATIVE STUDY OF NOSQL DATA STORAGE MODELS FOR BIG DATA Ompal Singh Assistant Professor, Computer Science & Engineering, Sharda University, (India) ABSTRACT In the new era of distributed system where

More information

Visualizing a Neo4j Graph Database with KeyLines

Visualizing a Neo4j Graph Database with KeyLines Visualizing a Neo4j Graph Database with KeyLines Introduction 2! What is a graph database? 2! What is Neo4j? 2! Why visualize Neo4j? 3! Visualization Architecture 4! Benefits of the KeyLines/Neo4j architecture

More information

Chapter 11 Map-Reduce, Hadoop, HDFS, Hbase, MongoDB, Apache HIVE, and Related

Chapter 11 Map-Reduce, Hadoop, HDFS, Hbase, MongoDB, Apache HIVE, and Related Chapter 11 Map-Reduce, Hadoop, HDFS, Hbase, MongoDB, Apache HIVE, and Related Summary Xiangzhe Li Nowadays, there are more and more data everyday about everything. For instance, here are some of the astonishing

More information

MongoDB and Couchbase

MongoDB and Couchbase Benchmarking MongoDB and Couchbase No-SQL Databases Alex Voss Chris Choi University of St Andrews TOP 2 Questions Should a social scientist buy MORE or UPGRADE computers? Which DATABASE(s)? Document Oriented

More information

Data Services as a Service for the G-Cloud

Data Services as a Service for the G-Cloud Service Definition The name of the Service is: Data Services as a Service An overview of Data Services as a Service The Data Services service enables data stored in legacy/operational systems, in the cloud

More information

Customer Bank Account Management System Technical Specification Document

Customer Bank Account Management System Technical Specification Document Customer Bank Account Management System Technical Specification Document Technical Specification Document Page 1 of 15 Table of Contents Contents 1 Introduction 3 2 Design Overview 4 3 Topology Diagram.6

More information

Beyond The Web Drupal Meets The Desktop (And Mobile) Justin Miller Code Sorcery Workshop, LLC http://codesorcery.net/dcdc

Beyond The Web Drupal Meets The Desktop (And Mobile) Justin Miller Code Sorcery Workshop, LLC http://codesorcery.net/dcdc Beyond The Web Drupal Meets The Desktop (And Mobile) Justin Miller Code Sorcery Workshop, LLC http://codesorcery.net/dcdc Introduction Personal introduction Format & conventions for this talk Assume familiarity

More information