Open Source Technologies on Microsoft Azure

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Open Source Technologies on Microsoft Azure"

Transcription

1 Open Source Technologies on Microsoft Azure A Copyright 2014 Chappell & Associates

2 The Main Idea i Open source technologies are a fundamental part of Microsoft Azure

3 The Big Questions Commitment? Is Microsoft really serious about supporting open source on Azure? ANSWER Yes: - Its competitors do this - Cloud platforms sell cycles, storage, and bandwidth. Who cares what software uses these?

4 The Big Questions Customers? Do customers care about open source on Azure? ANSWER Yes: - For running Linux workloads - For open source development on Linux and Windows

5 Open Source on Microsoft Azure Two categories Compute Data IaaS, PaaS, and mobile services SQL, NoSQL, and big data analytics

6 Compute IaaS, PaaS, and Mobile Services

7 Microsoft Azure Technologies Compute (1) Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Virtual Machines Cloud Services Web Sites Web Site VMs Application IIS Web Site VHDs Gallery Web Roles Worker Roles IIS Web Site Web Site VHDs User-Supplied

8 Microsoft Azure Technologies Compute (2) Mobile Backend as a Service (MBaaS) Mobile Services Authentication Notifications Custom Logic...

9 Microsoft Azure Compute: IaaS Virtual Machines Virtual Machines VMs Windows Server images provided by Microsoft; Linux images provided by partners VHDs Gallery Linux images provided by the community VHDs VHDs User-Supplied Windows Server and Linux images provided by customers VM Depot

10 Linux Images: The Gallery!!!!! Canonical UBUNTU Oracle Linux SUSE Linux Enterprise - Targets enterprises opensuse Linux - Community distro CENTOS by Open Logic - Binary compatible with Red Hat Enterprise Linux Microsoft provides forum-based support for all (today)

11 Linux Images: VM Depot The Linux images in the gallery provide just an OS Other Linux distributions are available Example: Debian Images typically include other software Examples: Django, Tomcat/EJB, Drupal, WordPress, Subversion, Jenkins, SugarCRM, An image s provider can offer paid support Example: Bitnami

12 Microsoft Azure Compute: PaaS Cloud Services Cloud Services Provides a pre-built, managed environment for running Windows applications Web Roles Application Worker Roles Can install open source software in Windows Server VMs Base images are Windows Server

13 Microsoft Azure Compute: PaaS Web Sites VMs Static Websites IIS Open Source Web Applications From the Web App Gallery Users Custom Web Applications Base images are Windows Server Microsoft Azure Web Sites FTP, WebDeploy Code HTML TFS, Git

14 Microsoft Azure Web Sites Example applications and frameworks in the Web App Gallery WordPress Joomla Umbraco What It Provides Content management system/blogging Content management system Content management system Technology Foundation PHP/MySQL PHP/MySQL (and others).net/sql Server (and others) MediaWiki Wiki package PHP/MySQL (and others) Django Web framework Python Express Web framework JavaScript/Node.js

15 Microsoft Azure Web Sites Supported open source development environments PHP Python Node.js Scripting language and environment for web development General-purpose dynamic programming language Environment for web development with JavaScript ASP.NET and Java applications are also supported

16 Node.js Basics Node.js can run in Virtual Machines, Cloud Services, and Web Sites JavaScript Client Code HTML/JSON Microsoft Azure JavaScript Server Code Written as a set of event handlers, each dispatched by the Node.js event loop JavaScript Engine Web Browser V8 JavaScript Engine Node.js Created by Google for the Chrome browser VM Same programming language on client and server

17 Node.js A closer look Perhaps a single-page app (SPA) Microsoft Azure Created by Google, provides data binding and more JavaScript Client Code AngularJS JavaScript Engine HTML/JSON JavaScript Server Code V8 JavaScript Engine Many useful modules are available as open source, e.g., Express Web Browser Node.js VM

18 Node.js Development tools Works with Node.js on Microsoft Azure Web Sites (today) Cloud9 IDE Visual Studio Online Monaco Web Browser Microsoft Azure JavaScript Server Code WebMatrix Node.js Tools for Visual Studio Windows V8 JavaScript Egine Node.js VM

19 Microsoft Azure Compute: MBaaS Mobile Services Using identities from Microsoft, Google, etc. Using services from Microsoft or Apple Node.js or ASP.NET User Authentication Notifications Data Access Custom Code Microsoft Azure Mobile Services REST/JSON Windows Store Apps Windows Phone Apps ios Apps Android Apps Microsoft provides SDKs for all

20 Which Compute Technology Should You Choose? Comparing the Azure open source options Use Mobile Services to support mobile apps Virtual Machines (IaaS) Cloud Services (PaaS) Web Sites (PaaS) Pros: Linux and Windows support; complete control of the VM Cons: Complete responsibility for VM management Pros: Least amount of required management Cons: Windows only; must reinstall open source software each time a VM starts Pros: Easiest to use; built-in support for many options Cons: Windows only; using more than the options Microsoft provides takes extra work

21 Data SQL, NoSQL, and Big Data Analytics

22 Microsoft Azure Technologies Data Operational Data Analytical Data Key/Value Store (Microsoft Azure Tables, Redis, ) NoSQL Technologies Column Family Store (Cassandra, HBase, ) Big Data Analytics (HDInsight, Hadoop) Document Store (MongoDB, CouchDB, ) Graph Database (Neo4J, ) Provided by Microsoft Azure SQL Technologies Relational Database (SQL Database, SQL Server, Oracle, MySQL, ) Relational Reporting (SQL Server, Oracle, MySQL, ) Relational Analytics (SQL Server, Oracle, MySQL, ) Runs in Microsoft Azure Virtual Machines Runs in Microsoft Azure Virtual Machines and is open source

23 The Relational Data Model A quick summary MySQL, etc. can run in an Azure Virtual Machines VM Application SQL Query Database Table Table Table Schema Relation ClearDB provides MySQL as a managed service on Microsoft Azure

24 Why Use a NoSQL Technology on Microsoft Azure? To handle lots of simultaneous users To work better with different data formats, e.g., JSON To work with data in a more flexible way To analyze lots of data in parallel Pros: NoSQL technologies can offer more scalability than relational databases Pros: Avoiding object/relational mapping makes code easier to write Pros: NoSQL technologies don t have fixed schemas Pros: Hadoop has a large and growing ecosystem of tools and people Cons: Often lose some benefits of relational databases, e.g., secondary indexes, full transactions Cons: Persistent data designed for a single application is harder to share; limited BI tools Cons: Fixed schemas help prevent errors; data often isn t normalized Cons: Moving lots of onpremises data to Microsoft Azure can take time Developers vs. DBAs?

25 Key/Value Stores Example: Redis NoSQL technologies are typically deployed in Microsoft Azure Linux VMs Database Shard Shard Shard Application B 3 A 1 A 2 B 1 B 2 C 1 C 2 A 3 B 3 C 3 Key Value (String, List, Set, Hash)

26 Comparing Operational NoSQL Technologies Key/value stores Example Technologies What It Provides Example Use Case Key/value stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Online shopping cart Roots are in Amazon Dynamo

27 Column Family Stores Example: Cassandra Keyspace Column Family Column Family Application X B 5 5 X A B Y C B Column Family Name Column Row Key Row Column Name Value Data that s frequently accessed together should be stored in the same column family

28 Comparing Operational NoSQL Technologies Column family stores Example Technologies What It Provides Example Use Case Key/value stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages Roots are in Google Bigtable

29 Document Databases Example: MongoDB Application Targets a specific collection Query JSON Database Collection Collection Collection JSON JSON JSON JSON JSON JSON JSON JSON Document MongoLab provides a managed database service based on MongoDB for Microsoft Azure

30 Comparing Operational NoSQL Technologies Document databases Example Technologies What It Provides Example Use Case Key/value stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages Document databases MongoDB, CouchDB Scalable store for JSON documents Persistent store for Node.js application

31 JSON Storage for JavaScript Applications The complete picture Microsoft Azure JavaScript Application Web Browser Native Apps JSON JSON JavaScript Server Code Node.js Query JSON Mongo DB Collection JSON JSON JSON PC/Phone/Tablet VM VM Mongoose and other packages support connecting to MongoDB

32 Graph Database Example: Neo4J A B D X Y Relationships are first-class data items Application Query B D Graph Graph Node Relationship Property Hard to shard, so not intended for massive scale

33 Comparing Operational NoSQL Technologies Graph databases Example Technologies What It Provides Example Use Case Key/value stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages Document databases MongoDB, CouchDB Scalable store for JSON documents Persistent store for Node.js application Graph databases Neo4J Fast access to data organized into graphs Social graph

34 Big Data Analytics Some members of the Hadoop technology family Hadoop 2.0 adds YARN, supporting frameworks other than MapReduce Hadoop Distributed File System (HDFS) Hadoop MapReduce Hive/Pig HBase Allows storing and accessing very large binary files across a cluster of commodity servers and disk drives Supports applications that process large amounts of analytical data in parallel Data is typically stored in HDFS Tools for querying, transforming, and analyzing data Both generate MapReduce jobs Column family store built on HDFS Designed for operational data, not analytical data

35 Big Data Analytics Example: A Hadoop cluster on Microsoft Azure Virtual Machines Provides HiveQL, a SQLlike query language Excel Microsoft allows submitting HiveQL queries from Excel Hive Pig... Hadoop MapReduce Job Hadoop Distributed File System (HDFS) Logic Logic Logic Data Data Data

36 Big Data Analytics Example: HDInsight Using HDInsight will typically make more sense than building your own Hadoop cluster on Microsoft Azure Excel Hive Pig... Hadoop MapReduce Job HDFS API VM VM VM Logic Logic Logic Data Data Data Microsoft Azure Blobs

37 Conclusion i Open source technologies are a fundamental part of Microsoft Azure Microsoft is serious about open source on Azure Compute: Support for many open source languages, frameworks, and applications Data: The ability to use open source databases, both relational and NoSQL Not even Microsoft can ignore the open source world

38 About the Speaker David Chappell is Principal of Chappell & Associates ( in San Francisco, California. Through his speaking, writing, and consulting, he helps people around the world understand, use, and make better decisions about new technology. David has been the keynote speaker for more than a hundred events and conferences on five continents, and his seminars have been attended by tens of thousands of business and IT leaders, architects, and developers in forty-five countries. His books have been published in a dozen languages and used regularly in courses at MIT, ETH Zurich, and other universities. In his consulting practice, he has helped clients such as Hewlett-Packard, IBM, Microsoft, Stanford University, and Target Corporation adopt new technologies, market new products, and educate their customers and staff. Earlier in his career, David wrote networking software, chaired a U.S. national standards working group, and played keyboards with the Peabody-award-winning Children s Radio Theater. He holds a B.S. in Economics and an M.S. in Computer Science, both from the University of Wisconsin-Madison.

39 Copyright 2014 Chappell & Associates

Open Source Technologies on Microsoft Azure

Open Source Technologies on Microsoft Azure Open Source Technologies on Microsoft Azure A Survey @DChappellAssoc Copyright 2014 Chappell & Associates The Main Idea i Open source technologies are a fundamental part of Microsoft Azure The Big Questions

More information

Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor. Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert

Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor. Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert Open Source on Microsoft Azure Two categories Compute Data IaaS, PaaS, and

More information

Cloud Platforms in the Enterprise

Cloud Platforms in the Enterprise Cloud Platforms in the Enterprise A Guide for IT Leaders @DChappellAssoc Copyright 2014 Chappell & Associates The Three Most Important IT Events In the last decade Initial pubic offering of Salesforce.com,

More information

Platforms in the Cloud

Platforms in the Cloud Platforms in the Cloud Where Will Your Next Application Run? Jazoon, Zurich June 2011 Copyright 2011 Chappell & Associates An Organization without Cloud Computing Users A A A VM VM VM A A A Application

More information

Understanding NoSQL Technologies on Windows Azure

Understanding NoSQL Technologies on Windows Azure David Chappell Understanding NoSQL Technologies on Windows Azure Sponsored by Microsoft Corporation Copyright 2013 Chappell & Associates Contents Data on Windows Azure: The Big Picture... 3 Windows Azure

More information

WINDOWS AZURE EXECUTION MODELS

WINDOWS AZURE EXECUTION MODELS WINDOWS AZURE EXECUTION MODELS Windows Azure provides three different execution models for running applications: Virtual Machines, Web Sites, and Cloud Services. Each one provides a different set of services,

More information

Cloud Computing Today

Cloud Computing Today Cloud Computing Today What You Need to Know Now Copyright 2013 Chappell & ssociates n Organization without Cloud Computing Users Compute/Storage/Network pplication On-Premises Data Center Virtual Machine

More information

Azure and Its Competitors

Azure and Its Competitors Azure and Its Competitors The Big Picture @DChappellAssoc Copyright 2014 Chappell & Associates The Three Most Important IT Events In the last decade Salesforce.com IPO, 2004 Showed that Software as a Service

More information

Understanding NoSQL on Microsoft Azure

Understanding NoSQL on Microsoft Azure David Chappell Understanding NoSQL on Microsoft Azure Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Data on Azure: The Big Picture... 3 Relational Technology: A Quick

More information

Microsoft Azure Data Technologies: An Overview

Microsoft Azure Data Technologies: An Overview David Chappell Microsoft Azure Data Technologies: An Overview Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Blobs... 3 Running a DBMS in a Virtual Machine... 4 SQL Database...

More information

WINDOWS AZURE DATA MANAGEMENT

WINDOWS AZURE DATA MANAGEMENT David Chappell October 2012 WINDOWS AZURE DATA MANAGEMENT CHOOSING THE RIGHT TECHNOLOGY Sponsored by Microsoft Corporation Copyright 2012 Chappell & Associates Contents Windows Azure Data Management: A

More information

OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM

OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM David Chappell OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM A GUIDE FOR IT LEADERS Sponsored by Microsoft Corporation Copyright 2016 Chappell & Associates Contents Microsoft s Data Platform:

More information

Architecting Open source solutions on Azure. Nicholas Dritsas Senior Director, Microsoft Singapore

Architecting Open source solutions on Azure. Nicholas Dritsas Senior Director, Microsoft Singapore Learn. Connect. Explore. Architecting Open source solutions on Azure Nicholas Dritsas Senior Director, Microsoft Singapore Agenda Developing OSS Apps on Azure Customer case with OSS Apps Hadoop on Azure

More information

WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS

WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS Managing and analyzing data in the cloud is just as important as it is anywhere else. To let you do this, Windows Azure provides a range of technologies

More information

Systems Integrators in the Cloud Era

Systems Integrators in the Cloud Era Systems Integrators in the Cloud Era Embracing the Future @DChappellAssoc Copyright 2014 Chappell & Associates SIs in the Cloud Era The SI world is changing The cloud brings new opportunities and new threats

More information

Cloud Scale Distributed Data Storage. Jürmo Mehine

Cloud Scale Distributed Data Storage. Jürmo Mehine Cloud Scale Distributed Data Storage Jürmo Mehine 2014 Outline Background Relational model Database scaling Keys, values and aggregates The NoSQL landscape Non-relational data models Key-value Document-oriented

More information

Cloud Platforms Today: The Big Picture

Cloud Platforms Today: The Big Picture Cloud Platforms Today: The Big Picture David Chappell Chappell & Associates www.davidchappell.com Mobile Workforce Big Data Cloud Computing Social Enterprise Privacy and Security The traditional world

More information

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1 Why NoSQL? Your database options in the new non- relational world 2015 IBM Cloudant 1 Table of Contents New types of apps are generating new types of data... 3 A brief history on NoSQL... 3 NoSQL s roots

More information

Standards and Open Source: Trends Affecting Microsoft and You. October 9, 2014 8:00 am 8:50 am

Standards and Open Source: Trends Affecting Microsoft and You. October 9, 2014 8:00 am 8:50 am Standards and Open Source: Trends Affecting Microsoft and You October 9, 2014 8:00 am 8:50 am Moderator David Ezell Principal Software Architect VeriFone Inc. Speaker Brian Benz Senior Technical Evangelist

More information

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world Analytics March 2015 White paper Why NoSQL? Your database options in the new non-relational world 2 Why NoSQL? Contents 2 New types of apps are generating new types of data 2 A brief history of NoSQL 3

More information

Assignment # 1 (Cloud Computing Security)

Assignment # 1 (Cloud Computing Security) Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual

More information

INTRODUCING WINDOWS AZURE

INTRODUCING WINDOWS AZURE INTRODUCING WINDOWS AZURE Windows Azure is Microsoft s application platform for the public cloud. You can use this platform in many different ways. For instance, you can use Windows Azure to build a web

More information

INTRODUCTIONS. Storm Technology. David Chappell. The Cloud A Rational Perspective. Logistics. Who we are and what we do

INTRODUCTIONS. Storm Technology. David Chappell. The Cloud A Rational Perspective. Logistics. Who we are and what we do INTRODUCTIONS Storm Technology Who we are and what we do David Chappell IT strategist and international advisor The Cloud A Rational Perspective The cloud platforms An objective overview of the Windows

More information

Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid

Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid Development Management Identity Data Virtualization All services

More information

Structured Data Storage

Structured Data Storage Structured Data Storage Xgen Congress Short Course 2010 Adam Kraut BioTeam Inc. Independent Consulting Shop: Vendor/technology agnostic Staffed by: Scientists forced to learn High Performance IT to conduct

More information

David Chappell. Data in a PaaS World. A Guide for New Applications. Sponsored by Microsoft Corporation. Copyright 2016 Chappell & Associates

David Chappell. Data in a PaaS World. A Guide for New Applications. Sponsored by Microsoft Corporation. Copyright 2016 Chappell & Associates David Chappell Data in a PaaS World A Guide for New Applications Sponsored by Microsoft Corporation Copyright 2016 Chappell & Associates Contents The Rise of PaaS Data Services... 3 The Value of PaaS for

More information

Microsoft Research Windows Azure for Research Training

Microsoft Research Windows Azure for Research Training Copyright 2013 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Microsoft Research Microsoft Azure for Research Training

Microsoft Research Microsoft Azure for Research Training Copyright 2014 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Azure Data Lake Analytics

Azure Data Lake Analytics Azure Data Lake Analytics Compose and orchestrate data services at scale Fully managed service to support orchestration of data movement and processing Connect to relational or non-relational data

More information

Sentimental Analysis using Hadoop Phase 2: Week 2

Sentimental Analysis using Hadoop Phase 2: Week 2 Sentimental Analysis using Hadoop Phase 2: Week 2 MARKET / INDUSTRY, FUTURE SCOPE BY ANKUR UPRIT The key value type basically, uses a hash table in which there exists a unique key and a pointer to a particular

More information

Windows Azure Architecture I think, therefore I am

Windows Azure Architecture I think, therefore I am Windows Azure Architecture I think, therefore I am Fernando Machado Píriz Enterprise Architect, Microsoft @netconfuy @fmachadopiriz Greater than >57% >250k 1,000,000 Fortune 500 using Azure Active websites

More information

Web 2.0 Technology Overview. Lecture 8 GSL Peru 2014

Web 2.0 Technology Overview. Lecture 8 GSL Peru 2014 Web 2.0 Technology Overview Lecture 8 GSL Peru 2014 Overview What is Web 2.0? Sites use technologies beyond static pages of earlier websites. Users interact and collaborate with one another Rich user experience

More information

Cloud Computing and Big Data What Technical Writers Need to Know

Cloud Computing and Big Data What Technical Writers Need to Know Cloud Computing and Big Data What Technical Writers Need to Know Greg Olson, Senior Director Black Duck Software For the Society of Technical Writers Berkeley Chapter Black Duck 2014 Agenda Introduction

More information

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required.

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required. What is this course about? This course is an overview of Big Data tools and technologies. It establishes a strong working knowledge of the concepts, techniques, and products associated with Big Data. Attendees

More information

APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS

APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS This article looks into the benefits of using the Platform as a Service paradigm to develop applications on the cloud. It also compares a few top PaaS providers

More information

Big Data Technologies Compared June 2014

Big Data Technologies Compared June 2014 Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development

More information

extensible record stores document stores key-value stores Rick Cattel s clustering from Scalable SQL and NoSQL Data Stores SIGMOD Record, 2010

extensible record stores document stores key-value stores Rick Cattel s clustering from Scalable SQL and NoSQL Data Stores SIGMOD Record, 2010 System/ Scale to Primary Secondary Joins/ Integrity Language/ Data Year Paper 1000s Index Indexes Transactions Analytics Constraints Views Algebra model my label 1971 RDBMS O tables sql-like 2003 memcached

More information

Linux A first-class citizen in Windows Azure. Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise

Linux A first-class citizen in Windows Azure. Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise Linux A first-class citizen in Windows Azure Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise 1 First, I am software developer (C/C++, ASM, C#, Java, Node.js,

More information

Sparking your Knowledge with Azure Spark

Sparking your Knowledge with Azure Spark Sparking your Knowledge with Azure Spark Data Platform Airlift 21 de Outubro \\ Microsoft Lisbon Experience Industry validation "Microsoft s comprehensive hybrid story, which spans applications and platforms

More information

Hadoop vs Apache Spark

Hadoop vs Apache Spark Innovate, Integrate, Transform Hadoop vs Apache Spark www.altencalsoftlabs.com Introduction Any sufficiently advanced technology is indistinguishable from magic. said Arthur C. Clark. Big data technologies

More information

Big Data and Data Science: Behind the Buzz Words

Big Data and Data Science: Behind the Buzz Words Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing

More information

Introduction to NoSQL Databases. Tore Risch Information Technology Uppsala University 2013-03-05

Introduction to NoSQL Databases. Tore Risch Information Technology Uppsala University 2013-03-05 Introduction to NoSQL Databases Tore Risch Information Technology Uppsala University 2013-03-05 UDBL Tore Risch Uppsala University, Sweden Evolution of DBMS technology Distributed databases SQL 1960 1970

More information

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013 Database Management System Choices Introduction To Database Systems CSE 373 Spring 2013 Outline Introduction PostgreSQL MySQL Microsoft SQL Server Choosing A DBMS NoSQL Introduction There a lot of options

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

SQL VS. NO-SQL. Adapted Slides from Dr. Jennifer Widom from Stanford

SQL VS. NO-SQL. Adapted Slides from Dr. Jennifer Widom from Stanford SQL VS. NO-SQL Adapted Slides from Dr. Jennifer Widom from Stanford 55 Traditional Databases SQL = Traditional relational DBMS Hugely popular among data analysts Widely adopted for transaction systems

More information

INTRODUCTION & CONCEPTS. Definition of Cloud Computing Service Models Deployment Models... 23

INTRODUCTION & CONCEPTS. Definition of Cloud Computing Service Models Deployment Models... 23 Contents I INTRODUCTION & CONCEPTS 17 1 Introduction to Cloud Computing 19 11 Introduction 111 Definition of Cloud Computing 20 12 Characteristics of Cloud Computing 20 13 Cloud Models 22 131 132 Service

More information

ADOPTING MICROSOFT AZURE

ADOPTING MICROSOFT AZURE David Chappell ADOPTING MICROSOFT AZURE A GUIDE FOR IT LEADERS Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Public Cloud Platforms: The Future of Enterprise Computing...

More information

Can the Elephants Handle the NoSQL Onslaught?

Can the Elephants Handle the NoSQL Onslaught? Can the Elephants Handle the NoSQL Onslaught? Avrilia Floratou, Nikhil Teletia David J. DeWitt, Jignesh M. Patel, Donghui Zhang University of Wisconsin-Madison Microsoft Jim Gray Systems Lab Presented

More information

Preparing Your Data For Cloud

Preparing Your Data For Cloud Preparing Your Data For Cloud Narinder Kumar Inphina Technologies 1 Agenda Relational DBMS's : Pros & Cons Non-Relational DBMS's : Pros & Cons Types of Non-Relational DBMS's Current Market State Applicability

More information

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com ` CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS Review Business and Technology Series www.cumulux.com Table of Contents Cloud Computing Model...2 Impact on IT Management and

More information

CHAPTER 1: NOSQL: WHAT IT IS AND WHY YOU NEED IT 3

CHAPTER 1: NOSQL: WHAT IT IS AND WHY YOU NEED IT 3 INTRODUCTION xvii PART I: GETTING STARTED CHAPTER 1: NOSQL: WHAT IT IS AND WHY YOU NEED IT 3 Definition and Introduction 4 Context and a Bit of History 4 Big Data 7 Scalability 9 Defi nition and Introduction

More information

Developing Microsoft Azure Solutions

Developing Microsoft Azure Solutions Course M20532 5 Day(s) 30:00 Hours Developing Microsoft Azure Solutions Audience The candidates targeted by this training have basic experience in implementing and monitoring Microsoft Azure solutions.

More information

Data Services Advisory

Data Services Advisory Data Services Advisory Modern Datastores An Introduction Created by: Strategy and Transformation Services Modified Date: 8/27/2014 Classification: DRAFT SAFE HARBOR STATEMENT This presentation contains

More information

www.expaway.com Offerte del 13 giugno 2014

www.expaway.com Offerte del 13 giugno 2014 www.expaway.com Offerte del 13 giugno 2014 TR1414A - SOFTWARE DEVELOPER/ ARCHITECT (GERLINGEN) Location: Gerlingen (9 km west of Stuttgart) Field of operation: Consumer Services Founded: 2011 and German

More information

Introduction to Big Data Training

Introduction to Big Data Training Introduction to Big Data Training The quickest way to be introduce with NOSQL/BIG DATA offerings Learn and experience Big Data Solutions including Hadoop HDFS, Map Reduce, NoSQL DBs: Document Based DB

More information

Microsoft Azure Fundamentals

Microsoft Azure Fundamentals Microsoft Azure Fundamentals 10979C - 2 Days - Instructor-led, Hands-on Introduction This course provides the underlying knowledge required by all individuals who will be evaluating Microsoft Azure, regardless

More information

Google Cloud Platform The basics

Google Cloud Platform The basics Google Cloud Platform The basics Who I am Alfredo Morresi ROLE Developer Relations Program Manager COUNTRY Italy PASSIONS Community, Development, Snowboarding, Tiramisu' Reach me alfredomorresi@google.com

More information

Developing Microsoft Azure Solutions

Developing Microsoft Azure Solutions Course 20532B: Developing Microsoft Azure Solutions Course Outline Module 1: OVERVIEW OF THE MICROSOFT AZURE PLATFORM This module reviews the services available in the Azure platform and the Management

More information

Where We Are. References. Cloud Computing. Levels of Service. Cloud Computing History. Introduction to Data Management CSE 344

Where We Are. References. Cloud Computing. Levels of Service. Cloud Computing History. Introduction to Data Management CSE 344 Where We Are Introduction to Data Management CSE 344 Lecture 25: DBMS-as-a-service and NoSQL We learned quite a bit about data management see course calendar Three topics left: DBMS-as-a-service and NoSQL

More information

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect IT Insight podcast This podcast belongs to the IT Insight series You can subscribe to the podcast through

More information

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Apps and data source extensions with APIs Future white label, embed or integrate Power BI Deploy Intelligent

More information

20532 Developing Microsoft Azure Solutions. Course Content. Course ID#: ZZ-W Hours: 35. Course Description: Prerequisites:

20532 Developing Microsoft Azure Solutions. Course Content. Course ID#: ZZ-W Hours: 35. Course Description: Prerequisites: Course Content Course Description: This course is intended for students who have experience building vertically scaled applications. Students will also have experience with the Microsoft platform and a

More information

Big Data and the Cloud Trends, Applications, and Training

Big Data and the Cloud Trends, Applications, and Training Big Data and the Cloud Trends, Applications, and Training Stavros Christodoulakis MUSIC/TUC Lab School of Electronic and Computer Engineering Technical University of Crete stavros@ced.tuc.gr Data Explosion

More information

Bringing Big Data to People

Bringing Big Data to People Bringing Big Data to People Microsoft s modern data platform SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform Everyone should have access to the data they need. Process

More information

Introduction to MapReduce Tore Risch Information Technology Uppsala University

Introduction to MapReduce  Tore Risch Information Technology Uppsala University Introduction to MapReduce http://user.it.uu.se/~torer/kurser/dm2/mapreduce.pdf Tore Risch Information Technology Uppsala University 2015-05-11 What is a NoSQL Database? A key/value store Basic index manager,

More information

NoSQL web apps. w/ MongoDB, Node.js, AngularJS. Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013

NoSQL web apps. w/ MongoDB, Node.js, AngularJS. Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013 NoSQL web apps w/ MongoDB, Node.js, AngularJS Dr. Gerd Jungbluth, NoSQL UG Cologne, 4.9.2013 About us Passionate (web) dev. since fallen in love with Sinclair ZX Spectrum Academic background in natural

More information

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview Programming Hadoop 5-day, instructor-led BD-106 MapReduce Overview The Client Server Processing Pattern Distributed Computing Challenges MapReduce Defined Google's MapReduce The Map Phase of MapReduce

More information

Developing Microsoft Azure Solutions

Developing Microsoft Azure Solutions Course Duration: 5 Days About this Course This course is intended for students who have experience building vertically scaled applications. Students should also have experience with the Microsoft Azure

More information

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012) 1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.

More information

Developing Microsoft Azure Solutions 20532B; 5 Days, Instructor-led

Developing Microsoft Azure Solutions 20532B; 5 Days, Instructor-led Developing Microsoft Azure Solutions 20532B; 5 Days, Instructor-led Course Description This course is intended for students who have experience building vertically scaled applications. Students should

More information

NoSQL systems: introduction and data models. Riccardo Torlone Università Roma Tre

NoSQL systems: introduction and data models. Riccardo Torlone Università Roma Tre NoSQL systems: introduction and data models Riccardo Torlone Università Roma Tre Why NoSQL? In the last thirty years relational databases have been the default choice for serious data storage. An architect

More information

PaaS - Platform as a Service Google App Engine

PaaS - Platform as a Service Google App Engine PaaS - Platform as a Service Google App Engine Pelle Jakovits 14 April, 2015, Tartu Outline Introduction to PaaS Google Cloud Google AppEngine DEMO - Creating applications Available Google Services Costs

More information

GigaSpaces Real-Time Analytics for Big Data

GigaSpaces Real-Time Analytics for Big Data GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and

More information

Client-Server Architecture The Classical Client-Server Model

Client-Server Architecture The Classical Client-Server Model Apache 60.31% IIS (by Microsoft) 19.34% nginx (by Igor Sysoev) 7.65% GWS (by Google) 5.09% lighttpd 0.60% Web Servers Market Share 2011 -Server Architecture The Classical -Server Model 37 38 -Server Architecture

More information

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia Monitis Project Proposals for AUA September 2014, Yerevan, Armenia Distributed Log Collecting and Analysing Platform Project Specifications Category: Big Data and NoSQL Software Requirements: Apache Hadoop

More information

Realizing the Benefits of Hybrid Cloud. Anand MS Cloud Solutions Architect Microsoft Asia Pacific

Realizing the Benefits of Hybrid Cloud. Anand MS Cloud Solutions Architect Microsoft Asia Pacific Realizing the Benefits of Hybrid Cloud Anand MS Cloud Solutions Architect Microsoft Asia Pacific Agenda Key drivers for Hybrid Cloud Unified Cloud Strategy Example Use Cases How to get there Hybrid Cloud:

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

Firebird meets NoSQL (Apache HBase) Case Study

Firebird meets NoSQL (Apache HBase) Case Study Firebird meets NoSQL (Apache HBase) Case Study Firebird Conference 2011 Luxembourg 25.11.2011 26.11.2011 Thomas Steinmaurer DI +43 7236 3343 896 thomas.steinmaurer@scch.at www.scch.at Michael Zwick DI

More information

Applications for Big Data Analytics

Applications for Big Data Analytics Smarter Healthcare Applications for Big Data Analytics Multi-channel sales Finance Log Analysis Homeland Security Traffic Control Telecom Search Quality Manufacturing Trading Analytics Fraud and Risk Retail:

More information

Implement Hadoop jobs to extract business value from large and varied data sets

Implement Hadoop jobs to extract business value from large and varied data sets Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to

More information

Introduction to NoSQL Databases and MapReduce. Tore Risch Information Technology Uppsala University 2014-05-12

Introduction to NoSQL Databases and MapReduce. Tore Risch Information Technology Uppsala University 2014-05-12 Introduction to NoSQL Databases and MapReduce Tore Risch Information Technology Uppsala University 2014-05-12 What is a NoSQL Database? 1. A key/value store Basic index manager, no complete query language

More information

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Dave Dykstra dwd@fnal.gov Fermilab is operated by the Fermi Research Alliance, LLC under contract No. DE-AC02-07CH11359

More information

ANALYTICAL SCENARIOS USING THE MICROSOFT DATA PLATFORM

ANALYTICAL SCENARIOS USING THE MICROSOFT DATA PLATFORM David Chappell ANALYTICAL SCENARIOS USING THE MICROSOFT DATA PLATFORM A GUIDE FOR IT LEADERS Sponsored by Microsoft Corporation Copyright 2016 Chappell & Associates Contents Microsoft s Data Platform:

More information

WINDOWS AZURE NETWORKING

WINDOWS AZURE NETWORKING WINDOWS AZURE NETWORKING The easiest way to connect to Windows Azure applications and data is through an ordinary Internet connection. But this simple solution isn t always the best approach. Windows Azure

More information

THE WINDOWS AZURE PROGRAMMING MODEL

THE WINDOWS AZURE PROGRAMMING MODEL THE WINDOWS AZURE PROGRAMMING MODEL DAVID CHAPPELL OCTOBER 2010 SPONSORED BY MICROSOFT CORPORATION CONTENTS Why Create a New Programming Model?... 3 The Three Rules of the Windows Azure Programming Model...

More information

INTRODUCTION TO CASSANDRA

INTRODUCTION TO CASSANDRA INTRODUCTION TO CASSANDRA This ebook provides a high level overview of Cassandra and describes some of its key strengths and applications. WHAT IS CASSANDRA? Apache Cassandra is a high performance, open

More information

Introduction to Cloud Computing

Introduction to Cloud Computing Discovery 2015: Cloud Computing Workshop June 20-24, 2011 Berkeley, CA Introduction to Cloud Computing Keith R. Jackson Lawrence Berkeley National Lab What is it? NIST Definition Cloud computing is a model

More information

Big Data Approaches. Making Sense of Big Data. Ian Crosland. Jan 2016

Big Data Approaches. Making Sense of Big Data. Ian Crosland. Jan 2016 Big Data Approaches Making Sense of Big Data Ian Crosland Jan 2016 Accelerate Big Data ROI Even firms that are investing in Big Data are still struggling to get the most from it. Make Big Data Accessible

More information

3 Case Studies of NoSQL and Java Apps in the Real World

3 Case Studies of NoSQL and Java Apps in the Real World Eugene Ciurana geecon@ciurana.eu - pr3d4t0r ##java, irc.freenode.net 3 Case Studies of NoSQL and Java Apps in the Real World This presentation is available from: http://ciurana.eu/geecon-2011 About Eugene...

More information

Objectives. Introduce some key concepts behind the NoSQL family of databases

Objectives. Introduce some key concepts behind the NoSQL family of databases NoSQL Source: Pramod J. Sadalage and Martin Fowler NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence, Pearson Education, 2013 Objectives Introduce some key concepts behind the

More information

An Approach to Implement Map Reduce with NoSQL Databases

An Approach to Implement Map Reduce with NoSQL Databases www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 8 Aug 2015, Page No. 13635-13639 An Approach to Implement Map Reduce with NoSQL Databases Ashutosh

More information

Any platform. Achieve more. Team agility

Any platform. Achieve more. Team agility Every app Every developer Any platform Achieve more Team agility Visual Studio 2015 Visual Studio 2013 "Russian Doll" Licensing Model Features Team Foundation Server Web Test Case Management Agile Portfolio

More information

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE

NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE <GEOFF@ZORCHED.NET> @GEOFFLANE NOSQL INTRODUCTION WITH MONGODB AND RUBY GEOFF LANE @GEOFFLANE WHAT IS NOSQL? NON-RELATIONAL DATA STORAGE USUALLY SCHEMA-FREE ACCESS DATA WITHOUT SQL (THUS... NOSQL) WIDE-COLUMN / TABULAR

More information

SOA, BPM, and Microsoft: A Pragmatic View

SOA, BPM, and Microsoft: A Pragmatic View SOA, BPM, and Microsoft: A Pragmatic View David Chappell Chappell & Associates www.davidchappell.com Copyright 2006 David Chappell Vision and Pragmatism Vision is essential But rubber must eventually meet

More information

Enterprise Operational SQL on Hadoop Trafodion Overview

Enterprise Operational SQL on Hadoop Trafodion Overview Enterprise Operational SQL on Hadoop Trafodion Overview Rohit Jain Distinguished & Chief Technologist Strategic & Emerging Technologies Enterprise Database Solutions Copyright 2012 Hewlett-Packard Development

More information

Agenda and Abstract for. Tuesday February 4th, :00am -1:00pm PT / 12:00pm 4:00pm ET / 3:00pm 7:00pm BRT

Agenda and Abstract for. Tuesday February 4th, :00am -1:00pm PT / 12:00pm 4:00pm ET / 3:00pm 7:00pm BRT Agenda and Abstract for Virtual Developer Day - Building Database Apps using Modern Techniques Tuesday February 4th, 2012 9:00am -1:00pm PT / 12:00pm 4:00pm ET / 3:00pm 7:00pm BRT Agenda Time Track and

More information

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.0.x

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.0.x HP Vertica Analytic Database Software Version: 7.0.x Document Release Date: 5/7/2014 Legal Notices Warranty The only warranties for HP products and services are set forth in the express warranty statements

More information

Implementing Microsoft Azure Infrastructure Solutions

Implementing Microsoft Azure Infrastructure Solutions Course 20533: Implementing Microsoft Azure Infrastructure Solutions Course details Course Outline Module 1: Introduction to Azure This module provides the students a high level introduction to Azure. Cloud

More information

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.1.x

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.1.x HP Vertica Analytic Database Software Version: 7.1.x Document Release Date: 10/14/2015 Legal Notices Warranty The only warranties for HP products and services are set forth in the express warranty statements

More information

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture 8 Cloud Programming & Software Environments Part 1 of 2 Spring 2013 A Specialty Course for Purdue University s M.S. in Technology

More information