Open Source Technologies on Microsoft Azure

Size: px
Start display at page:

Download "Open Source Technologies on Microsoft Azure"

Transcription

1 Open Source Technologies on Microsoft Azure A Copyright 2014 Chappell & Associates

2 The Main Idea i Open source technologies are a fundamental part of Microsoft Azure

3 The Big Questions Commitment? Is Microsoft really serious about supporting open source on Azure? ANSWER Yes: - Its competitors do this - Cloud platforms sell cycles, storage, and bandwidth. Who cares what software uses these?

4 The Big Questions Customers? Do customers care about open source on Azure? ANSWER Yes: - For running Linux workloads - For open source development on Linux and Windows You can now sell projects that include open source solutions

5 Open Source on Microsoft Azure Two categories Compute Data IaaS, PaaS, and mobile services SQL, NoSQL, and big data analytics

6 Compute IaaS, PaaS, and Mobile Services

7 Microsoft Azure Technologies Compute (1) Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Virtual Machines Cloud Services Web Sites Application VMs Application IIS Application VHDs Gallery Web Roles Worker Roles IIS Application Application VHDs User-Supplied

8 Microsoft Azure Technologies Compute (2) Mobile Backend as a Service (MBaaS) Mobile Services Authentication Notifications Custom Logic...

9 Microsoft Azure Compute: IaaS Virtual Machines Virtual Machines VMs Windows Server images provided by Microsoft; Linux images provided by partners VHDs Gallery VHDs User-Supplied Windows Server and Linux images provided by customers

10 Linux Images: Examples From the Gallery!!!!! Canonical UBUNTU Oracle Linux SUSE Linux Enterprise - Targets enterprises opensuse Linux - Community distro CENTOS by Open Logic - Binary compatible with Red Hat Enterprise Linux Microsoft provides forum-based support for all

11 Microsoft Azure Compute: PaaS Cloud Services Cloud Services Provides a pre-built, managed environment for running Windows applications Web Roles Application Worker Roles Can install open source software in Windows Server VMs Base images are Windows Server

12 Microsoft Azure Compute: PaaS Web Sites Web Sites IIS VMs Custom Web Applications FTP, WebDeploy Code HTML TFS, Git Open Source Web Applications From the Web App Gallery Base images are Windows Server

13 Microsoft Azure Web Sites Example applications and frameworks in the Web App Gallery WordPress Joomla What It Provides Content management system/blogging Content management system Technology Foundation PHP/MySQL PHP/MySQL (and others) MediaWiki Wiki package PHP/MySQL (and others) Apache Tomcat Django Web server/ servlet container Web framework Java Python Express Web framework JavaScript/Node.js

14 Microsoft Azure Web Sites Supported open source development environments PHP Python Node.js Scripting language and environment for web development General-purpose dynamic programming language Environment for web development with JavaScript.NET and Java applications are also supported

15 Node.js Basics Node.js can run in Virtual Machines, Cloud Services, and Web Sites JavaScript Client Code HTML/JSON Microsoft Azure JavaScript Server Code Written as a set of event handlers, each dispatched by the Node.js event loop JavaScript Engine Web Browser V8 JavaScript Engine Node.js Created by Google for the Chrome browser VM Same programming language on client and server

16 Node.js Development tools Works with Node.js on Microsoft Azure Web Sites (today) Cloud9 IDE Visual Studio Online Monaco Web Browser WebMatrix Microsoft Azure JavaScript Server Code V8 JavaScript Egine Many useful modules are available as open source, e.g., Express Node.js Tools for Visual Studio Windows Node.js VM

17 Microsoft Azure Compute: MBaaS Mobile Services Using identities from Microsoft, Google, etc. Using services from Microsoft or Apple Built with Node.js or.net User Authentication Notifications Data Access Custom Code Microsoft Azure Mobile Services REST/JSON Windows Store Apps Windows Phone Apps ios Apps Android Apps Microsoft provides SDKs for all

18 Which Compute Technology Should You Choose? Comparing the open source options Use Mobile Services to support mobile apps Microsoft Azure Virtual Machines (IaaS) Pros: Linux and Windows support; complete control of the VM Cons: Complete responsibility for VM management Microsoft Azure Cloud Services (PaaS) Pros: Least amount of required management Cons: Windows only; must reinstall OSS software each time a VM starts Microsoft Azure Web Sites (PaaS) Pros: Easiest to use; built-in support for many options Cons: Windows only; using more than the options Microsoft provides takes extra work

19 Data SQL, NoSQL, and Big Data Analytics

20 Microsoft Azure Technologies Data Operational Data Analytical Data Key/Value Store (Tables, Redis, ) NoSQL Technologies Column Family Store (HBase, Cassandra, ) Big Data Analytics (HDInsight, Hadoop) Document Store (DocumentDB, MongoDB, ) Graph Database (Neo4J, ) Provided by Microsoft Azure SQL Technologies Relational Database (SQL Database, SQL Server, Oracle, MySQL, ) Relational Reporting (SQL Server, Oracle, MySQL, ) Relational Analytics (SQL Server, Oracle, MySQL, ) Runs in Microsoft Azure Virtual Machines Runs in Microsoft Azure Virtual Machines and is open source

21 The Relational Data Model A quick summary MySQL, etc. can run in a Microsoft Azure Virtual Machines VM Application SQL Query Database Table Table Table Schema Relation ClearDB provides MySQL as a managed service on Microsoft Azure

22 Why Use a NoSQL Technology on Microsoft Azure? To scale for lots of users and lots of data To work better with different data formats, e.g., JSON To work with data in a more flexible way To analyze lots of data in parallel Pros: NoSQL technologies can offer more scalability than relational databases Pros: Avoiding object/relational mapping makes code easier to write Pros: NoSQL technologies don t have fixed schemas Pros: Hadoop has a large and growing ecosystem of tools and people Cons: Often lose some benefits of relational databases, e.g., secondary indexes, full transactions Cons: Persistent data designed for a single application is harder to share; limited BI tools Cons: Fixed schemas help prevent errors; data often isn t normalized Cons: Moving lots of onpremises data to Microsoft Azure can take time

23 Key/Value Stores Example: Redis NoSQL technologies are typically deployed in Microsoft Azure Linux VMs Database Shard Shard Shard Application B 3 A 1 A 2 B 1 B 2 C 1 C 2 A 3 B 3 C 3 Key Value (String, List, Set, Hash)

24 Comparing Operational NoSQL Technologies Key/value stores Example Technologies What It Provides Example Use Case Key/value stores Redis, Tables Fast access to large amounts of simply structured data Online shopping cart

25 Column Family Stores Example: Cassandra Keyspace Columns store multiple timestamped versions of a value Column Family Column Family Application X B 5 5 X A B Y C B Column Family Name Column Row Key Row Column Name Value

26 Comparing Operational NoSQL Technologies Column family stores Example Technologies What It Provides Example Use Case Key/value stores Redis, Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages

27 Document Databases Example: MongoDB Database Can create indexes on multiple keys Targets a specific collection Shard Shard Shard Collection Collection Application Query JSON JSON JSON JSON JSON JSON JSON JSON JSON JSON Document MongoLab provides a managed database service based on MongoDB for Microsoft Azure

28 Comparing Operational NoSQL Technologies Document databases Example Technologies What It Provides Example Use Case Key/value stores Redis, Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages Document databases MongoDB, DocumentDB Scalable store for JSON documents Persistent store for Node.js application

29 JSON Storage for JavaScript Applications The complete picture Microsoft Azure JavaScript Application Web Browser Native Apps JSON JSON JavaScript Server Code Node.js Query JSON Mongo DB Collection JSON JSON JSON PC/Phone/Tablet VM VM

30 Graph Database Example: Neo4J A B D X Y Relationships are first-class data items Application Query B D Graph Graph Node Relationship Property Hard to shard, so not intended for massive scale

31 Comparing Operational NoSQL Technologies Graph databases Example Technologies What It Provides Example Use Case Key/value stores Redis, Tables Fast access to large amounts of simply structured data Online shopping cart Column family stores Cassandra, HBase Fast access to large amounts of more structured data A table storing web pages Document databases MongoDB, DocumentDB Scalable store for JSON documents Persistent store for Node.js application Graph databases Neo4J Fast access to data organized into graphs Social graph

32 Big Data Analytics Some members of the Hadoop technology family Hadoop 2.0 adds YARN, supporting frameworks other than MapReduce Hadoop Distributed File System (HDFS) Hadoop MapReduce Hive/Pig HBase Allows storing and accessing very large binary files across a cluster of commodity servers and disk drives Supports applications that process large amounts of analytical data in parallel Data is typically stored in HDFS Tools for querying, transforming, and analyzing data Both generate MapReduce jobs Column family store built on HDFS Designed for operational data, not analytical data

33 Big Data Analytics Example: A Hadoop cluster on Microsoft Azure Virtual Machines Provides HiveQL, a SQLlike query language Excel Microsoft allows submitting HiveQL queries from Excel Hive Pig... Hadoop MapReduce Job Hadoop Distributed File System (HDFS) Logic Logic Logic Data Data Data

34 Big Data Analytics Example: HDInsight Using HDInsight will typically make more sense than building your own Hadoop cluster on Microsoft Azure Excel Hive Pig... Hadoop MapReduce Job HDFS API VM VM VM Logic Logic Logic Data Data Data Microsoft Azure Blobs

35 Conclusion i Open source technologies are a fundamental part of Microsoft Azure Microsoft is serious about open source on Microsoft Azure Compute: Support for many open source languages, frameworks, and applications Data: The ability to use relational and NoSQL technologies Not even Microsoft can ignore the open source world

36 About the Speaker David Chappell is Principal of Chappell & Associates (www.davidchappell.com) in San Francisco, California. Through his speaking, writing, and consulting, he helps people around the world understand, use, and make better decisions about new technology. David has been the keynote speaker for more than a hundred events and conferences on five continents, and his seminars have been attended by tens of thousands of business and IT leaders, architects, and developers in forty-five countries. His books have been published in a dozen languages and used regularly in courses at MIT, ETH Zurich, and other universities. In his consulting practice, he has helped clients such as Hewlett-Packard, IBM, Microsoft, Stanford University, and Target Corporation adopt new technologies, market new products, and educate their customers and staff. Earlier in his career, David wrote networking software, chaired a U.S. national standards working group, and played keyboards with the Peabody-award-winning Children s Radio Theater. He holds a B.S. in Economics and an M.S. in Computer Science, both from the University of Wisconsin-Madison.

37 Copyright 2014 Chappell & Associates

Open Source Technologies on Microsoft Azure

Open Source Technologies on Microsoft Azure Open Source Technologies on Microsoft Azure A Survey @DChappellAssoc Copyright 2014 Chappell & Associates The Main Idea i Open source technologies are a fundamental part of Microsoft Azure The Big Questions

More information

Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor. Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert

Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor. Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert Microsoft Azure: Opção de Nuvem para Todo o Desenvolvedor Danilo Bordini & Osvaldo Daibert Microsoft Brasil @dbordini @daibert Open Source on Microsoft Azure Two categories Compute Data IaaS, PaaS, and

More information

Cloud Platforms in the Enterprise

Cloud Platforms in the Enterprise Cloud Platforms in the Enterprise A Guide for IT Leaders @DChappellAssoc Copyright 2014 Chappell & Associates The Three Most Important IT Events In the last decade Initial pubic offering of Salesforce.com,

More information

Understanding NoSQL Technologies on Windows Azure

Understanding NoSQL Technologies on Windows Azure David Chappell Understanding NoSQL Technologies on Windows Azure Sponsored by Microsoft Corporation Copyright 2013 Chappell & Associates Contents Data on Windows Azure: The Big Picture... 3 Windows Azure

More information

Azure and Its Competitors

Azure and Its Competitors Azure and Its Competitors The Big Picture @DChappellAssoc Copyright 2014 Chappell & Associates The Three Most Important IT Events In the last decade Salesforce.com IPO, 2004 Showed that Software as a Service

More information

Platforms in the Cloud

Platforms in the Cloud Platforms in the Cloud Where Will Your Next Application Run? Jazoon, Zurich June 2011 Copyright 2011 Chappell & Associates An Organization without Cloud Computing Users A A A VM VM VM A A A Application

More information

Cloud Computing Today

Cloud Computing Today Cloud Computing Today What You Need to Know Now Copyright 2013 Chappell & ssociates n Organization without Cloud Computing Users Compute/Storage/Network pplication On-Premises Data Center Virtual Machine

More information

Understanding NoSQL on Microsoft Azure

Understanding NoSQL on Microsoft Azure David Chappell Understanding NoSQL on Microsoft Azure Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Data on Azure: The Big Picture... 3 Relational Technology: A Quick

More information

WINDOWS AZURE EXECUTION MODELS

WINDOWS AZURE EXECUTION MODELS WINDOWS AZURE EXECUTION MODELS Windows Azure provides three different execution models for running applications: Virtual Machines, Web Sites, and Cloud Services. Each one provides a different set of services,

More information

Microsoft Azure Data Technologies: An Overview

Microsoft Azure Data Technologies: An Overview David Chappell Microsoft Azure Data Technologies: An Overview Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Blobs... 3 Running a DBMS in a Virtual Machine... 4 SQL Database...

More information

Architecting Open source solutions on Azure. Nicholas Dritsas Senior Director, Microsoft Singapore

Architecting Open source solutions on Azure. Nicholas Dritsas Senior Director, Microsoft Singapore Learn. Connect. Explore. Architecting Open source solutions on Azure Nicholas Dritsas Senior Director, Microsoft Singapore Agenda Developing OSS Apps on Azure Customer case with OSS Apps Hadoop on Azure

More information

WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS

WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS WINDOWS AZURE DATA MANAGEMENT AND BUSINESS ANALYTICS Managing and analyzing data in the cloud is just as important as it is anywhere else. To let you do this, Windows Azure provides a range of technologies

More information

Systems Integrators in the Cloud Era

Systems Integrators in the Cloud Era Systems Integrators in the Cloud Era Embracing the Future @DChappellAssoc Copyright 2014 Chappell & Associates SIs in the Cloud Era The SI world is changing The cloud brings new opportunities and new threats

More information

Cloud Platforms Today: The Big Picture

Cloud Platforms Today: The Big Picture Cloud Platforms Today: The Big Picture David Chappell Chappell & Associates www.davidchappell.com Mobile Workforce Big Data Cloud Computing Social Enterprise Privacy and Security The traditional world

More information

WINDOWS AZURE DATA MANAGEMENT

WINDOWS AZURE DATA MANAGEMENT David Chappell October 2012 WINDOWS AZURE DATA MANAGEMENT CHOOSING THE RIGHT TECHNOLOGY Sponsored by Microsoft Corporation Copyright 2012 Chappell & Associates Contents Windows Azure Data Management: A

More information

OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM

OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM David Chappell OPERATIONAL SCENARIOS USING THE MICROSOFT DATA PLATFORM A GUIDE FOR IT LEADERS Sponsored by Microsoft Corporation Copyright 2016 Chappell & Associates Contents Microsoft s Data Platform:

More information

Standards and Open Source: Trends Affecting Microsoft and You. October 9, 2014 8:00 am 8:50 am

Standards and Open Source: Trends Affecting Microsoft and You. October 9, 2014 8:00 am 8:50 am Standards and Open Source: Trends Affecting Microsoft and You October 9, 2014 8:00 am 8:50 am Moderator David Ezell Principal Software Architect VeriFone Inc. Speaker Brian Benz Senior Technical Evangelist

More information

David Chappell. Data in a PaaS World. A Guide for New Applications. Sponsored by Microsoft Corporation. Copyright 2016 Chappell & Associates

David Chappell. Data in a PaaS World. A Guide for New Applications. Sponsored by Microsoft Corporation. Copyright 2016 Chappell & Associates David Chappell Data in a PaaS World A Guide for New Applications Sponsored by Microsoft Corporation Copyright 2016 Chappell & Associates Contents The Rise of PaaS Data Services... 3 The Value of PaaS for

More information

Assignment # 1 (Cloud Computing Security)

Assignment # 1 (Cloud Computing Security) Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual

More information

INTRODUCING WINDOWS AZURE

INTRODUCING WINDOWS AZURE INTRODUCING WINDOWS AZURE Windows Azure is Microsoft s application platform for the public cloud. You can use this platform in many different ways. For instance, you can use Windows Azure to build a web

More information

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1

Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1 Why NoSQL? Your database options in the new non- relational world 2015 IBM Cloudant 1 Table of Contents New types of apps are generating new types of data... 3 A brief history on NoSQL... 3 NoSQL s roots

More information

Azure Data Lake Analytics

Azure Data Lake Analytics Azure Data Lake Analytics Compose and orchestrate data services at scale Fully managed service to support orchestration of data movement and processing Connect to relational or non-relational data

More information

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world

Analytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world Analytics March 2015 White paper Why NoSQL? Your database options in the new non-relational world 2 Why NoSQL? Contents 2 New types of apps are generating new types of data 2 A brief history of NoSQL 3

More information

Microsoft Research Windows Azure for Research Training

Microsoft Research Windows Azure for Research Training Copyright 2013 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid

Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid Introduction to the Cloud OS Windows Azure Overview Visual Studio Tooling for Windows Azure Scenarios: Dev/Test Web Mobile Hybrid Development Management Identity Data Virtualization All services

More information

Microsoft Research Microsoft Azure for Research Training

Microsoft Research Microsoft Azure for Research Training Copyright 2014 Microsoft Corporation. All rights reserved. Except where otherwise noted, these materials are licensed under the terms of the Apache License, Version 2.0. You may use it according to the

More information

Implement Hadoop jobs to extract business value from large and varied data sets

Implement Hadoop jobs to extract business value from large and varied data sets Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to

More information

APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS

APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS This article looks into the benefits of using the Platform as a Service paradigm to develop applications on the cloud. It also compares a few top PaaS providers

More information

Big Data and Data Science: Behind the Buzz Words

Big Data and Data Science: Behind the Buzz Words Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing

More information

ADOPTING MICROSOFT AZURE

ADOPTING MICROSOFT AZURE David Chappell ADOPTING MICROSOFT AZURE A GUIDE FOR IT LEADERS Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Public Cloud Platforms: The Future of Enterprise Computing...

More information

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required.

You should have a working knowledge of the Microsoft Windows platform. A basic knowledge of programming is helpful but not required. What is this course about? This course is an overview of Big Data tools and technologies. It establishes a strong working knowledge of the concepts, techniques, and products associated with Big Data. Attendees

More information

Cloud Scale Distributed Data Storage. Jürmo Mehine

Cloud Scale Distributed Data Storage. Jürmo Mehine Cloud Scale Distributed Data Storage Jürmo Mehine 2014 Outline Background Relational model Database scaling Keys, values and aggregates The NoSQL landscape Non-relational data models Key-value Document-oriented

More information

Preparing Your Data For Cloud

Preparing Your Data For Cloud Preparing Your Data For Cloud Narinder Kumar Inphina Technologies 1 Agenda Relational DBMS's : Pros & Cons Non-Relational DBMS's : Pros & Cons Types of Non-Relational DBMS's Current Market State Applicability

More information

Bringing Big Data to People

Bringing Big Data to People Bringing Big Data to People Microsoft s modern data platform SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform Everyone should have access to the data they need. Process

More information

Can the Elephants Handle the NoSQL Onslaught?

Can the Elephants Handle the NoSQL Onslaught? Can the Elephants Handle the NoSQL Onslaught? Avrilia Floratou, Nikhil Teletia David J. DeWitt, Jignesh M. Patel, Donghui Zhang University of Wisconsin-Madison Microsoft Jim Gray Systems Lab Presented

More information

Windows Azure Architecture I think, therefore I am

Windows Azure Architecture I think, therefore I am Windows Azure Architecture I think, therefore I am Fernando Machado Píriz Enterprise Architect, Microsoft @netconfuy @fmachadopiriz Greater than >57% >250k 1,000,000 Fortune 500 using Azure Active websites

More information

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Apps and data source extensions with APIs Future white label, embed or integrate Power BI Deploy Intelligent

More information

INTRODUCTIONS. Storm Technology. David Chappell. The Cloud A Rational Perspective. Logistics. Who we are and what we do

INTRODUCTIONS. Storm Technology. David Chappell. The Cloud A Rational Perspective. Logistics. Who we are and what we do INTRODUCTIONS Storm Technology Who we are and what we do David Chappell IT strategist and international advisor The Cloud A Rational Perspective The cloud platforms An objective overview of the Windows

More information

Developing Microsoft Azure Solutions

Developing Microsoft Azure Solutions Course 20532A: Developing Microsoft Azure Solutions Page 1 of 7 Developing Microsoft Azure Solutions Course 20532A: 4 days; Instructor-Led Introduction This course is intended for students who have experience

More information

Step by Step: Big Data Technology. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015

Step by Step: Big Data Technology. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015 Step by Step: Big Data Technology Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015 Data Sources IT Infrastructure Analytics 2 B y 2015, 20% of Global 1000 organizations

More information

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com;

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Microsoft Big Data Solutions Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Why/What is Big Data and Why Microsoft? Options of storage and big data processing in Microsoft Azure. Real Impact of Big

More information

Cloud Computing and Big Data What Technical Writers Need to Know

Cloud Computing and Big Data What Technical Writers Need to Know Cloud Computing and Big Data What Technical Writers Need to Know Greg Olson, Senior Director Black Duck Software For the Society of Technical Writers Berkeley Chapter Black Duck 2014 Agenda Introduction

More information

Sentimental Analysis using Hadoop Phase 2: Week 2

Sentimental Analysis using Hadoop Phase 2: Week 2 Sentimental Analysis using Hadoop Phase 2: Week 2 MARKET / INDUSTRY, FUTURE SCOPE BY ANKUR UPRIT The key value type basically, uses a hash table in which there exists a unique key and a pointer to a particular

More information

WINDOWS AZURE NETWORKING

WINDOWS AZURE NETWORKING WINDOWS AZURE NETWORKING The easiest way to connect to Windows Azure applications and data is through an ordinary Internet connection. But this simple solution isn t always the best approach. Windows Azure

More information

Web 2.0 Technology Overview. Lecture 8 GSL Peru 2014

Web 2.0 Technology Overview. Lecture 8 GSL Peru 2014 Web 2.0 Technology Overview Lecture 8 GSL Peru 2014 Overview What is Web 2.0? Sites use technologies beyond static pages of earlier websites. Users interact and collaborate with one another Rich user experience

More information

INTRODUCTION & CONCEPTS. Definition of Cloud Computing Service Models Deployment Models... 23

INTRODUCTION & CONCEPTS. Definition of Cloud Computing Service Models Deployment Models... 23 Contents I INTRODUCTION & CONCEPTS 17 1 Introduction to Cloud Computing 19 11 Introduction 111 Definition of Cloud Computing 20 12 Characteristics of Cloud Computing 20 13 Cloud Models 22 131 132 Service

More information

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect IT Insight podcast This podcast belongs to the IT Insight series You can subscribe to the podcast through

More information

Microsoft Azure for IT Professionals 55065A; 3 days

Microsoft Azure for IT Professionals 55065A; 3 days Lincoln Land Community College Capital City Training Center 130 West Mason Springfield, IL 62702 217-782-7436 www.llcc.edu/cctc Microsoft Azure for IT Professionals 55065A; 3 days Course Description This

More information

Developing Microsoft Azure Solutions 20532A; 5 days

Developing Microsoft Azure Solutions 20532A; 5 days Lincoln Land Community College Capital City Training Center 130 West Mason Springfield, IL 62702 217-782-7436 www.llcc.edu/cctc Developing Microsoft Azure Solutions 20532A; 5 days Course Description This

More information

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012) 1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.

More information

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture 8 Cloud Programming & Software Environments Part 1 of 2 Spring 2013 A Specialty Course for Purdue University s M.S. in Technology

More information

Linux A first-class citizen in Windows Azure. Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise

Linux A first-class citizen in Windows Azure. Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise Linux A first-class citizen in Windows Azure Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise 1 First, I am software developer (C/C++, ASM, C#, Java, Node.js,

More information

ESS event: Big Data in Official Statistics. Antonino Virgillito, Istat

ESS event: Big Data in Official Statistics. Antonino Virgillito, Istat ESS event: Big Data in Official Statistics Antonino Virgillito, Istat v erbi v is 1 About me Head of Unit Web and BI Technologies, IT Directorate of Istat Project manager and technical coordinator of Web

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

GigaSpaces Real-Time Analytics for Big Data

GigaSpaces Real-Time Analytics for Big Data GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and

More information

Big Data Technologies Compared June 2014

Big Data Technologies Compared June 2014 Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development

More information

Cloud Powered Mobile Apps with Azure

Cloud Powered Mobile Apps with Azure Cloud Powered Mobile Apps with Azure Malte Lantin Technical Evanglist Microsoft Azure Agenda Mobile Services Features and Demos Advanced Features Scaling and Pricing 2 What is Mobile Services? Storage

More information

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com

CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com ` CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS Review Business and Technology Series www.cumulux.com Table of Contents Cloud Computing Model...2 Impact on IT Management and

More information

Sparking your Knowledge with Azure Spark

Sparking your Knowledge with Azure Spark Sparking your Knowledge with Azure Spark Data Platform Airlift 21 de Outubro \\ Microsoft Lisbon Experience Industry validation "Microsoft s comprehensive hybrid story, which spans applications and platforms

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

BUILDING SAAS APPLICATIONS ON WINDOWS AZURE

BUILDING SAAS APPLICATIONS ON WINDOWS AZURE David Chappell BUILDING SAAS APPLICATIONS ON WINDOWS AZURE THINGS TO THINK ABOUT BEFORE YOU START Sponsored by Microsoft Corporation Copyright 2012 Chappell & Associates Contents Illustrating SaaP and

More information

Firebird meets NoSQL (Apache HBase) Case Study

Firebird meets NoSQL (Apache HBase) Case Study Firebird meets NoSQL (Apache HBase) Case Study Firebird Conference 2011 Luxembourg 25.11.2011 26.11.2011 Thomas Steinmaurer DI +43 7236 3343 896 thomas.steinmaurer@scch.at www.scch.at Michael Zwick DI

More information

Enterprise Operational SQL on Hadoop Trafodion Overview

Enterprise Operational SQL on Hadoop Trafodion Overview Enterprise Operational SQL on Hadoop Trafodion Overview Rohit Jain Distinguished & Chief Technologist Strategic & Emerging Technologies Enterprise Database Solutions Copyright 2012 Hewlett-Packard Development

More information

Course 20533: Implementing Microsoft Azure Infrastructure Solutions

Course 20533: Implementing Microsoft Azure Infrastructure Solutions Course 20533: Implementing Microsoft Azure Infrastructure Solutions Overview About this course This course is aimed at experienced IT Professionals who currently administer their on-premises infrastructure.

More information

Structured Data Storage

Structured Data Storage Structured Data Storage Xgen Congress Short Course 2010 Adam Kraut BioTeam Inc. Independent Consulting Shop: Vendor/technology agnostic Staffed by: Scientists forced to learn High Performance IT to conduct

More information

INTRODUCTION TO CASSANDRA

INTRODUCTION TO CASSANDRA INTRODUCTION TO CASSANDRA This ebook provides a high level overview of Cassandra and describes some of its key strengths and applications. WHAT IS CASSANDRA? Apache Cassandra is a high performance, open

More information

EIGHT. Opportunities for Enterprise Modernization

EIGHT. Opportunities for Enterprise Modernization EIGHT Opportunities for Enterprise Modernization Widely regarded as the default way to run enterprise applications in recent times, cloud solutions are increasingly gaining traction across all industries

More information

Where We Are. References. Cloud Computing. Levels of Service. Cloud Computing History. Introduction to Data Management CSE 344

Where We Are. References. Cloud Computing. Levels of Service. Cloud Computing History. Introduction to Data Management CSE 344 Where We Are Introduction to Data Management CSE 344 Lecture 25: DBMS-as-a-service and NoSQL We learned quite a bit about data management see course calendar Three topics left: DBMS-as-a-service and NoSQL

More information

PaaS - Platform as a Service Google App Engine

PaaS - Platform as a Service Google App Engine PaaS - Platform as a Service Google App Engine Pelle Jakovits 14 April, 2015, Tartu Outline Introduction to PaaS Google Cloud Google AppEngine DEMO - Creating applications Available Google Services Costs

More information

Hadoop vs Apache Spark

Hadoop vs Apache Spark Innovate, Integrate, Transform Hadoop vs Apache Spark www.altencalsoftlabs.com Introduction Any sufficiently advanced technology is indistinguishable from magic. said Arthur C. Clark. Big data technologies

More information

New Modeling Challenges: Big Data, Hadoop, Cloud

New Modeling Challenges: Big Data, Hadoop, Cloud New Modeling Challenges: Big Data, Hadoop, Cloud Karen López @datachick www.datamodel.com Karen Lopez Love Your Data InfoAdvisors.com @datachick Senior Project Manager & Architect 1 Disclosure I m a Data

More information

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013

Database Management System Choices. Introduction To Database Systems CSE 373 Spring 2013 Database Management System Choices Introduction To Database Systems CSE 373 Spring 2013 Outline Introduction PostgreSQL MySQL Microsoft SQL Server Choosing A DBMS NoSQL Introduction There a lot of options

More information

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia

Monitis Project Proposals for AUA. September 2014, Yerevan, Armenia Monitis Project Proposals for AUA September 2014, Yerevan, Armenia Distributed Log Collecting and Analysing Platform Project Specifications Category: Big Data and NoSQL Software Requirements: Apache Hadoop

More information

Windows Azure Data Services (basics) 55093A; 3 Days

Windows Azure Data Services (basics) 55093A; 3 Days Lincoln Land Community College Capital City Training Center 130 West Mason Springfield, IL 62702 217-782-7436 www.llcc.edu/cctc Windows Azure Data Services (basics) 55093A; 3 Days Course Description This

More information

Implementing Microsoft Azure Infrastructure Solutions

Implementing Microsoft Azure Infrastructure Solutions Course Code: M20533 Vendor: Microsoft Course Overview Duration: 5 RRP: 2,025 Implementing Microsoft Azure Infrastructure Solutions Overview This course is aimed at experienced IT Professionals who currently

More information

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.0.x

Supported Platforms. HP Vertica Analytic Database. Software Version: 7.0.x HP Vertica Analytic Database Software Version: 7.0.x Document Release Date: 5/7/2014 Legal Notices Warranty The only warranties for HP products and services are set forth in the express warranty statements

More information

Google Cloud Platform The basics

Google Cloud Platform The basics Google Cloud Platform The basics Who I am Alfredo Morresi ROLE Developer Relations Program Manager COUNTRY Italy PASSIONS Community, Development, Snowboarding, Tiramisu' Reach me alfredomorresi@google.com

More information

Integrating Big Data into the Computing Curricula

Integrating Big Data into the Computing Curricula Integrating Big Data into the Computing Curricula Yasin Silva, Suzanne Dietrich, Jason Reed, Lisa Tsosie Arizona State University http://www.public.asu.edu/~ynsilva/ibigdata/ 1 Overview Motivation Big

More information

Certified Cloud Computing Professional VS-1067

Certified Cloud Computing Professional VS-1067 Certified Cloud Computing Professional VS-1067 Certified Cloud Computing Professional Certification Code VS-1067 Vskills Cloud Computing Professional assesses the candidate for a company s cloud computing

More information

An Approach to Implement Map Reduce with NoSQL Databases

An Approach to Implement Map Reduce with NoSQL Databases www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 8 Aug 2015, Page No. 13635-13639 An Approach to Implement Map Reduce with NoSQL Databases Ashutosh

More information

WHAT IS AN APPLICATION PLATFORM?

WHAT IS AN APPLICATION PLATFORM? David Chappell December 2011 WHAT IS AN APPLICATION PLATFORM? Sponsored by Microsoft Corporation Copyright 2011 Chappell & Associates Just about every application today relies on other software: operating

More information

Microsoft Azure Fundamentals

Microsoft Azure Fundamentals Microsoft Azure Fundamentals 10979C - 2 Days - Instructor-led, Hands-on Introduction This course provides the underlying knowledge required by all individuals who will be evaluating Microsoft Azure, regardless

More information

The Inside Scoop on Hadoop

The Inside Scoop on Hadoop The Inside Scoop on Hadoop Orion Gebremedhin National Solutions Director BI & Big Data, Neudesic LLC. VTSP Microsoft Corp. Orion.Gebremedhin@Neudesic.COM B-orgebr@Microsoft.com @OrionGM The Inside Scoop

More information

Syllabus INFO-UB-3322. Design and Development of Web and Mobile Applications (Especially for Start Ups)

Syllabus INFO-UB-3322. Design and Development of Web and Mobile Applications (Especially for Start Ups) Syllabus INFO-UB-3322 Design and Development of Web and Mobile Applications (Especially for Start Ups) Fall 2014 Stern School of Business Norman White, KMEC 8-88 Email: nwhite@stern.nyu.edu Phone: 212-998

More information

Syllabus INFO-GB-3322. Design and Development of Web and Mobile Applications (Especially for Start Ups)

Syllabus INFO-GB-3322. Design and Development of Web and Mobile Applications (Especially for Start Ups) Syllabus INFO-GB-3322 Design and Development of Web and Mobile Applications (Especially for Start Ups) Spring 2015 Stern School of Business Norman White, KMEC 8-88 Email: nwhite@stern.nyu.edu Phone: 212-998

More information

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases

Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Comparison of the Frontier Distributed Database Caching System with NoSQL Databases Dave Dykstra dwd@fnal.gov Fermilab is operated by the Fermi Research Alliance, LLC under contract No. DE-AC02-07CH11359

More information

Big Data Course Highlights

Big Data Course Highlights Big Data Course Highlights The Big Data course will start with the basics of Linux which are required to get started with Big Data and then slowly progress from some of the basics of Hadoop/Big Data (like

More information

NoSQL and Hadoop Technologies On Oracle Cloud

NoSQL and Hadoop Technologies On Oracle Cloud NoSQL and Hadoop Technologies On Oracle Cloud Vatika Sharma 1, Meenu Dave 2 1 M.Tech. Scholar, Department of CSE, Jagan Nath University, Jaipur, India 2 Assistant Professor, Department of CSE, Jagan Nath

More information

MS 10978A Introduction to Azure for Developers

MS 10978A Introduction to Azure for Developers MS 10978A Introduction to Azure for Developers Description: Days: 5 Prerequisites: This course offers students the opportunity to learn about Microsoft Azure development by taking an existing ASP.NET MVC

More information

Exploring the options to deploy Microsoft SharePoint in the Cloud.

Exploring the options to deploy Microsoft SharePoint in the Cloud. Exploring the options to deploy Microsoft SharePoint in the Cloud. Carlos Camacho NWN Corporation Overview of Office 365 Overview of SharePoint Online Demo of SharePoint Online Admin Console Overview of

More information

A Brief Outline on Bigdata Hadoop

A Brief Outline on Bigdata Hadoop A Brief Outline on Bigdata Hadoop Twinkle Gupta 1, Shruti Dixit 2 RGPV, Department of Computer Science and Engineering, Acropolis Institute of Technology and Research, Indore, India Abstract- Bigdata is

More information

WHAT S NEW IN SAS 9.4

WHAT S NEW IN SAS 9.4 WHAT S NEW IN SAS 9.4 PLATFORM, HPA & SAS GRID COMPUTING MICHAEL GODDARD CHIEF ARCHITECT SAS INSTITUTE, NEW ZEALAND SAS 9.4 WHAT S NEW IN THE PLATFORM Platform update SAS Grid Computing update Hadoop support

More information

Applications for Big Data Analytics

Applications for Big Data Analytics Smarter Healthcare Applications for Big Data Analytics Multi-channel sales Finance Log Analysis Homeland Security Traffic Control Telecom Search Quality Manufacturing Trading Analytics Fraud and Risk Retail:

More information

Moving From Hadoop to Spark

Moving From Hadoop to Spark + Moving From Hadoop to Spark Sujee Maniyam Founder / Principal @ www.elephantscale.com sujee@elephantscale.com Bay Area ACM meetup (2015-02-23) + HI, Featured in Hadoop Weekly #109 + About Me : Sujee

More information

Platform Agnostic Mobile App Development

Platform Agnostic Mobile App Development Platform Agnostic Mobile App Development January 2016 A cooperative project between NTT DATA, Inc. and University of Texas Dallas Copyright 2012 NTT DATA Corporation Copyright 2012 NTT DATA Corporation

More information

Using Cloud Services for Test Environments A case study of the use of Amazon EC2

Using Cloud Services for Test Environments A case study of the use of Amazon EC2 Using Cloud Services for Test Environments A case study of the use of Amazon EC2 Lee Hawkins (Quality Architect) Quest Software, Melbourne Copyright 2010 Quest Software We are gathered here today to talk

More information

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview Programming Hadoop 5-day, instructor-led BD-106 MapReduce Overview The Client Server Processing Pattern Distributed Computing Challenges MapReduce Defined Google's MapReduce The Map Phase of MapReduce

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Yvonne@CS Course evaluation forgotten Please assign one volunteer

More information

Introduction to Big Data Training

Introduction to Big Data Training Introduction to Big Data Training The quickest way to be introduce with NOSQL/BIG DATA offerings Learn and experience Big Data Solutions including Hadoop HDFS, Map Reduce, NoSQL DBs: Document Based DB

More information

Implementing Microsoft Azure Infrastructure Solutions

Implementing Microsoft Azure Infrastructure Solutions Course 20533: Implementing Microsoft Azure Infrastructure Solutions Course details Course Outline Module 1: Introduction to Azure This module provides the students a high level introduction to Azure. Cloud

More information