HADOOP BIG DATA DEVELOPER TRAINING AGENDA

Size: px
Start display at page:

Download "HADOOP BIG DATA DEVELOPER TRAINING AGENDA"

Transcription

1 HADOOP BIG DATA DEVELOPER TRAINING AGENDA About the Course This course is the most advanced course available to Software professionals This has been suitably designed to help Big Data Developers and experts to undergo a lab bases training to implement Big Data on Hadoop ecosystem. It covers all major components of Big Data Ecosystem. In this course, for every concepts, participants will be made to do a live demo in virtual machine in their own laptops/systems. By Completing this course participants will Understand on Big Data is a combination of essential fundamentals, practical techniques, hands-on sessions on Hadoop and other technology in Big Data ecosystem, and case studies to cement all this together. Understand fundamentals of Big Data Know what Big Data and its ecosystem is all about Get an understanding on Big Data ecosystem Identify problem areas that can be tackled by Big Data ecosystems Effectively use and choose most appropriate Big Data tools in its ecosystem to solve Big Data problems Define and lead Big Data related projects in your organizations Topics Covered What is Big Data and Introduction Hadoop Introduction and Architecture MapReduce and HDFS Introduction, Basics and Advanced concepts Apache pig and pig - Latin Apache Hive setup, basic and advanced concepts. Introduction to NoSQL and HBase YARN Introduction Other trending technologies Duration 5 Days (Can be calibrated/customised on request) With 2 short break of 15 mins each and a 30 mins lunch break

2 Q&A session on the flow and during re-cap Note: Evaluation at the end of the day. Re-cap post each session Pre-Requisites Laptop/Desktop with 6GB ram and Internet connection Presentation ecosystem (Projector, ppt etc.). Practical sessions Infra requirements (will be shared) Aligned Certificates This course is aligned to Cloudera Certified Developer for Apache Hadoop (CCDH). Quiz, Demo, Ready reckoner will help you to get deep understand on concepts that would be tested over this certification. Post completing the course successfully, you will be prepared to take the certification exam. Ref : Deliverables PPT of the course (soft copy) Ready reckoner Guide Virtual machine to do the handson Industry specific use case Demo guide Other Modules offered which can be added / replaced HBase and Advanced Concepts Introduction to Storm and concepts Introduction to Apache Spark, Spark Streaming and its components Introduction to Sqoop Introduction to Flume

3 Detail Agenda Day 1 Day 3 Introduction to BigData? Why BigData? Introduction to SMAC Stack Introduction to Cloud Problem being faced in traditional system 3Vs of BigData Challenges in BigData Introduction to BigData Ecosystem Introduction to Hadoop Different Daemons/Components and its Purpose Roles and Responsibility of NN/SNN/DN Hadoop Installation in Cloud / VM Introduction to Pig Latin Different modes of execution Anatomy of Pig Execution Different Functions of Pig Using Grunt Shell Use of DESCRIBE / EXPLAIN / ILLUSTRATE User Defined Function Introduction to Hive Where and when to use Hive Types of Tables in Hive Hive Partition, Buckets HiveJoins and SubQuery MapSide Join, Reduce Side Join Day 2 Day 4 Typical Cluster Setup What and how with HDFS and Commands File Read and Write Introduction, What, How of MapReduce Architecture of MapReduce Different Data Types Eclipse Environment Setup Map and Reduce in Details with Code Writing custom Map and Reduce program Partitioners and Combiners Introduction to HBase Introduction to Cloudera & HDP YARN and Generation 2 Hadoop Administration and Configuration Advanced features of MapReduce - Counters, Cache Oozie and Functions MRUnit Day 5 Introduction to Spark Introduction to Elastic Map Reduce in AWS Real world use cases Introduction to Flume Future of Big Data Introduction to NoSQL o Key Value Pairs o Column Family Database o Document Database o Graph Database

4 About the course AMAZON WEB SERVCIES TRAINING (CLOUD) This course introduces AWS products, services, and common solutions with demos, knowledge checks, and hands-on lab activities. It provides learners with the basic fundamentals to become more proficient in AWS and empowers them to make informed decisions about IT solutions based on business requirements. It is designed to teach Solution Architects how to optimize the use of the AWS Cloud by understanding AWS services and how these services fit into a cloud solution. It also covers the best practices, cost optimization and lessons learned. By Completing this course participants will Recognize various terminology and concepts as they relate to the AWS platform Navigate the AWS Management Console / Services offered Understand the security measures AWS provides Recognize AWS Compute and Networking options and use Amazon Elastic Compute Cloud (EC2) and Amazon Elastic Block Storage (EBS) Differentiate AWS Storage options and create an Amazon S3 bucket Describe Managed Services and Database options Use Amazon Relational Database Service (RDS) to launch an application Identity and Access Management(IAM) and VPC Identify Deployment and Management options Topics Covered AWS Introduciton Elastic Compute Cloud (EC2) Elastic Block Storage (EBS) Simple Storage Service (S3) Auto Scaling and Load Balancer(ELB). Virtual Private Cloud (VPC) Relational Data Service (RDS) Cloud Formation Ops Works (Dev Ops) DynamoDB / Glacier

5 Cloud Front Identity and Access Management (IAM) Cloud Watch Elastic Bean Stack (EBS) Duration 4 Days (Can be calibrated on request) With 2 short break of 15 mins each and a 30 mins Lunch break Q&A session on the flow and during re-cap Note: Evaluation at the end of the day. Re-cap post each session Pre-Requisites Laptop/Desktop with Internet connection Presentation ecosystem (Projector, ppt etc.). Free account with AWS. (Credit card required to register) Aligned Certificates This course is aligned to AWS Certified Solution Architect - Associate. Quiz, Demo, Ready reckoner will help you to get deep understand on concepts that would be tested over this certification. After completing the course successfully, you will be in a position to take the certification confidently. Ref : Deliverables PPT of the course Ready reckoner Industry specific use case Demo guide Other Modules offered which can be added / replaced Elastic Map Reduce (EMR) Application Hosting and Deployment

6 Detail Agenda Day 1 Day 3 Introduction to cloud Computing o Definition and concept o Cloud computing and virtualization o Cloud service Models o Cloud Service Providers AWS Introduction o AWS history o AWS Service models o AWS Account creation and registration AWS Compute and Networking : EC2 o EC2 : Dashbord, Events Tags o EC2 : Instances, Spot request, Reserved and On-Demand Instances o EC2 Images : AMI and Bundle o EC2 EBS: Volume and Snapshot o EC2 Network and Security: Security groups, Elastic IPs, Load Balancer, Key pairs o EC2 : Create, Stop, Reboot and Terminate o Deployment of Web Server on EC2 o Connectivity of Windows and Linux instances from desktop o Common issues and errors faced o Case Study Virtual Private Cloud o Virtual private cloud concept o Deployment of EC2 in VPC o Connectivity to EC2 o Different types of VPC models o Network policies Cost Optimization principles o Economics o Simple Calculator o TCO Calculator o Cost Calculation Architecture and Best Practices o High available Architecture o Disaster Recovery Planning o Scalable Architecture o low cost Architecture with EC2, S3, etc., Day 2 Day 4 Amazon S3 (Simple Storage Service) o CRUD operation bucket o Connecting S3 through S3 Clients o Policies on S3 o Public and private objects Amazon RDS (MYSQL) o Start and Stop RDS o Connecting MSSQL using client o Backup of RDS o Performance optimization of RDS o Best practices Elastic Load balancing and Autoscaling o Elastic load balancing policies o Monitor HTTP Protocol o Types of Elastic Load balancing o Launch Configuration o Autoscaling Groups Security Other Services IAM o Users, Roles and Groups o Access Persmission o EC2 Roles Cloudwatch o Standard and Detail Monitoring o Alarms o Biling alerts CloudFront o Edge location Cloud Formation o Wordpress deployment Elastic BeanStack Elastic Mapreduce OpsWorks

7 ServiceNow Implementation Specialist (30 hours) Objectives Implementation Specialist training enhances existing skills by providing handson experience to enable attendees to successfully implement ServiceNow. This is a combination of both lecture and hands-on labs where attendees will learn about implementation and best practices followed. Prerequisites ServiceNow Administration Certified JavaScript knowledge preferred Day 1 Module 1: Engagement Methodology and Project Planning (3 hours) Objectives - Project Scope, Requirements definition, Strategy Introduction to Software Development Life Cycle (SDLC) Project management and Release cycle Continual Service Improvement activities, Dedicated and Multi-tenant ServiceNow instances Lab (1 hour) - Sample Case Study with SDLC process Module 2: Core System Setup (3 hours) Objectives Settings, LDAP & Web Services Company basic settings and configuration LDAP Integration and configuration Introduction to Web Services, SOAP & REST API Lab (1 hour) - LDAP setup and Create SOAP Web Service Day 2 Module 3: Security (3 hours) Objectives - Security Model, ACLs, Field Encryption, VPN Simple Security & Contextual Security Access Control Lists architecture and Field encryption basics VPN components and requirements Lab (1 hour) - Create ACLs for an entire application Module 4: Tuning and Performance (3 hours) Objectives - Cloud Infrastructure, Disaster Recovery and Performance Tuning Cloud Infrastructure model used by ServiceNow High Availability features and Disaster Recovery process

8 Diagnostic tools & Performance tuning best practices Lab (1 hour) - Sample Best practices for Performance tuning Day 3 Module 5: Configuration - Server (6 hours) Objectives - Forms, Views, Lists, Server side scripting I Server side Glide Classes Overview GlideRecord, GlideElement, GlideSystem, GlideAggregate, GlideDateTime Business Rules, Script Includes Lab (3 hours) - Create Business Rule, Create Script Include Day 4 Module 5: Configuration - Server (3 hours) Objectives - Server side scripting II, Best practices Scripting, Inbound Actions UI Actions, Scheduled Jobs Transform Scripts, Best practices Lab (1.5 hours) - Create Inbound Action, Create Import Set Module 5: Configuration - Client (3 hours) Objectives - Forms, Views, Lists, Client side scripting I Client side Glide Classes Overview GlideForm, GlideUser, GlideMenu Client Scripts, UI Policies Lab (1.5 hours) - Create new Client Script, Create UI Policy Day 5 Module 5: Configuration - Client (6 hours) Objectives - Client side scripting II, Best practices GlideAjax, GlideDialogWindow Catalog Client Scripts & Catalog UI Policies UI Actions, UI Context Menus UI Pages, UI Macros Jelly scripting, Best practices Lab (3 hours) - Create Dialog Window using UI Action

9 ServiceNow Scripting (24 hours) Objectives Scripting training in ServiceNow is to learn how to use the ServiceNow JavaScript API, take advantage of the extensibility of ServiceNow, and add new functionality or modify the baseline behavior of an instance. This class begins with client-side scripting and transitions to server-side scripting. Attendees write, test and debug scripts using real-world, relevant lab exercises Prerequisites ServiceNow Administration certified Basic JavaScript preferred Day 1 Module 1: Configuration - Client (6 hours) Objectives - Forms, Views, Lists, Client side scripting I Client side Glide Classes Overview GlideForm, GlideUser, GlideMenu, GlideList Client Scripts, UI Policies Lab (3 hours) - Create new Client Script, Create UI Policy Day 2 Module 1: Configuration - Client (6 hours) Objectives - Client side scripting II, Best practices GlideAjax, GlideDialogWindow Catalog Client Scripts & Catalog UI Policies UI Actions, UI Context Menus UI Pages, UI Macros Jelly scripting, Best practices Lab (3 hours) - Create Dialog Window using UI Action Day 3 Module 2: Configuration - Server (6 hours) Objectives - Forms, Views, Lists, Server side scripting I Server side Glide Classes Overview GlideRecord, GlideElement, GlideSystem, GlideAggregate, GlideDateTime Business Rules, Script Includes Lab (3 hours) - Create Business Rule, Create Script Include

10 Day 4 Module 2: Configuration - Server (6 hours) Objectives - Server side scripting II, Best practices Scripting, Inbound Actions UI Actions, Scheduled Jobs Transform Scripts, Best practices Lab (3 hours) - Create Inbound Action, Create Import Set

11 ServiceNow System Administration (24 hours) Objectives This course is designed for system administrators who are new to ServiceNow ecosystem. During this 4-day interactive training course attendees will implement various system administration functions in their own instance, learning to perform fundamental administration and configuration tasks. Prerequisites 3 to 6 months hands-on experience in ServiceNow recommended Basic knowledge in ITIL framework preferred Day 1 Module 1: Core Configuration, CMDB (3 hours) Objectives - Introduction, Architecture, UI, Forms, Applications, Modules, CMDB Introduction to ServiceNow & technologies used by ServiceNow User Interface components and navigation Personalize Forms, List & Create Applications, Modules Basic CMDB, Configuration Items (CI), Business Service Maps (BSM) Lab (1.5 hours) - Add Bookmark, Edit Self Service Filters, Create new Table Module 2: Homepages, Security Methodology (3 hours) Objectives - Homepages, Security, Plugins Create & Edit Homepages, Activate Plugins Contextual Security, High Security Plugin, Access Control Lists (ACLs) Lab (1.5 hours) - Refresh Homepages, Activate a Plugin and Create ACLs Day 2 Module 3: User Administration (2 hours) Objectives - Users, Groups, Delegates, Roles Create Users, Groups, Assignment Rules and Delegates Group membership, Types of Roles, Create Roles Lab (1 hour) - Create new Group, Create new Role, Grant Roles and Set delegates Module 4: Service Administration (4 hours) Objectives - Service Level Management, Gauges, Reports, Notifications, Social IT SLA, OLA & Underpinning Contract, Basic Reports configuration Events, Properties, Notifications, templates ServiceNow Chat & Live feed social components Lab (2 hours) - Notifications, Create new SLA, Bar Chart for Open Incidents

12 Day 3 Module 5: Process Applications (3 hours) Objectives - Knowledge Base, Service Catalog, Order Guides Lifecycle of Knowledge Base, Search & View Articles Service Catalog Management, Create Variables, Variable Sets, Order guides Lab (1.5 hours) - Create & Publish Article, Create New Service Catalog Module 6: Record Producers, Workflows (3 hours) Objectives - Record Producer, Workflows Create Record Producers, Workflows, Workflow activities & administration Lab (1.5 hours) - Create new Workflow with 1 level of Approval Day 4 Module 7: Core Application Administration (3 hours) Objectives - Update Sets, System Upgrades Customization basics, Update Set concepts, Best practices Release Lifecycle concepts, System Upgrades Lab (1.5 hours) - Create, Complete, Retrieve, Preview and Commit Update Set Module 8: Manage Data with Import Sets (3 hours) Objectives - Import Sets, Transform Maps, Scheduled Jobs Data Import Sets, Transform Maps, Export & Import XML Scheduled Jobs, Scheduling Reports, Data Imports Lab (1.5 hours) - Transform Excel Sheet data, Schedule Reports weekly once

Workshop on Hadoop with Big Data

Workshop on Hadoop with Big Data Workshop on Hadoop with Big Data Hadoop? Apache Hadoop is an open source framework for distributed storage and processing of large sets of data on commodity hardware. Hadoop enables businesses to quickly

More information

HADOOP ADMINISTATION AND DEVELOPMENT TRAINING CURRICULUM

HADOOP ADMINISTATION AND DEVELOPMENT TRAINING CURRICULUM HADOOP ADMINISTATION AND DEVELOPMENT TRAINING CURRICULUM 1. Introduction 1.1 Big Data Introduction What is Big Data Data Analytics Bigdata Challenges Technologies supported by big data 1.2 Hadoop Introduction

More information

Big Data Course Highlights

Big Data Course Highlights Big Data Course Highlights The Big Data course will start with the basics of Linux which are required to get started with Big Data and then slowly progress from some of the basics of Hadoop/Big Data (like

More information

Peers Techno log ies Pv t. L td. HADOOP

Peers Techno log ies Pv t. L td. HADOOP Page 1 Peers Techno log ies Pv t. L td. Course Brochure Overview Hadoop is a Open Source from Apache, which provides reliable storage and faster process by using the Hadoop distibution file system and

More information

Qsoft Inc www.qsoft-inc.com

Qsoft Inc www.qsoft-inc.com Big Data & Hadoop Qsoft Inc www.qsoft-inc.com Course Topics 1 2 3 4 5 6 Week 1: Introduction to Big Data, Hadoop Architecture and HDFS Week 2: Setting up Hadoop Cluster Week 3: MapReduce Part 1 Week 4:

More information

BIG DATA HADOOP TRAINING

BIG DATA HADOOP TRAINING BIG DATA HADOOP TRAINING DURATION 40hrs AVAILABLE BATCHES WEEKDAYS (7.00AM TO 8.30AM) & WEEKENDS (10AM TO 1PM) MODE OF TRAINING AVAILABLE ONLINE INSTRUCTOR LED CLASSROOM TRAINING (MARATHAHALLI, BANGALORE)

More information

BIG DATA - HADOOP PROFESSIONAL amron

BIG DATA - HADOOP PROFESSIONAL amron 0 Training Details Course Duration: 30-35 hours training + assignments + actual project based case studies Training Materials: All attendees will receive: Assignment after each module, video recording

More information

www.boost ur skills.com

www.boost ur skills.com www.boost ur skills.com AWS CLOUD COMPUTING WORKSHOP Write us at training@boosturskills.com BOOSTURSKILLS No 1736 1st Amrutha College Road Kasavanhalli,Off Sarjapur Road,Bangalore-35 1) Introduction &

More information

Hadoop & Spark Using Amazon EMR

Hadoop & Spark Using Amazon EMR Hadoop & Spark Using Amazon EMR Michael Hanisch, AWS Solutions Architecture 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda Why did we build Amazon EMR? What is Amazon EMR?

More information

TRAINING PROGRAM ON BIGDATA/HADOOP

TRAINING PROGRAM ON BIGDATA/HADOOP Course: Training on Bigdata/Hadoop with Hands-on Course Duration / Dates / Time: 4 Days / 24th - 27th June 2015 / 9:30-17:30 Hrs Venue: Eagle Photonics Pvt Ltd First Floor, Plot No 31, Sector 19C, Vashi,

More information

Implement Hadoop jobs to extract business value from large and varied data sets

Implement Hadoop jobs to extract business value from large and varied data sets Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to

More information

Introduction to Big data. Why Big data? Case Studies. Introduction to Hadoop. Understanding Features of Hadoop. Hadoop Architecture.

Introduction to Big data. Why Big data? Case Studies. Introduction to Hadoop. Understanding Features of Hadoop. Hadoop Architecture. Big Data Hadoop Administration and Developer Course This course is designed to understand and implement the concepts of Big data and Hadoop. This will cover right from setting up Hadoop environment in

More information

Introduction to Big Data Training

Introduction to Big Data Training Introduction to Big Data Training The quickest way to be introduce with NOSQL/BIG DATA offerings Learn and experience Big Data Solutions including Hadoop HDFS, Map Reduce, NoSQL DBs: Document Based DB

More information

Hadoop Job Oriented Training Agenda

Hadoop Job Oriented Training Agenda 1 Hadoop Job Oriented Training Agenda Kapil CK hdpguru@gmail.com Module 1 M o d u l e 1 Understanding Hadoop This module covers an overview of big data, Hadoop, and the Hortonworks Data Platform. 1.1 Module

More information

COURSE CONTENT Big Data and Hadoop Training

COURSE CONTENT Big Data and Hadoop Training COURSE CONTENT Big Data and Hadoop Training 1. Meet Hadoop Data! Data Storage and Analysis Comparison with Other Systems RDBMS Grid Computing Volunteer Computing A Brief History of Hadoop Apache Hadoop

More information

ITG Software Engineering

ITG Software Engineering Introduction to Apache Hadoop Course ID: Page 1 Last Updated 12/15/2014 Introduction to Apache Hadoop Course Overview: This 5 day course introduces the student to the Hadoop architecture, file system,

More information

EEDC. Scalability Study of web apps in AWS. Execution Environments for Distributed Computing

EEDC. Scalability Study of web apps in AWS. Execution Environments for Distributed Computing EEDC Execution Environments for Distributed Computing 34330 Master in Computer Architecture, Networks and Systems - CANS Scalability Study of web apps in AWS Sergio Mendoza sergio.mendoza@est.fib.upc.edu

More information

19.10.11. Amazon Elastic Beanstalk

19.10.11. Amazon Elastic Beanstalk 19.10.11 Amazon Elastic Beanstalk A Short History of AWS Amazon started as an ECommerce startup Original architecture was restructured to be more scalable and easier to maintain Competitive pressure for

More information

ServiceNow Certified System Administrator. Examination Specifications

ServiceNow Certified System Administrator. Examination Specifications ServiceNow Certified System Administrator Examination Specifications Certified System Administrator Introduction This ServiceNow Certified System Administrator Exam Specification defines the purpose, audience,

More information

Complete Java Classes Hadoop Syllabus Contact No: 8888022204

Complete Java Classes Hadoop Syllabus Contact No: 8888022204 1) Introduction to BigData & Hadoop What is Big Data? Why all industries are talking about Big Data? What are the issues in Big Data? Storage What are the challenges for storing big data? Processing What

More information

ITG Software Engineering

ITG Software Engineering Introduction to Cloudera Course ID: Page 1 Last Updated 12/15/2014 Introduction to Cloudera Course : This 5 day course introduces the student to the Hadoop architecture, file system, and the Hadoop Ecosystem.

More information

Certified Big Data and Apache Hadoop Developer VS-1221

Certified Big Data and Apache Hadoop Developer VS-1221 Certified Big Data and Apache Hadoop Developer VS-1221 Certified Big Data and Apache Hadoop Developer Certification Code VS-1221 Vskills certification for Big Data and Apache Hadoop Developer Certification

More information

BIG DATA SERIES: HADOOP DEVELOPER TRAINING PROGRAM. An Overview

BIG DATA SERIES: HADOOP DEVELOPER TRAINING PROGRAM. An Overview BIG DATA SERIES: HADOOP DEVELOPER TRAINING PROGRAM An Overview Contents Contents... 1 BIG DATA SERIES: HADOOP DEVELOPER TRAINING PROGRAM... 1 Program Overview... 4 Curriculum... 5 Module 1: Big Data: Hadoop

More information

Introduction to AWS in Higher Ed

Introduction to AWS in Higher Ed Introduction to AWS in Higher Ed Lori Clithero loricli@amazon.com 206.227.5054 University of Washington Cloud Day 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 2 Cloud democratizes

More information

HADOOP. Revised 10/19/2015

HADOOP. Revised 10/19/2015 HADOOP Revised 10/19/2015 This Page Intentionally Left Blank Table of Contents Hortonworks HDP Developer: Java... 1 Hortonworks HDP Developer: Apache Pig and Hive... 2 Hortonworks HDP Developer: Windows...

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to CS secretaries Course evaluation forgotten Please assign one

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

Infomatics. Big-Data and Hadoop Developer Training with Oracle WDP

Infomatics. Big-Data and Hadoop Developer Training with Oracle WDP Big-Data and Hadoop Developer Training with Oracle WDP What is this course about? Big Data is a collection of large and complex data sets that cannot be processed using regular database management tools

More information

Upcoming Announcements

Upcoming Announcements Enterprise Hadoop Enterprise Hadoop Jeff Markham Technical Director, APAC jmarkham@hortonworks.com Page 1 Upcoming Announcements April 2 Hortonworks Platform 2.1 A continued focus on innovation within

More information

ServiceNow Certified Implementation Specialist Examination Specification

ServiceNow Certified Implementation Specialist Examination Specification ServiceNow Certified Implementation Specialist Examination Specification Introduction The ServiceNow Certified Implementation Specialist Exam Specification defines the purpose, audience, testing options,

More information

t] open source Hadoop Beginner's Guide ij$ data avalanche Garry Turkington Learn how to crunch big data to extract meaning from

t] open source Hadoop Beginner's Guide ij$ data avalanche Garry Turkington Learn how to crunch big data to extract meaning from Hadoop Beginner's Guide Learn how to crunch big data to extract meaning from data avalanche Garry Turkington [ PUBLISHING t] open source I I community experience distilled ftu\ ij$ BIRMINGHAMMUMBAI ')

More information

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview

Programming Hadoop 5-day, instructor-led BD-106. MapReduce Overview. Hadoop Overview Programming Hadoop 5-day, instructor-led BD-106 MapReduce Overview The Client Server Processing Pattern Distributed Computing Challenges MapReduce Defined Google's MapReduce The Map Phase of MapReduce

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Using ArcGIS for Server in the Amazon Cloud Randall Williams, Esri Subrat Bora, Esri Esri UC 2014 Technical Workshop Agenda What is ArcGIS for Server on Amazon Web Services Sounds good! How much does it

More information

Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments

Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments Important Notice 2010-2015 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, Cloudera Impala, Impala, and

More information

Razvoj Java aplikacija u Amazon AWS Cloud: Praktična demonstracija

Razvoj Java aplikacija u Amazon AWS Cloud: Praktična demonstracija Razvoj Java aplikacija u Amazon AWS Cloud: Praktična demonstracija Robert Dukarić University of Ljubljana Faculty of Computer and Information Science Laboratory for information systems integration Competence

More information

Savanna Hadoop on. OpenStack. Savanna Technical Lead

Savanna Hadoop on. OpenStack. Savanna Technical Lead Savanna Hadoop on OpenStack Sergey Lukjanov Savanna Technical Lead Mirantis, 2013 Agenda Savanna Overview Savanna Use Cases Roadmap & Current Status Architecture & Features Overview Hadoop vs. Virtualization

More information

Alfresco Enterprise on AWS: Reference Architecture

Alfresco Enterprise on AWS: Reference Architecture Alfresco Enterprise on AWS: Reference Architecture October 2013 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 13 Abstract Amazon Web Services (AWS)

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to CS secretaries Cloud computing introduction General concepts

More information

TECHNOLOGY WHITE PAPER Jan 2016

TECHNOLOGY WHITE PAPER Jan 2016 TECHNOLOGY WHITE PAPER Jan 2016 Technology Stack C# PHP Amazon Web Services (AWS) Route 53 Elastic Load Balancing (ELB) Elastic Compute Cloud (EC2) Amazon RDS Amazon S3 Elasticache CloudWatch Paypal Overview

More information

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect on AWS Services Overview Bernie Nallamotu Principle Solutions Architect \ So what is it? When your data sets become so large that you have to start innovating around how to collect, store, organize, analyze

More information

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview Opsview in the Cloud Monitoring with Amazon Web Services Opsview Technical Overview Page 2 Opsview In The Cloud: Monitoring with Amazon Web Services Contents Opsview in The Cloud... 3 Considerations...

More information

Every Silver Lining Has a Vault in the Cloud

Every Silver Lining Has a Vault in the Cloud Irvin Hayes Jr. Autodesk, Inc. PL6015-P Don t worry about acquiring hardware and additional personnel in order to manage your Vault software installation. Learn how to spin up a hosted server instance

More information

Background on Elastic Compute Cloud (EC2) AMI s to choose from including servers hosted on different Linux distros

Background on Elastic Compute Cloud (EC2) AMI s to choose from including servers hosted on different Linux distros David Moses January 2014 Paper on Cloud Computing I Background on Tools and Technologies in Amazon Web Services (AWS) In this paper I will highlight the technologies from the AWS cloud which enable you

More information

Amazon AWS in.net. Presented by: Scott Reed scottr@develop.com

Amazon AWS in.net. Presented by: Scott Reed scottr@develop.com Amazon AWS in.net Presented by: Scott Reed scottr@develop.com Objectives Cloud Computing What Amazon provides Why Amazon Web Services? Q&A Instances Interacting with Instances Management Console Command

More information

CLOUD COMPUTING WITH AWS An INTRODUCTION. John Hildebrandt Solutions Architect ANZ

CLOUD COMPUTING WITH AWS An INTRODUCTION. John Hildebrandt Solutions Architect ANZ CLOUD COMPUTING WITH AWS An INTRODUCTION John Hildebrandt Solutions Architect ANZ AGENDA Todays Agenda Background and Value proposition of AWS Global infrastructure and the Sydney Region AWS services Drupal

More information

HP SiteScope 11.x Essentials

HP SiteScope 11.x Essentials HP SiteScope 11.x Essentials Overview This course provides the technical knowledge and skills needed to manage and monitor an IT infrastructure with the help of the HP SiteScope product. Students gain

More information

Amazon Web Services. Lawrence Berkeley LabTech Conference 9/10/15. Jamie Baker Federal Scientific Account Manager AWS WWPS bakjames@amazon.

Amazon Web Services. Lawrence Berkeley LabTech Conference 9/10/15. Jamie Baker Federal Scientific Account Manager AWS WWPS bakjames@amazon. Web Services Lawrence Berkeley LabTech Conference 9/10/15 Jamie Baker Federal Scientific Account Manager AWS WWPS bakjames@amazon.com 2015, Web Services, Inc. or its Affiliates. All rights reserved. AWS

More information

Professional Hadoop Solutions

Professional Hadoop Solutions Brochure More information from http://www.researchandmarkets.com/reports/2542488/ Professional Hadoop Solutions Description: The go-to guidebook for deploying Big Data solutions with Hadoop Today's enterprise

More information

TECHNOLOGY WHITE PAPER Jun 2012

TECHNOLOGY WHITE PAPER Jun 2012 TECHNOLOGY WHITE PAPER Jun 2012 Technology Stack C# Windows Server 2008 PHP Amazon Web Services (AWS) Route 53 Elastic Load Balancing (ELB) Elastic Compute Cloud (EC2) Amazon RDS Amazon S3 Elasticache

More information

Data Security in Hadoop

Data Security in Hadoop Data Security in Hadoop Eric Mizell Director, Solution Engineering Page 1 What is Data Security? Data Security for Hadoop allows you to administer a singular policy for authentication of users, authorize

More information

Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments

Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments Important Notice 2010-2016 Cloudera, Inc. All rights reserved. Cloudera, the Cloudera logo, Cloudera Impala, Impala, and

More information

Fault-Tolerant Computer System Design ECE 695/CS 590. Putting it All Together

Fault-Tolerant Computer System Design ECE 695/CS 590. Putting it All Together Fault-Tolerant Computer System Design ECE 695/CS 590 Putting it All Together Saurabh Bagchi ECE/CS Purdue University ECE 695/CS 590 1 Outline Looking at some practical systems that integrate multiple techniques

More information

Introduction to Cloud Computing on Amazon Web Services (AWS) with focus on EC2 and S3. Horst Lueck

Introduction to Cloud Computing on Amazon Web Services (AWS) with focus on EC2 and S3. Horst Lueck Introduction to Cloud Computing on Amazon Web Services (AWS) with focus on EC2 and S3 Horst Lueck 2011-05-17 IT Pro Forum http://itproforum.org Thanks to Open Office Impress The Cloud the Name The 90s

More information

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com Cloud Computing with Amazon Web Services and the DevOps Methodology Who am I? Max Manders @maxmanders Systems Developer at Cloudreach @cloudreach Director / Co-Founder of Whisky Web @whiskyweb Who are

More information

Hadoop Development & BI- 0 to 100

Hadoop Development & BI- 0 to 100 Development Master the Data Analysis tools like Pig and hive Data Science Hadoop Development & BI- 0 to 100 Build a recommendation engine Hadoop Development - 0 to 100 HADOOP SCHOOL OF TRAINING Basics

More information

DLT Solutions and Amazon Web Services

DLT Solutions and Amazon Web Services DLT Solutions and Amazon Web Services For a seamless, cost-effective migration to the cloud PREMIER CONSULTING PARTNER DLT Solutions 2411 Dulles Corner Park, Suite 800 Herndon, VA 20171 Duane Thorpe Phone:

More information

Training Catalog. Summer 2015 Training Catalog. Apache Hadoop Training from the Experts. Apache Hadoop Training From the Experts

Training Catalog. Summer 2015 Training Catalog. Apache Hadoop Training from the Experts. Apache Hadoop Training From the Experts Training Catalog Apache Hadoop Training from the Experts Summer 2015 Training Catalog Apache Hadoop Training From the Experts September 2015 provides an immersive and valuable real world experience In

More information

Pro Apache Hadoop. Second Edition. Sameer Wadkar. Madhu Siddalingaiah

Pro Apache Hadoop. Second Edition. Sameer Wadkar. Madhu Siddalingaiah Pro Apache Hadoop Second Edition Sameer Wadkar Madhu Siddalingaiah Contents J About the Authors About the Technical Reviewer Acknowledgments Introduction xix xxi xxiii xxv Chapter 1: Motivation for Big

More information

ENABLING GLOBAL HADOOP WITH EMC ELASTIC CLOUD STORAGE

ENABLING GLOBAL HADOOP WITH EMC ELASTIC CLOUD STORAGE ENABLING GLOBAL HADOOP WITH EMC ELASTIC CLOUD STORAGE Hadoop Storage-as-a-Service ABSTRACT This White Paper illustrates how EMC Elastic Cloud Storage (ECS ) can be used to streamline the Hadoop data analytics

More information

HEAnet Conference November 12 th 2015

HEAnet Conference November 12 th 2015 HEAnet Conference November 12 th 2015 Transforming Education in The Cloud Pat McCarthy (pat.mccarthy@cit.ie) Lecturer & Course Co-Ordinator Bsc in Cloud Computing Cork Institute of Technology Agenda History

More information

Data Analyst Program- 0 to 100

Data Analyst Program- 0 to 100 Development Data Analyst Program- 0 to 100 Master the Data Analysis tools like Pig and hive Data Science Build a recommendation engine 1 Data Analyst Program- 0 to 100 HADOOP SCHOOL OF TRAINING Basics

More information

Hadoop: The Definitive Guide

Hadoop: The Definitive Guide FOURTH EDITION Hadoop: The Definitive Guide Tom White Beijing Cambridge Famham Koln Sebastopol Tokyo O'REILLY Table of Contents Foreword Preface xvii xix Part I. Hadoop Fundamentals 1. Meet Hadoop 3 Data!

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Federal GIS Conference February 9 10, 2015 Washington, DC Using ArcGIS for Server in the Amazon Cloud Bonnie Stayer, Esri Amy Ramsdell, Blue Raster Session Outline AWS Overview ArcGIS in AWS Cloud Builder

More information

15-319 / 15-619 Cloud Computing. Recitation 5 September 29 th & October 1 st 2015

15-319 / 15-619 Cloud Computing. Recitation 5 September 29 th & October 1 st 2015 15-319 / 15-619 Cloud Computing Recitation 5 September 29 th & October 1 st 2015 1 Overview Administrative Stuff Last Week s Reflection Project 2.1, OLI Modules 5 & 6, Quiz 3 New concepts This week s schedule

More information

Scalable Application. Mikalai Alimenkou http://xpinjection.com 11.05.2012

Scalable Application. Mikalai Alimenkou http://xpinjection.com 11.05.2012 Scalable Application Development on AWS Mikalai Alimenkou http://xpinjection.com 11.05.2012 Background Java Technical Lead/Scrum Master at Zoral Labs 7+ years in software development 5+ years of working

More information

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013 Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache

More information

How To Use Aws.Com

How To Use Aws.Com Crypto-Options on AWS Bertram Dorn Specialized Solutions Architect Security/Compliance Network/Databases Amazon Web Services Germany GmbH Amazon.com, Inc. and its affiliates. All rights reserved. Agenda

More information

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES AWS GLOBAL INFRASTRUCTURE 10 Regions 25 Availability Zones 51 Edge locations WHAT

More information

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect AWS HISTORY About How didamazon Amazon Web Services! Deep experience in building and operating global

More information

ServiceNow Certified Application Developer. Examination Specifications

ServiceNow Certified Application Developer. Examination Specifications ServiceNow Certified Application Developer Examination Specifications Introduction This ServiceNow Certified Application Developer Exam Specification defines the purpose, audience, testing options, examination

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security For the Period April 1, 2013 March 31, 2014 Ernst & Young LLP Suite 1600 560 Mission Street San Francisco,

More information

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity P3 InfoTech Solutions Pvt. Ltd http://www.p3infotech.in July 2013 Created by P3 InfoTech Solutions Pvt. Ltd., http://p3infotech.in 1 Web Application Deployment in the Cloud Using Amazon Web Services From

More information

ArcGIS for Server: In the Cloud

ArcGIS for Server: In the Cloud DevSummit DC February 11, 2015 Washington, DC ArcGIS for Server: In the Cloud Bonnie Stayer, Esri Session Outline Cloud Overview - Benefits - Types of clouds ArcGIS in AWS - Cloud Builder - Maintenance

More information

AIST Data Symposium. Ed Lenta. Managing Director, ANZ Amazon Web Services

AIST Data Symposium. Ed Lenta. Managing Director, ANZ Amazon Web Services AIST Data Symposium Ed Lenta Managing Director, ANZ Amazon Web Services Why are companies adopting cloud computing and AWS so quickly? #1: Agility The primary reason businesses are moving so quickly to

More information

Amazon Web Services. 18.11.2015 Yu Xiao

Amazon Web Services. 18.11.2015 Yu Xiao Amazon Web Services 18.11.2015 Yu Xiao Agenda Introduction to Amazon Web Services(AWS) 7 Steps to Select the Right Architecture for Your Web Applications Private, Public or Hybrid Cloud? AWS Case Study

More information

Big Data Training - Hackveda

Big Data Training - Hackveda Big Data Training - Hackveda Become a Hackveda Certified Big Data Professional - (Beginner) Skill level: Beginner Training fee: INR 9000 only (Topics covered: 108) Chief Trainer: Mr. Devanshu Shukla Training

More information

Cloud Essentials for Architects using OpenStack

Cloud Essentials for Architects using OpenStack Cloud Essentials for Architects using OpenStack Course Overview Start Date 18th December 2014 Duration 2 Days Location Dublin Course Code SS906 Programme Overview Cloud Computing is gaining increasing

More information

IT Service Management with System Center Service Manager

IT Service Management with System Center Service Manager Course 10965B: IT Service Management with System Center Service Manager Course Details Course Outline Module 1: Service Management Overview Effective IT Service Management includes process driven methodologies

More information

BIG DATA & HADOOP DEVELOPER TRAINING & CERTIFICATION

BIG DATA & HADOOP DEVELOPER TRAINING & CERTIFICATION FACT SHEET BIG DATA & HADOOP DEVELOPER TRAINING & CERTIFICATION BIGDATA & HADOOP CLASS ROOM SESSION GreyCampus provides Classroom sessions for Big Data & Hadoop Developer Certification. This course will

More information

Cloud Computing For Bioinformatics

Cloud Computing For Bioinformatics Cloud Computing For Bioinformatics Cloud Computing: what is it? Cloud Computing is a distributed infrastructure where resources, software, and data are provided in an on-demand fashion. Cloud Computing

More information

Software AG and the AWS cloud. Past, Present and Best Practices. Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing

Software AG and the AWS cloud. Past, Present and Best Practices. Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing Software AG and the AWS cloud Past, Present and Best Practices Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing Agenda How Software AG Uses The cloud Software AG s

More information

Preparing Your IT for the Holidays. A quick start guide to take your e-commerce to the Cloud

Preparing Your IT for the Holidays. A quick start guide to take your e-commerce to the Cloud Preparing Your IT for the Holidays A quick start guide to take your e-commerce to the Cloud September 2011 Preparing your IT for the Holidays: Contents Introduction E-Commerce Landscape...2 Introduction

More information

Introduction to DevOps on AWS

Introduction to DevOps on AWS Introduction to DevOps on AWS David Chapman December 2014 Contents Contents Abstract Introduction Agile Evolution to DevOps Infrastructure as Code AWS CloudFormation AWS AMI Continuous Deployment AWS CodeDeploy

More information

319 MANAGED HOSTING TECHNICAL DETAILS

319 MANAGED HOSTING TECHNICAL DETAILS 319 MANAGED HOSTING TECHNICAL DETAILS 319 NetWorks www.319networks.com Table of Contents Architecture... 4 319 Platform... 5 319 Applications... 5 319 Network Stack... 5 319 Cloud Hosting Technical Details...

More information

Amazon Web Services Primer. William Strickland COP 6938 Fall 2012 University of Central Florida

Amazon Web Services Primer. William Strickland COP 6938 Fall 2012 University of Central Florida Amazon Web Services Primer William Strickland COP 6938 Fall 2012 University of Central Florida AWS Overview Amazon Web Services (AWS) is a collection of varying remote computing provided by Amazon.com.

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Yvonne@CS Course evaluation forgotten Please assign one volunteer

More information

How AWS Pricing Works May 2015

How AWS Pricing Works May 2015 How AWS Pricing Works May 2015 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction...

More information

Testing Tools using Visual Studio. Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation

Testing Tools using Visual Studio. Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation Plan REQUIREMENTS BACKLOG Monitor + Learn Development Collaboration Production Develop + Test Release

More information

One click Hadoop clusters - anywhere

One click Hadoop clusters - anywhere One click Hadoop clusters - anywhere Janos Matyas, Senior Director of Engineering October, Page 1 2015 Overview Page 2 Introduction Goals and motivations Technology stack How it works Results/achievements/future

More information

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher

Cloud Computing and Amazon Web Services. CJUG March, 2009 Tom Malaher Cloud Computing and Amazon Web Services CJUG March, 2009 Tom Malaher Agenda What is Cloud Computing? Amazon Web Services (AWS) Other Offerings Composing AWS Services Use Cases Ecosystem Reality Check Pros&Cons

More information

Understanding ArcGIS Deployments in Public and Private Cloud. Marwa Mabrouk

Understanding ArcGIS Deployments in Public and Private Cloud. Marwa Mabrouk Understanding ArcGIS Deployments in Public and Private Cloud Marwa Mabrouk Agenda Back to Basics What are people doing? New Features Using ArcGIS in the Cloud - Private Cloud - Public Cloud Technical Demos

More information

Financial Services Grid Computing on Amazon Web Services January 2013 Ian Meyers

Financial Services Grid Computing on Amazon Web Services January 2013 Ian Meyers Financial Services Grid Computing on Amazon Web Services January 2013 Ian Meyers (Please consult http://aws.amazon.com/whitepapers for the latest version of this paper) Page 1 of 15 Contents Abstract...

More information

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012) 1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security and Availability For the Period April 1, 2015 September 30, 2015 Ernst & Young LLP Suite 1600 560 Mission

More information

Using Amazon EMR and Hunk to explore, analyze and visualize machine data

Using Amazon EMR and Hunk to explore, analyze and visualize machine data Using Amazon EMR and Hunk to explore, analyze and visualize machine data Machine data can take many forms and comes from a variety of sources; system logs, application logs, service and system metrics,

More information

Chapter 9 PUBLIC CLOUD LABORATORY. Sucha Smanchat, PhD. Faculty of Information Technology. King Mongkut s University of Technology North Bangkok

Chapter 9 PUBLIC CLOUD LABORATORY. Sucha Smanchat, PhD. Faculty of Information Technology. King Mongkut s University of Technology North Bangkok CLOUD COMPUTING PRACTICE 82 Chapter 9 PUBLIC CLOUD LABORATORY Hand on laboratory based on AWS Sucha Smanchat, PhD Faculty of Information Technology King Mongkut s University of Technology North Bangkok

More information