Software Defined System for Disaster Management and Environmental Monitoring. Hiroaki Yamanaka (NICT)



Similar documents
Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control

Evolving to a Software Defined Carrier Network. Shunichiro Tejima

Resilient network architecture based on Movable and Deployable Resource Unit (MDRU)

Copyright NTT Communications Corporation. All rights reserved.

CERTIFICATE PROGRAMME ON CLOUD SPECIALISTS DEVELOPMENT

SDN/OpenFlow Optical Network on JGN X

Smart City Australia

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

Collaborating for Wireless Growth:

RISE 3.0: The Design and Implementation of SDN/OpenFlow Testbed Considering Node Capacity and Inflexible Topology

How To Manage A Network From A Microsoft Lab

Addressing Open Source Big Data, Hadoop, and MapReduce limitations

Beyond Cloud: Implications for the Industrialization of IT and the 3rd Era of Computing. Jonathan

Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015

Big Data and Industrial Internet

Pilot-Streaming: Design Considerations for a Stream Processing Framework for High- Performance Computing

SDN Security Challenges. Anita Nikolich National Science Foundation Program Director, Advanced Cyberinfrastructure July 2015

Transport SDN - Clearing the Roadblocks to Wide-scale Commercial

TRAINING PROGRAM ON BIGDATA/HADOOP

Big Data Analytics. with EMC Greenplum and Hadoop. Big Data Analytics. Ofir Manor Pre Sales Technical Architect EMC Greenplum

Software-Defined Networks Powered by VellOS

Plug-and-play Virtual Appliance Clusters Running Hadoop. Dr. Renato Figueiredo ACIS Lab - University of Florida

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies

3rd International Symposium on Big Data and Cloud Computing Challenges (ISBCC-2016) March 10-11, 2016 VIT University, Chennai, India

Overview of OOO(O three) Open Innovation over Network Platform

Big Trends in Computing Research Over the Next Decade

Open Cirrus: Towards an Open Source Cloud Stack

IT VIRTUALIZATION FOR DISASTER MITIGATION AND RECOVERY

Creating The World s First Open Programmable Dimitra Simeonidou & Anna Tzanakaki

APAN perspective on multi- platform data integration

Accelerating Enterprise Big Data Success. Tim Stevens, VP of Business and Corporate Development Cloudera

Ontology, NFV and the Future OSS September 2015

BIG DATA TRENDS AND TECHNOLOGIES

The Network Meets the Cloud

The Internet of Things starts with intelligence inside

HDP Hadoop From concept to deployment.

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013

ViSION Status Update. Dan Savu Stefan Stancu. D. Savu - CERN openlab

Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems

Real Time Big Data Processing

PNNL Institutional Research Cloud Pilot WENDY COWLEY PNNL

Inter cloud computing: Use cases and requirements lessons learned 3.11

Software Defined Cloud Security Architectures

EO Data by using SAP HANA Spatial Hinnerk Gildhoff, Head of HANA Spatial, SAP Satellite Masters Conference 21 th October 2015 Public

Hitachi Open Middleware for Big Data Processing

Big Data: Overview and Roadmap eglobaltech. All rights reserved.

Wireless Sensor Networks (WSN) for Distributed Solar Energy in Smart Grids

Big Data Storage Challenges for the Industrial Internet of Things

China Bank BigData Usecase Huawei FusionInsight Solution

SAVI/GENI Federation. Research Progress. Sushil Bhojwani, Andreas Bergen, Hausi A. Müller, Sudhakar Ganti University of Victoria.

1 st Symposium on Colossal Data and Networking (CDAN-2016) March 18-19, 2016 Medicaps Group of Institutions, Indore, India

Big Data Analytics - Accelerated. stream-horizon.com

SOFTWARE-DEFINED NETWORKING (SDN)/NFV AND ACADEMIC RESEARCH IN CANADA

The Shifting Datacentre Landscape. Sally Parker, Research Director Enterprise Systems, Software and Services

Analytics In the Cloud

Search and Real-Time Analytics on Big Data

Concept and Project Objectives

Day at a Glance. Los Alamos National Labs: IBM Big Data Briefing. Los Alamos Research Park, Room 203A. Thursday, August 15, 2013

The Future of Data Management

Consulting and Systems Integration (1) Networks & Cloud Integration Engineer

Using GENI, CloudLab and AWS together within a Cloud Computing course

Build Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015

IPOP-TinCan: User-defined IP-over-P2P Virtual Private Networks

IPv6 Research and Testbeds in BUPT. EU-China Test beds Federation Workshop Yan Ma Jan. 15, 2015

NASA s Big Data Challenges in Climate Science

Automated Overlay Virtual Networking Manager for OpenFlow-based International SDN-Cloud Testbed

Datasheet. Infosys in the Wireless Mobility Space

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed

Zenoss for Cisco ACI: Application-Centric Operations

White Paper. Innovate Telecom Services with NFV and SDN

Comprehensive Analytics on the Hortonworks Data Platform

6.S897 Large-Scale Systems

The Future of Data Management with Hadoop and the Enterprise Data Hub

How To Make Data Streaming A Real Time Intelligence

Cloud Computing and Big Data What Technical Writers Need to Know

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER

Training for Big Data

Data Semantics Aware Cloud for High Performance Analytics

Traffic Management Solutions for Social Innovation Business

A Hurwitz white paper. Inventing the Future. Judith Hurwitz President and CEO. Sponsored by Hitachi

Enabling High performance Big Data platform with RDMA

Data Centre Networks Overview

Private Cloud Management

Global Technology Services. Mike Daniels Senior Vice President Global Technology Services

Hortonworks CISC Innovation day

Educational Opportunities in Big Data

HDP Enabling the Modern Data Architecture

Activity Report of Working Group 1

The New Dynamism in Research and Education Networks

NASA's Strategy and Activities in Server Side Analytics

Chukwa, Hadoop subproject, 37, 131 Cloud enabled big data, 4 Codd s 12 rules, 1 Column-oriented databases, 18, 52 Compression pattern, 83 84

Cloud Courses Description

Non-Stop Hadoop Paul Scott-Murphy VP Field Techincal Service, APJ. Cloudera World Japan November 2014

Successfully Deploying Globalized Applications Requires Application Delivery Controllers

SPECIALISTS TRAINING IN BIG DATA USING DISTRIBUTED ARCHITECTURAL SOLUTIONS SERVICES. Проректор по учебной и воспитательной работе

High Performance Computing (HPC)

NSF IRNC Program International Deployment and Experimental Efforts with SDN in 2013

Real-Time Big Data Analytics + Internet of Things (IoT) = Value Creation

NTRA s Proposed Areas of Research

CAPTURING & PROCESSING REAL-TIME DATA ON AWS

Transcription:

Software Defined System for Disaster Management and Environmental Monitoring Hiroaki Yamanaka (NICT) 1

Contents Needs for IT supported solutions in ASEAN region Target technologies of research in the ASEAN IVO Partner projects Platforms for research by NICT 2

Background ASEAN countries Large scale cities and rural areas severely impacted by disaster or environmental events Disasters often affect or are similar in several countries thus benefitting from collaborative transnational solutions. Address issues Understanding phenomena of nature Transnational software defined cyber infrastructure (CI) 3

IT supported solutions Environmental monitoring Smart cities http://www.soumu.go.jp/menu_seisaku/ictseisaku/ asean_smartnetwork/en/environment.html Disaster management http://se.nec.com/en_se/global/solutions/safety/disaster/index.html http://www.smartcityplanning.co.jp/en/approach/index.html 4

Software defined systems Software definition of system configuration/behavior via management interfaces Computing, networking, storage resources Improving performance Flexible and easy deployment Examples: Specialized communication protocol Application specific workloads Business continuity plan C. S. Li, et al, Software defined environments: An introduction, IBM Journal of Research and Development, vol. 58 5

Partner projects Center Of Excellence on Enablement of Cyberinfrastructure Applications (housed at NCHC) ASEAN IVO (Japan) Preliminary research activity for international collaboration in ASEAN countries Strong leadership of NICT COE (Taiwan) CENTRA (US) East Asia Collaborations to Enable Transnational Cyberinfrastructure Applications (funded by NSF) 6

CENTRA E N T US East Asia Collaborations to Enable Transnational Cyberinfrastructure Applications Housed at Advanced Computing and Information Systems Laboratory (ACIS) of University of Florida (UF) Key goals: Scientific advances in Application domains: environmental monitoring (EM), disaster management (DM), smart cities (SC) Software-defined systems: data-sharing, middleware interoperability, coordination Creation of next generation of international collaboration networks (of people) Creation of a framework for persistent collaboration among centers/groups in US-EA Advanced Computing and Information Systems laboratory C A R

CENTRA middleware scope Environments and corresponding frameworks and IT stacks that CENTRA research will consider (with examples) Environment Frameworks Stacks/platforms Examples HPC, HTC Social nets, adhoc systems Big-data stores data management Big data, analytics, visualization Sensor data processing and communication Batch scheduling, parallel processing and management, machine learning. Online social networks, overlay networks. Distributed unstructured stores, structured databases, index/search systems Batch and stream processing, machine learning, distributed data processing Real-time stream processing, data synchronization, compression MPI, HTCondor,HDFS, Pegasus,Torque, Lustre, Hadoop, Infiniband SocialVPN, Jitsi, IPOP Spark, Hadoop, Elastic Search, Riak, Ceph, HBase, PostgreSQL OpenStack, Apache Spark Hadoop/YARN. Apache Storm, Apache Kafka, Zookeeper, Piax [Yoshida08] Advanced Computing and Information Systems laboratory Ocean/lake modeling, MPI applications Locationbased cooperation idigbio Lifemapper JOSE testbed

Research platforms by NICT Research platforms that are possibly utilized for ASEAN IVO research. Platform Resilient ICT Research Center JOSE RISE PRAGMA ENT Description Resilient ICT research collaboration among NICT, Tohoku Univ., and industries Testbed with a large number of wireless sensors, SDN capabilities and distributed CLOUD resources. Wide area SDN testbed,which users can control the networks using their OpenFlow controllers International collaboration of wide area network testbeds 9

Resilient ICT Research Center in NICT Collaboration among NICT, Tohoku Univ. and Industries 1 Robust Photonic Network Platform Resilient ICT Research Center @Sendai Universities and Industries 2 Dependable Wireless & Satellite Network 3 Disaster Information Distribution Platform 10

Field Experiments of Disaster Information Dissemination and Communications in SIP (Strategic Innovation Promotion Programs) Association Indoor Fire Alarms with Broadcast Messages Healthcare Assessment ICT for Refuges Emergency mail for Foreigners and Handicapped Persons Vertual Network Servers Applications Experiment DB Visualize/ Showcases Quick Network Recovery in Damaged Areas Platform @NICT Sendai 11

Overview of JOSE(Japan-wide Orchestrated Smart/Sensor Environment) JOSE provides a Japan wide open testbed, which consists of a large number of wireless sensors, SDN capabilities and distributed CLOUD resources. The facilities of JOSE are connected via high speed network with SDN feature. JOSE will accelerate field trials of large scale smart ICT services essential for building future smart societies. Smart Planet Smart Cities Smart Health Smart Living Future Smart ICT (IoT) Services Smart Industry Smart Infrastructure Smart Buildings Smart Agriculture Field trials Field trials Field trials Provide facilities to verify & evaluate future IoT service technologies by the practical field trials large scale real environment empowered by state of the art SDN 12 technologies

RISE (Research Infrastructure for Large Scale Network Experiments) Wide area SDN testbed East Asia Japan US Connect to ASEAN countries via TEIN Connect resources of Tokyo Bangkok Singapore Los Angels OpenFlow networks with user preferred topologies and VMs are provided. Testbed users can control the networks using their own OpenFlow controllers. 13

PRAGMA ENT (Experimental Network Testbed) International collaboration of testbeds Goals Build a testbed to explore for use by PRAGMA researchers Facilitate collaborations as demonstrated by use of testbed in papers and presentations 14

PRAGMA ENT usecase: Satellite Image Sharing between Taiwan and Japan For rapid response to natural disasters, highspeed dedicated network needs to be established in a on demand manner Computational Resources Virtual Network Slice AutoVFlow The clip art of satellite is by Free Download Web CC BY 3.0 15

Initial plan ASEAN IVO invites researchers to help conceptualize international collaborative projects. participate in international teams. Identify research challenges and requirements for testbeds Create collaboration research projects launched in near future Identify participants with same interests in CENTRA and COE International collaboration research in ASEAN countries 16

Scheduled Meetings Dec. 7 11 2015 SEIAP 2015, hosted by COE (Taiwan) Jan. 27 29 2016 PRAGMA/APAN meeting (on 27 th Joint Meeting for Disaster Management Workshop) Feb. 2016 (planned) ASEAN workshop for Software Defined System for Disaster Management and Environmental Monitoring, hosted by ASEAN IVO (Japan) Mar. 2016 (planned) CENTRA Workshop, hosted by CENTRA (US) 17

Initial participants for ASEAN IVO (partial) Name Institute, country Position Role in activity Representative Lee Bu Sung SINGAREN, Vice President Software defined networks Singapore Hong Hoe ONG MIMOS, Malaysia Senior Director Software defined systems Jing Yuan LUKE MIMOS, Malaysia Senior Staff Software defined systems and Engineer resilience Dr. Kanokvate NECTEC, Thailand Deputy Director Disaster management Tungpimolrut Dr. Chalermpol NECTEC, Thailand Laboratory Software defined IT Charnsripinyo Director Hiroaki Yamanaka NICT, Japan researcher Software defined experimental networks Shinji Shimojo NICT, Japan director of testbed Software defined networks and R&D promotion system Yasuhiro NICT, Japan Director of Global data sharing Murayama Integrated Science Data Research Lab. Hiroshi Kumagai NICT, Japan Vice Director of Resilient ICT research Toshiyuki Miyachi NICT, Japan Large scale simulation/emulation environment 18

Conclusion IVO for transnational research in ASEAN countries Software defines systems Applications: environmental monitoring, disaster management, smart cities Partner projects: CENTRA (US), COE (Taiwan) Research platforms of NICT possibly utilized for ASEAN IVO ASEAN IVO invites researchers for transnational collaboration researches. 19