Cloud computing application for water resources based on open source software and open standards a prototype

Similar documents
Cloud application for water resources modeling. Faculty of Computer Science, University Goce Delcev Shtip, Republic of Macedonia

Amazon EC2 XenApp Scalability Analysis

Software implementation of the geodatabase model of the Republic of Macedonia

Implementation of information system to respond to a nuclear emergency affecting agriculture and food products - Case of Morocco

2) Xen Hypervisor 3) UEC

G-Cloud Service Definition Cadcorp Web Map Layers

Neptune. A Domain Specific Language for Deploying HPC Software on Cloud Platforms. Chris Bunch Navraj Chohan Chandra Krintz Khawaja Shams

Cloud powered services composition using Public Cloud PaaS platform

MEGA Web Application Architecture Overview MEGA 2009 SP4

vnas Series All-in-one NAS with virtualization platform

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

WHITE PAPER SETTING UP AND USING ESTATE MASTER ON THE CLOUD INTRODUCTION

Institute of Computational Modeling SB RAS

This presentation covers virtual application shared services supplied with IBM Workload Deployer version 3.1.

Performance Testing of a Cloud Service

Decision support for urban drainage using radar data of HydroNET-SCOUT

Cloud Computing and Government Services August 2013 Serdar Yümlü SAMPAŞ Information & Communication Systems

A CLOUD-BASED FRAMEWORK FOR ONLINE MANAGEMENT OF MASSIVE BIMS USING HADOOP AND WEBGL

Cloud Computing. Chapter 1 Introducing Cloud Computing

Cloud Computing and Amazon Web Services

County of Los Angeles. Chief Information Office Preferred Technologies for Geographic Information Systems (GIS) September 2014

EMC SYNCPLICITY FILE SYNC AND SHARE SOLUTION

Virtualization of the MS Exchange Server Environment

Virtualization of ArcGIS Pro. An Esri White Paper December 2015

Final Project Proposal. CSCI.6500 Distributed Computing over the Internet

Cloud Computing. Chapter 1 Introducing Cloud Computing

SECURE, ENTERPRISE FILE SYNC AND SHARE WITH EMC SYNCPLICITY UTILIZING EMC ISILON, EMC ATMOS, AND EMC VNX

Windows Server ,500-user pooled VDI deployment guide

Geoprocessing in Hybrid Clouds

Cloud Computing. Chapter 1 Introducing Cloud Computing

How To Use Arcgis For Free On A Gdb (For A Gis Server) For A Small Business

Standardized data sharing through an open-source Spatial Data Infrastructure: the Afromaison project

Technology and Cost Considerations for Cloud Deployment: Amazon Elastic Compute Cloud (EC2) Case Study

wu.cloud: Insights Gained from Operating a Private Cloud System

Deploying Business Virtual Appliances on Open Source Cloud Computing

Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps

FusionHub Virtual Appliance

Cloud-based Infrastructures. Serving INSPIRE needs

Cisco is a registered trademark or trademark of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.

Chapter 1: Introduction to ArcGIS Server

DEVELOPMENT OF WEB-BASED GIS INTERFACES FOR APPLICATION OF THE WEPP MODEL

CLOUD BASED N-DIMENSIONAL WEATHER FORECAST VISUALIZATION TOOL WITH IMAGE ANALYSIS CAPABILITIES

Belgacom Group Carrier & Wholesale Solutions. ICT to drive Your Business. Hosting Solutions. Datacenter Services

Efficient Cloud Management for Parallel Data Processing In Private Cloud

AlphaTrust PRONTO - Hardware Requirements

MAY 18, 2015 ARCGIS FOR SERVER FUNCTIONALITY MATRIX

Data Visualization Using Web GIS Software

Web Mapping in Archaeology

A Middleware Strategy to Survive Compute Peak Loads in Cloud

Deploying a Geospatial Cloud

GIS AS A DECISION SUPPORT FOR SUPPLY CHAIN MANAGEMENT

ServerCentral Cloud Services Reliable. Adaptable. Robust.

Numerix CrossAsset XL and Windows HPC Server 2008 R2

From Geoportal to Spatial Data Service Platform. Jani Kylmäaho National Land Survey of Finland Development Centre

Cloud Computing with Red Hat Solutions. Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd.

Optimal Service Pricing for a Cloud Cache

System requirements for A+

Application of GIS Analyzes with Cloud Computing

EMC Smarts SAM, IP, ESM, MPLS, NPM, OTM, and VoIP Managers Support Matrix

Pivot3 Reference Architecture for VMware View Version 1.03

WP 3. Elaboration database Architecture Features (Software Architecture Document)

How To Understand Cloud Computing

SERENA SOFTWARE Authors: Bill Weingarz, Pete Dohner, Kartik Raghavan, Amitav Chakravartty

Cloud Computing. Chapter 1 Introducing Cloud Computing

Open Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)

Running R from Amazon's Elastic Compute Cloud

Laurence Liew General Manager, APAC. Economics Is Driving Big Data Analytics to the Cloud

Intro to Virtualization

EUMETSAT EO Portal. End User Image Access using OGC WMS/WCS services. EUM/OPS/VWG/10/0095 Issue <1> <14/01/2010> Slide: 1

Security in the Sauce Labs Cloud. Practices and protocols used in Sauce s infrastructure and Sauce Connect

OBSERVEIT DEPLOYMENT SIZING GUIDE

Cloud Models and Platforms

MS Exchange Server Acceleration

Enabling Technologies for Distributed and Cloud Computing

Open-E Data Storage Software and Intel Modular Server a certified virtualization solution

The deployment of OHMS TM. in private cloud

ORACLE VIRTUAL DESKTOP INFRASTRUCTURE

Amazon Hosted ESRI GeoPortal Server. GeoCloud Project Report

The ORIENTGATE data platform

Editing Strategies for Enterprise Geodatabase

RED HAT ENTERPRISE VIRTUALIZATION

Page 1. Overview of System Architecture

owncloud Enterprise Edition on IBM Infrastructure

Cloud Computing and E-Commerce

Software Requirements Specification

CS 695 Topics in Virtualization and Cloud Computing. Introduction

XTM Web 2.0 Enterprise Architecture Hardware Implementation Guidelines. A.Zydroń 18 April Page 1 of 12

CFCC: Covert Flows Confinement For VM Coalitions Ge Cheng, Hai Jin, Deqing Zou, Lei Shi, and Alex K. Ohoussou

Migrating from Amazon AWS to OpenStack

Outline. Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models

EMC Smarts SAM, IP, ESM, MPLS, NPM, OTM, and VoIP Managers 9.4 Support Matrix

Virtualization in Linux a Key Component for Cloud Computing

CS 695 Topics in Virtualization and Cloud Computing and Storage Systems. Introduction

Transcription:

Cloud computing application for water resources based on open source software and open standards a prototype Blagoj Delipetrev 1, Dimitri Solomatine 2 1 University Goce Delcev, Krste Misirkov bb, 2000 Shtip, Republic of Macedonia. 2 Water Resources Section, Delft University of Technology, Delft, the Netherlands. Abstract This short paper presents research and development of a cloud computing application for water resources based on open source software and open standards using hybrid deployment model of public private cloud, running on two separate virtual machines (VMs). The first one (VM1) is running on Amazon web services (AWS) and the second one (VM2) is running on a Xen cloud platform. The cloud application has three web services for 1) data infrastructure (DI), 2) support for water resources modelling (WRM), 3) user management. The presented cloud application is: available all the time, accessible from everywhere, it is scalable, works in a distributed computer environment, it creates a real-time multiuser collaboration platform, the programing languages code and components are interoperable, and it is flexible in including additional components. This research demonstrate the capability to scale and distribute the cloud application between several VMs. The cloud application was tested on the Zletovica river basin case study with concurrent multiple users. The tests confirmed that the presented cloud application works and can be used as a foundation for development of specialized geospatial application in the water domain. Keywords Cloud computing, water resources, open source, application development. 1 Introduction Presently, most of the existing software for water resources is desktop-based, designed to work on a single computer. This represents a major limitation in many ways, starting from limited computer processing, storage power, accessibility, availability, etc. The only feasible solution lies in the web and cloud. There are various examples of web applications (Choi, Engel, & Farnsworth, 2005; Delipetrev, Jonoski, & Solomatine, 2014; Delipetrev, Mihajlov, Delipetrev, & Delipetrov, 2010; Horak, Orlik, & Stromsky, 2008; Reed, Bills, Anderson, Ketchum, & Piasecki, 2010), cloud web services (Bürger, Kollet, Schumacher, & Bösel, 2012; Quiroga, Popescu, Solomatine, & Bociort, 2013) and mobile applications (Jonoski et al., 2012) in the water domain. The cloud application for water resources is continuation of previous research (Delipetrev et al., 2014) that presents the development of a web application for water resources based on open source software. The cloud application enhancement are the following: 449

1. The web application is distributed / deployed on two VMs. The VM1 is running as a micro instance of Amazon web services (AWS) public cloud, and the VM2 is running on a Xen cloud platform at the University Goce Delcev in the Republic of Macedonia. 2. The web service for support of WRM that runs on VM1, and the DI web service that runs on VM2, are communicating with WFS-T (Web Feature Service - Transactional Protocol) XML messages over the internet, demonstrating distributed computer environment.. 3. Hybrid cloud design is presented, where VM1 is part of the AWS public cloud, and VM2 is running in the private cloud. The advantage of this distributed computer environment is that the data security and protection can reside in the private cloud (VM2), while the web services can be in the public cloud (VM1). The cloud computing application was tested using data from the Zletovica river basin located in the northeastern part of the Republic of Macedonia. The application url www.delipetrov.com/his/ provides video presentation and explanation of the system components, guides how to use the services etc. 2 Design and implementation The main enhancement compared to the web application is the scalability. The design and implementation demonstrate that the cloud application can support seamlessly unlimited number of users. The web services that are shown in Figure 1: 1. DI. 2. Support of WRM. 3. User management. Figure 1: Design of the cloud computing application for water resources. The DI web service is composed of two components 1) HMak database created in PostgreSQL and PostGIS and 2) GeoServer application. The HMak stores 450

geospatial data, including topographic, hydro-geological, rivers, roads, municipal, etc. The HMak stores six geospatial vector layers: rivers, canals, reservoirs, users, inflows, and agriculture land, and their attribute tables, which are used by the web service for support of WRM. The web service for support of WRM is intended to provide a web interface for creating and editing geospatial water resources elements just like in classical desktop applications. The main difference between the web service for support of WRM and desktop interfaces is that the web service for WRM is accessible by multiple users simultaneously over the internet using a web browser. The web service for support of WRM is developed using PHP, Ajax, JavaScript and OpenLayer library that supports OGC standards. The OpenLayer library creates WFS-T communication between the web service for support of WRM user interface running on VM1, and the geospatial data stored in HMak where the GeoServer acts like a middle tier running on VM2. The WFS-T communication provides a framework to create, update, and delete geospatial data over the internet. The web service for users management is simple with a main purpose to control the cloud computing application access. Each user receives its own login and password to access the cloud application and monitoring the time spent on the system. Important milestone is the deployment of the cloud application between the two VMs running on separate physical servers. The first VM1 is a micro instance on the AWS, and the second VM2 is running on the Xen cloud platform. The VM1 has 8 GB HDD, 1 GB RAM and Ubuntu 13 as an operating system. The VM2 has 30 GB HDD, 1 GB RAM and Fedora 16 as an operating system. The VM 2 is running on a physical server IBM x3400 M3 with four-core Intel Xeon E5620 2.40 GHz with 12 MB of cache per processor. 3 Preliminary results and tests The cloud computing application was tested on river basin Zletovica that is located in the north-east of the Republic of Macedonia. The river basin main challenges are flood and drought protection. Figure 2 shows the hydro system Zletovica model that is created by the web service for WRM by multiple collaborating users. The hydro system contains the reservoir Knezevo, river network, canal network, towns as users and agricultural areas. The towns and reservoir titles are added additionally and are not part from the web service. 451

4 Discussion Figure 2: Water resource model of the Zletovica river basin. Concerning service models, the presented cloud application belong to software as a service (SaaS). Users with a web browser access the cloud application and do not care about underlying cloud infrastructure. The current deployment model is hybrid of public - private cloud because the VM1 is running in public cloud AWS, and VM2 is on private Xen cloud platform. The cloud application is scalable, interoperable, and accessible from everywhere and available all the time. The most valuable cloud application feature is its real time collaboration platform capabilities. Multiple users using only a web browser can jointly work with the web services and collaborate in the same working environment. When a user saves the current work, all other distributed users with just a web browser refresh can see the changes (new/modified rivers, users etc.). All of the data and models are stored in HMak and users do not have to be concerned about hardware and software support infrastructure. Another important concern in implementing cloud solutions is the data protection and safety. This prototype cloud application makes an elegant solution, residing the web services in the public cloud, while the data is stored in the private cloud. If for instance an attack happens to protect the data, the private cloud VM2 can be disconnected from the public cloud AWS VM1. Another key point is that data resides inside the institution, and only the web services are outsourced. This concept can be applied in many organizations where the data needs to be stored internally. 5 Conclusions The presented cloud application is developed using open source software and standards and prototype code. The application is deployed on two VM creating hybrid cloud solution. The cloud application is a state-of-the-art web geospatial collaboration platform for water resources modeling. The presented solution is a prototype and can be used as a foundation for developing specialized web geospatial applications. 452

References Geomatics Workbooks n 12 "FOSS4G Europe Como 2015" Bürger, C. M., Kollet, S., Schumacher, J., & Bösel, D. (2012). Introduction of a web service for cloud computing with the integrated hydrologic simulation platform ParFlow. Computers and Geosciences, 48, 334-336. Choi, J., Engel, B., & Farnsworth, R. (2005). Web-based GIS and spatial decision support system for watershed management. Journal of Hydroinformatics, 7, 165-174. Delipetrev, B., Jonoski, A., & Solomatine, D. P. (2014). Development of a web application for water resources based on open source software. Computers & Geosciences, 62, 35-42. Delipetrev, B., Mihajlov, D., Delipetrev, M., & Delipetrov, T. (2010). Model of the Hydro-Information System of the Republic of Macedonia. Journal of Computing and Information Technology, 18(2), 201-204. Horak, J., Orlik, A., & Stromsky, J. (2008). Web services for distributed and interoperable hydro-information systems. Hydrology and Earth System Sciences, 12(2), 635-644. Jonoski, A., Alfonso, L., Almoradie, A., Popescu, I., van Andel, S. J., & Vojinovic, Z. (2012). Mobile phone applications in the water domain. Environmental Engineering & Management Journal (EEMJ), 11(5). Quiroga, V. M., Popescu, I., Solomatine, D., & Bociort, L. (2013). Cloud and cluster computing in uncertainty analysis of integrated flood models. Journal of Hydroinformatics, 15(1), 55-70. Reed, P. M., Bills, B., Anderson, M., Ketchum, B., & Piasecki, M. (2010). The Mid-Atlantic Watershed Atlas (MAWA): Open access data search & watershed-based community building. Environmental Modelling & Software, 25(6), 808-812. 453

454