ONS Methodology Working Paper Series No 1. ONS Innovation Laboratories
|
|
- Randall Little
- 8 years ago
- Views:
Transcription
1 ONS Methodology Working Paper Series No 1 ONS Innovation Laboratories Owen Abbott December 2014
2 Contents 1. Introduction History The need for computing facilities to drive innovation Openstack... 4 Figure 1 Openstack structure overview Building the Openstack environment... 5 Figure 2 The Titchfield Lab Servers... 6 Figure 3 The Titchfield Lab Terminals... 6 Figure 4 The terminals in the Newport Lab Lab architecture Lab management and use Management Projects Documentation and Information sharing... 9 Figure 5 Screenshot of Innovation Lab DokuWiki homepage Conclusions References Annex A -Hardware list for the Titchfield Lab Annex B -Openstack Environment Specification... 11
3 ONS Innovation Laboratories 1. Introduction This paper describes the Innovation Laboratories that are being used by the Office for National Statistics (ONS) to support its strategic aim to be at the forefront of integrating and exploiting data from multiple sources, and to support its aspiration to be perceived as among the best, most innovative statistical offices in the world (ONS, 2013). Big data are being used more and more to produce statistics in the wider world and ONS is engaging with emerging data, methods and tools. This requires access to an environment which can be used to explore these new developments, and permit analysis of the potential for them to be used in the production of official statistics. The Innovation Labs are a resource for learning, research and innovation which provide technologies which are not available on the standard ONS secure network. They are stand-alone networks of high specification computers which are not connected to the ONS network, but have full internet access. They have been built as a full private cloud computing facility 1 which allows users control over processing power, operating system and software depending on their requirements. The cloud environment is built using open-source software. The Labs were set up in response to the challenges of the ONS strategy (ONS, 2013). To deliver its aims, ONS recognised the need to: explore how to gather and use big data; explore the use of alternative data sources in producing statistics; move towards more use of open-source software; use technology to support the business; and develop our skills and innovation abilities. Another outcome from the ONS strategy was the establishment of the Big Data project (Naylor et al, 2014a) in late 2013 to: investigate the potential advantages that big data provides for official statistics; understand the challenges with using these sources; establish an ONS policy on big data and longer term strategy incorporating ONS s position within Government and internationally in this field; and make recommendations on the best way to support the ONS strategy on big data beyond the life of the project. A key component of the project was to include some practical applications of big data to both assess the role they may have within official statistics and also to help understand the methodological and technical issues that may arise when handling them. The Labs have supported these pilot projects, the Big Data team being the primary user group. This paper provides a brief history of how the laboratories were instigated and built, and then sets out the IT architecture that was deployed. It summarises how the Labs are managed, and discusses some of the projects that have been undertaken using the lab environment. Lastly, the lessons learnt and future plans for the Labs are described. 1 A description of a private cloud can be found at
4 2. History 2.1 The need for computing facilities to drive innovation There has been a long standing need within the ONS Methodology group for a sandpit environment which would allow the exploration of new statistical software, and would also provide a high performance computing capability. In the days when ONS had an in-house IT support function, it was possible to specify and obtain high performance workstations for particular purposes, such as for simulating censuses, large scale spatial analyses or memory intensive multilevel modelling. However, with the move towards centralised IT functions and the outsourcing of IT support it became more difficult to repeat this approach, primarily because it was more expensive to introduce and support non-standard hardware. We considered the possibility of getting a sandpit environment scoped and built by our IT partner organization out of the box, but this was ruled out for three reasons: Firstly, we did not have a clear picture of exactly what the environment would need to deliver. We therefore ran the risk of it not meeting our needs. The cost would also be very significant. Secondly, changing and adapting the environment once delivered would be expensive and relatively slow, requiring a change management process that was not sufficiently agile for our needs. Thirdly, a key objective was to build capability by understanding more about big data and data science tools and technologies. The former Methodology Group in particular has always fostered a strong culture of learning by doing, and it was felt that this would be the best way to build new capability. In late 2011, the ONS Methodology group was merged with the ONS IT function. This reorganisation was designed to bring together statistical and IT experts in a single directorate to encourage collaboration between the two groups. As part of this, some statistical staff who were interested in computer science and technology began considering how to encourage collaboration and innovation. Following discussions in March 2013, the Director agreed to the creation of a pilot innovation laboratory at the ONS Titchfield site. The equipment was purchased through the usual IT contract, albeit on a supply only basis with no support and on the proviso that it was not to be connected to the secure ONS network. On arrival in November 2013, the methodology staff who specified the machines installed them on a bank of spare desks. They networked and connected them to a basic external broadband line which had been purchased. Windows 7 was installed on the machines to allow initial use of the lab facilities. This was followed by a pilot at the Newport site to mirror the Titchfield setup. The next stage was to explore setting up the Labs as a private cloud environment. The methodology staff who instigated the hardware purchases had identified that Openstack 2 offered the best option in terms of cloud software, as it was widely supported and available across a number of platforms. 2.2 Openstack Openstack is a collection of open source software packages that can be used to create a cloud environment on top of a set of physical hardware. The environment provides the ability to run virtual machines - essentially a computer that isn't tied to a specific physical machine. These virtual 2
5 machines are fully customisable, so the end user can vary how powerful they are, how much storage they have, what operating system they use and what software is installed. Figure 1 shows the basic Openstack structure. Users define what they need through the dashboard, and Openstack provisions compute (processing power), networking and disk storage for the user. The user then accesses the provisioned virtual machine by either logging on directly, or in the case of a machine that has a pre-built web interface, using a web browser pointed at the machine s network address. Figure 1 Openstack structure overview 3 This type of environment allows a user to essentially work on a virtual machine of their choosing (provided we have a base image for the operating system required). The user can install whatever software they like and run any processes they desire, as well as store and access data on a shared storage facility. What makes cloud environments particularly powerful is that they are easily scalable (by adding additional physical machines). An end user is able to run multiple virtual machines for a variety of purposes, and this also allows them to take advantage of parallel processing technologies (e.g. Apache Hadoop, an algorithm based framework for processing large problems). A key additional advantage to ONS of setting up a private cloud environment in house is that those administering it will obtain a good understanding of the technology, its advantages and disadvantages. 2.3 Building the Openstack environment The methodology group staff attempted to build the environment themselves in early 2014, learning about Linux and the open source software required along the way. There are lots of ways of implementing an Openstack environment, and there are a number of websites that provide detailed instructions for doing so using open source software. After trying without success to use a package called Packstack 4 to automatically provision Openstack, the Ubuntu 5 distribution of Openstack was explored as this seemed to provide a more user friendly route that was relatively well documented. This had some success. The software used to control the hardware (MAAS 6 ) was installed and 3 See
6 deployed, as was the software orchestration layer (Juju 7 ) which could deploy the Openstack components. However, some issues with the Openstack setup prevented an operational stack from being completed. As some knowledge of the Ubuntu operating system (OS) had been obtained, and the quality of the software looked good, the decision was made to obtain some consultancy (through the government G-cloud procurement facility). This resulted in Canonical 8 (the company which delivers Ubuntu) being engaged to provide 5 days consultancy with the aim of setting up a working Openstack implementation by the end. This worked very well. The consultants collaborated with ONS methodology and IT staff to complete the installation and provide a full guide to setting up and using the environment. This was completed in Titchfield in March 2014, and in Newport in June The ONS team was able to use this guide to rebuild the environments from scratch, and have learnt a huge amount working through this process. During the process of getting the Openstack environment working, the ONS team was able to acquire 20 ex-ons workstation PCs which were due to be disposed. These machines were of 2008 vintage, and were being replaced due to the ONS rollout of Windows 7. The team deployed the desktop version of Ubuntu 12.04LTS onto these PCs for use as terminals for users to login and access Openstack through a web browser. Figures 2 and 3 shows the Titchfield Lab (on a standard bank of ONS desks), and Figure 3 shows the Newport Lab (on specifically ordered desking). Figure 2 The Titchfield Lab Servers Figure 3 The Titchfield Lab Terminals
7 Figure 4 The terminals in the Newport Lab 3. Lab architecture The Labs are built using a mixture of high specification workstations (8 core processors, 64GB RAM) which act as servers and ex-ons desktops/laptops which are act as the terminals through which users can either browse the web or access the Openstack environment. The Labs have their own broadband connection, network switches, printer and a storage server (with about 10TB storage) for the storage of data and user shares. The full list of hardware is provided at Annex A. In total, the equipment cost was in the region of 50k for each Lab. The environment is classed as a Business Impact Level Zero (BIL0) environment, as it has minimal security and is not accredited in any way. This essentially means that it can only hold publically available data, so unpublished ONS data cannot be held in the Labs. Higher BIL environments require increased security, protective monitoring and ultimately isolation from external attacks.
8 The servers are running Ubuntu 12.04LTS (a flavour of Linux) as the operating system, and they host the Ubuntu version of Openstack (we are using the Havana release). This provides about 90 virtual CPUs, 700GB virtual RAM and 32TB of storage. The storage backend is provided by a distributed storage solution called Ceph, which distributes the data across physical disks and hosts such that if one fails, there is always a copy on another disk or host. The full specification of the Openstack environment is provided at Annex B. The desktop terminals use the desktop version of Ubuntu 12.04LTS (which provides a desktop environment and web browser). The Labs have a user authentication server which allows users to log on to any of the terminals and provides them with a home share (which is stored permanently on the storage server) where they can store their own files. The storage server hosts the Lab wiki (see section 4) and also provides a Virtual Private Network (VPN) server, which has allowed ONS staff in London to access the Labs from a standalone terminal there over the internet. It also allows the Lab administrators to be able to connect to Titchfield and Newport for maintenance. All software used to build the Labs is open source. This is software that is distributed under a license which allows anyone to view, modify or change it for any purpose. Such software has often been built by public developer communities. This means it is essentially free, but it develops according to the level of interest in it and has limited professional support. The following software packages beyond those noted in the installation description have been used in the Labs: Mozilla Firefox (web browser), Google Chrome, R (statistical software), Libreoffice (a clone of Microsoft office), QGIS, MySQL, PostgreSQL, DokuWiki, Python, Java and more. The operating systems that are available to be used in Openstack are Ubuntu server, Mint desktop, CentOS, CirrOS, Windows 2012 Server and Windows 7 desktop. Windows 7 is the only OS that requires a proper license, so the licenses that were purchased with the workstations on which the Labs are built are used. 4. Lab management and use 4.1 Management The Labs are supported by two Lab Managers, one for each site. IT support is provided by two system architects. None of these roles are full time (the Managers are 0.2 FTEs and architects are 0.1 FTEs), and were filled by interested parties who wanted to be involved in learning about the Lab technology and uses. There is also a small amount of administrative support for the Labs. The Labs are overseen by the Innovation Labs Oversight Group, chaired by the Big Data project lead. The group includes both Lab Managers and representatives from the methodology and IT divisions. This group meets monthly to discuss relevant developments, approve project proposals, monitor the Lab setup and communicate project outcomes. There is limited funding for the Labs. Whilst the Big Data project provided funding for the Lab setup, there is no specific funding for the projects carried out in the Labs. Staff wishing to use the Labs must therefore either be doing so as part of their funded work, or as part of self development. This has been somewhat of an issue with encouraging Lab use particularly from areas who are mainly customer funded and therefore do not have spare capacity (or money) for spending time on innovation projects. The oversight group strategy is to deliver some pilot projects which will demonstrate the value of innovation, and therefore encourage budget holders to consider allowing resource for such projects.
9 4.2 Projects At the time of writing, only Methodology and IT staff have been able to use the Labs, with plans to open them to all of ONS in early In order to ensure that Labs are used appropriately, potential users have to complete a one page template outlining the purpose of the work they wish to carry out in the lab, what the benefits are, how long it will take and what their requirements are. Following Line Manager support, these projects are then submitted to the oversight group for approval before the users are provided with an account. For small projects that will require less than 2 hours or so (for instance viewing a webinar which cannot be accessed on the usual ONS network facilities), a project template is not required and a guest account can be used following approval from a Lab Manager. Since the Labs opened in early 2014, their use has increased over time. The Big Data project is the primary user, with approximately 5 staff in total using the Labs across both sites on an almost permanent basis. Progress on Big Data projects were reported by Naylor et al (2014a and 2014b). Beyond the Big Data specific pilot project, there have been 7 completed projects and at the time of writing there are 6 ongoing projects. In addition, there have been around 10 users who have used the Labs for individual learning, accessing webinars or for exploring websites not accessible over the ONS network. The more substantial projects included: Obtaining, evaluating and analysing GP prescriptions data (open data available monthly for all of England) to see if there are correlations with levels of health from 2011 Census Obtaining and evaluating House transaction data (address level open data available monthly from Land Registry) to evaluate its coverage and see if there are correlations with accommodation type information from 2011 Census at low geographical levels Evaluating open source GIS software (QGIS and UDIG) Setting up a multi-node Hadoop cluster and interface Implementing a Windows 7 Desktop virtual machine for use in Openstack How to carry out sentiment analysis using Twitter data in R, and whether it can help make predictions Ongoing projects include: Generating and damaging synthetic data using FEBRL (a record linkage tool) Sentiment analysis of ONS outputs using Twitter data evaluation of ArcGIS pro Implementing an extended Hadoop environment Analysis of large volume ONS flexible working data Assessing the potential of Google Trends 4.3 Documentation and Information sharing Instructions and information for using the Lab is stored in a DokuWiki (see Figure 5) hosted on the Lab storage server. This Wiki contains an overview of the Labs, user instructions for how to use the Lab environment, what data is available and allows users to add content such as project outcomes, code or hints and tips. It also allows the Lab administrators to keep documentation about the Lab setup and what to do when there is a problem. The wiki has been made accessible to all ONS staff over the internet.
10 Figure 5 Screenshot of Innovation Lab DokuWiki homepage 5. Conclusions The ONS Innovation Labs are scalable environments where staff can experiment with new data, tools, technologies and methods safely without compromising ONS systems. They provide an environment where staff can develop a wide variety of statistical and technical skills and work on innovative projects that they put forward themselves. Evidence from the projects undertaken so far is that this is very motivational and allows staff to explore and learn about different areas of Data Science thus equipping themselves and ONS for change. The future of the Innovation Labs is not yet clear. Their unique point is that any open-source software (or software for which we have an appropriate license) can quickly and easily be installed. This means we can try out new software and technologies that we would otherwise have to go through lengthy and possibly costly processes to get onto ONS systems. It also allows us to easily download and explore public data sources which again we may not have access to on the ONS network. Therefore, for ONS to continue innovating it is important that support for the Labs continue and that continue to be flexible. If there was a need to have a higher BIL environment, for example to allow some of the data collected by ONS to be able to be stored and analysed, accreditation would require the removal of such flexibility (as it opens up security risks). Therefore, to use data that is a higher Business Impact Level in a flexible environment, the only option is to reduce the IL level through anonymisation or by creating synthetic data which replicates the patterns in the higher IL level data. The Labs can then be used to test the new technologies/methods using the protected data - this process then provides the information necessary to make the case for using the new tools on a more secure platform with sensitive data in a 'production' ONS
11 environment. The strategy therefore is to consider ways of making the Labs more robust to support ongoing use, but without losing their flexibility - and incorporate the learning from these into business cases for new tools on production ONS systems. As noted in the paper, the Labs are currently restricted to usage by Methodology and IT staff only. However, the plan is to open up the Labs to the rest of ONS in early Some pilot projects run by outside business areas have demonstrated how this will work. The likely demand is unknown but there are some areas who have expressed an interest in using the Labs to encourage innovation within the production of their statistics. References Naylor, J., Swier, N. and Williams, S. (2014a) ONS Big Data Project Progress report: Qtr 1 Jan to Mar Available at Naylor, J., Swier, N. and Williams, S. (2014b) ONS Big Data Project Progress report: Qtr 2 April to June Available at Office for National Statistics (2013) ONS Strategy Available at Annex A -Hardware list for the Titchfield Lab Fujitsu Esprimo E5720 desktop x 9 (2-core Pentium CPU, 4GB RAM, 160 GB HDD) Fujitsu 22 monitors x9 Fujitsu Celsius M720 Workstation x 7 (8-core Xeon CPU, 64GB RAM, 128GB SSD boot drive), 4 x 2TB SATA HDDs in 3 of these workstations, 2 x 2TB SATA HDDs in 1 of these workstations) Fujitsu Celsius M730 Workstation x 2 (10-core Xeon CPU, 128GB RAM, 128GB SSD boot drive) Synology NAS Diskstation DS1513+ with 5 x 3TB SATA HDDs Netgear DGN1000 router 1xDLINK DGS EasySmart Gigabit Switch 1xDLINK DGS EasySmart Gigabit Switch 1xSamsung colour laser printer Annex B -Openstack Environment Specification The environment was built by Canonical consultants in March 2014 using the stable versions of software available at that time (MAAS v1.5, Juju v1.6 and Havana openstack release). The basic structure is that MAAS manages the virtual/physical machines which will host the openstack services. Juju is the software orchestrator which places the required services onto the MAAS managed machines.
12 The hosts (physical machines) are therefore setup as follows (machines managed by MAAS are denoted by (M)): 1 x hypervisor machine running Ubuntu 12.04LTS 64 bit server. This hosts 12 Virtual Machines, as follows (all use Ubuntu 12.04LTS 64 bit server): LDAP identity server used for desktop authorisation (using OpenLdap) MAAS server and Juju client (M) Juju Bootstrap server (M) Openstack Dashboard (M) MySQL database backend (M) RabbitMQ messaging service (M) Glance image storage gateway (M) Cinder block storage gateway (M) Ceph-radosgw object storage gateway (M) Nova-controller cloud controller service (M) Keystone identity service (M) Neutron networking service 3x Storage nodes (M) each of which have 4 x 3TB HDDs. These provide the Ceph block storage service. 5x Compute nodes (M) which provide the compute service. The Synology NAS (which has 5x 3TB HDDs) provides shared Virtual Machine storage for the compute nodes, and permanent storage for users data.
Ubuntu OpenStack on VMware vsphere: A reference architecture for deploying OpenStack while limiting changes to existing infrastructure
TECHNICAL WHITE PAPER Ubuntu OpenStack on VMware vsphere: A reference architecture for deploying OpenStack while limiting changes to existing infrastructure A collaboration between Canonical and VMware
More informationUbuntu OpenStack Fundamentals Training
Ubuntu OpenStack Fundamentals Training Learn from the best, how to use the best! You ve made the decision to use the most powerful open cloud platform, and now you need to learn how to make the most of
More informationIntro to Virtualization
Cloud@Ceid Seminars Intro to Virtualization Christos Alexakos Computer Engineer, MSc, PhD C. Sysadmin at Pattern Recognition Lab 1 st Seminar 19/3/2014 Contents What is virtualization How it works Hypervisor
More informationw w w. u l t i m u m t e c h n o l o g i e s. c o m Infrastructure-as-a-Service on the OpenStack platform
w w w. u l t i m u m t e c h n o l o g i e s. c o m Infrastructure-as-a-Service on the OpenStack platform http://www.ulticloud.com http://www.openstack.org Introduction to OpenStack 1. What OpenStack is
More informationSUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse.
SUSE Cloud 2.0 Pete Chadwick Douglas Jarvis Senior Product Manager pchadwick@suse.com Product Marketing Manager djarvis@suse.com SUSE Cloud SUSE Cloud is an open source software solution based on OpenStack
More informationMobile Cloud Computing T-110.5121 Open Source IaaS
Mobile Cloud Computing T-110.5121 Open Source IaaS Tommi Mäkelä, Otaniemi Evolution Mainframe Centralized computation and storage, thin clients Dedicated hardware, software, experienced staff High capital
More informationIOS110. Virtualization 5/27/2014 1
IOS110 Virtualization 5/27/2014 1 Agenda What is Virtualization? Types of Virtualization. Advantages and Disadvantages. Virtualization software Hyper V What is Virtualization? Virtualization Refers to
More informationGeoCloud Project Report USGS/EROS Spatial Data Warehouse Project
GeoCloud Project Report USGS/EROS Spatial Data Warehouse Project Description of Application The Spatial Data Warehouse project at the USGS/EROS distributes services and data in support of The National
More informationHow to Deploy OpenStack on TH-2 Supercomputer Yusong Tan, Bao Li National Supercomputing Center in Guangzhou April 10, 2014
How to Deploy OpenStack on TH-2 Supercomputer Yusong Tan, Bao Li National Supercomputing Center in Guangzhou April 10, 2014 2014 年 云 计 算 效 率 与 能 耗 暨 第 一 届 国 际 云 计 算 咨 询 委 员 会 中 国 高 峰 论 坛 Contents Background
More informationIron Chef: Bare Metal OpenStack
Rebecca Brenton Partner Alliances Manager Rob Hirschfeld Principal Cloud Architect Session Hashtags #chefconf #openstack About the Solution: http://dell.com/openstack http://dell.com/crowbak Iron Chef:
More informationPrivileged Cloud Storage By MaaS JuJu
Privileged Cloud Storage By MaaS JuJu Sarita Shankar Pol 1, S. V. Gumaste 2 1 Computer Engineering, Sharadchandra College of Engineering, Otur (Pune), India 2 Professor, Computer Engineering, Sharadchandra
More informationIBM Cloud Manager with OpenStack
IBM Cloud Manager with OpenStack Download Trial Guide Cloud Solutions Team: Cloud Solutions Beta cloudbta@us.ibm.com Page 1 Table of Contents Chapter 1: Introduction...3 Development cycle release scope...3
More informationSUSE Cloud Installation: Best Practices Using a SMT, Xen and Ceph Storage Environment
Best Practices Guide www.suse.com SUSE Cloud Installation: Best Practices Using a SMT, Xen and Ceph Storage Environment Written by B1 Systems GmbH Table of Contents Introduction...3 Use Case Overview...3
More informationOpen Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)
Open Cloud System (Integration of Eucalyptus, Hadoop and into deployment of University Private Cloud) Thinn Thu Naing University of Computer Studies, Yangon 25 th October 2011 Open Cloud System University
More informationrackspace.com/cloud/private
rackspace.com/cloud/private Rackspace Private Cloud Installation (2014-11-21) Copyright 2014 Rackspace All rights reserved. This documentation is intended for users who want to install Rackspace Private
More informationAMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013
AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013 OpenStack What is OpenStack? OpenStack is a cloud operaeng system that controls large pools of compute, storage, and networking resources
More informationApplied Micro development platform. ZT Systems (ST based) HP Redstone platform. Mitac Dell Copper platform. ARM in Servers
ZT Systems (ST based) Applied Micro development platform HP Redstone platform Mitac Dell Copper platform ARM in Servers 1 Server Ecosystem Momentum 2009: Internal ARM trials hosting part of website on
More informationEstablishing Scientific Computing Clouds on Limited Resources using OpenStack
UNIVERSITY OF TARTU FACULTY OF MATHEMATICS AND COMPUTER SCIENCE Institute of Computer Science Valdur Kadakas Establishing Scientific Computing Clouds on Limited Resources using OpenStack Bachelor Thesis
More informationRestricted Document. Pulsant Technical Specification
Pulsant Technical Specification Title Pulsant Government Virtual Server IL2 Department Cloud Services Contributors RR Classification Restricted Version 1.0 Overview Pulsant offer two products based on
More information9/26/2011. What is Virtualization? What are the different types of virtualization.
CSE 501 Monday, September 26, 2011 Kevin Cleary kpcleary@buffalo.edu What is Virtualization? What are the different types of virtualization. Practical Uses Popular virtualization products Demo Question,
More informationSUSE Cloud 5 Openstack
SUSE Cloud 5 Openstack SUSEtoberfest 2015 Florian Rommel, Datalounges Oy @datalounges https://www.datalounges.com Welcome! (about me?) Background: Datalounges Decades of Multinational Corporate IT in experience
More informationPatriot Hardware and Systems Software Requirements
Patriot Hardware and Systems Software Requirements Patriot is designed and written for Microsoft Windows. As a result, it is a stable and consistent Windows application. Patriot is suitable for deployment
More informationDell Compellent Storage Center SAN & VMware View 1,000 Desktop Reference Architecture. Dell Compellent Product Specialist Team
Dell Compellent Storage Center SAN & VMware View 1,000 Desktop Reference Architecture Dell Compellent Product Specialist Team THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL
More informationDeploying Business Virtual Appliances on Open Source Cloud Computing
International Journal of Computer Science and Telecommunications [Volume 3, Issue 4, April 2012] 26 ISSN 2047-3338 Deploying Business Virtual Appliances on Open Source Cloud Computing Tran Van Lang 1 and
More informationAn Oracle White Paper December 2011. Oracle Virtual Desktop Infrastructure: A Design Proposal for Hosted Virtual Desktops
An Oracle White Paper December 2011 Oracle Virtual Desktop Infrastructure: A Design Proposal for Hosted Virtual Desktops Introduction... 2! Design Goals... 3! Architectural Overview... 5! Logical Architecture...
More informationSage 200 Online. System Requirements and Prerequisites
Sage 200 Online System Requirements and Prerequisites v2013 Copyright statement Sage (UK) Limited, 2013. All rights reserved. If this documentation includes advice or information relating to any matter
More informationXTM Web 2.0 Enterprise Architecture Hardware Implementation Guidelines. A.Zydroń 18 April 2009. Page 1 of 12
XTM Web 2.0 Enterprise Architecture Hardware Implementation Guidelines A.Zydroń 18 April 2009 Page 1 of 12 1. Introduction...3 2. XTM Database...4 3. JVM and Tomcat considerations...5 4. XTM Engine...5
More informationVirtualization For Network Testing & Staff Training
Virtualization For Network Testing & Staff Training Virtualization Technologies They are everywhere By abstracting functionality away from hardware we gain Improved capacity usage Lower power consumption
More informationDISTRIBUTED DATA COLLECTION FOR REINSURANCE (RI) AND RISK ADJUSTMENT (RA): PROVISIONING. August 27, 2015 HTTPS://WWW.REGTAP.INFO/
DISTRIBUTED DATA COLLECTION FOR REINSURANCE (RI) AND RISK ADJUSTMENT (RA): PROVISIONING August 27, 2015 Session Guidelines This is a 90-minute webinar session. For questions regarding the Distributed Data
More informationMark Bennett. Search and the Virtual Machine
Mark Bennett Search and the Virtual Machine Agenda Intro / Business Drivers What to do with Search + Virtual What Makes Search Fast (or Slow!) Virtual Platforms Test Results Trends / Wrap Up / Q & A Business
More information2) Xen Hypervisor 3) UEC
5. Implementation Implementation of the trust model requires first preparing a test bed. It is a cloud computing environment that is required as the first step towards the implementation. Various tools
More informationHow To Install Openstack On Ubuntu 14.04 (Amd64)
Getting Started with HP Helion OpenStack Using the Virtual Cloud Installation Method 1 What is OpenStack Cloud Software? A series of interrelated projects that control pools of compute, storage, and networking
More informationPrivate Distributed Cloud Deployment in a Limited Networking Environment
Private Distributed Cloud Deployment in a Limited Networking Environment Jeffrey Galloway, Susan Vrbsky, and Karl Smith The University of Alabama jmgalloway@crimson.ua.edu, vrbsky@cs.ua.edu, smith102@crimson.ua.edu
More informationPriority Pro v17: Hardware and Supporting Systems
Introduction Priority Pro v17: Hardware and Supporting Systems The following provides minimal system configuration requirements for Priority with respect to three types of installations: On-premise Priority
More informationAn Experimental Study of Load Balancing of OpenNebula Open-Source Cloud Computing Platform
An Experimental Study of Load Balancing of OpenNebula Open-Source Cloud Computing Platform A B M Moniruzzaman 1, Kawser Wazed Nafi 2, Prof. Syed Akhter Hossain 1 and Prof. M. M. A. Hashem 1 Department
More informationCloud Computing. Chapter 8 Virtualization
Cloud Computing Chapter 8 Virtualization Learning Objectives Define and describe virtualization. Discuss the history of virtualization. Describe various types of virtualization. List the pros and cons
More informationDatasheet FUJITSU Software ServerView Cloud Monitoring Manager V1.0
Datasheet FUJITSU Software ServerView Cloud Monitoring Manager V1.0 Datasheet FUJITSU Software ServerView Cloud Monitoring Manager V1.0 A Monitoring Cloud Service for Enterprise OpenStack Systems Cloud
More informationStorage solutions for a. infrastructure. Giacinto DONVITO INFN-Bari. Workshop on Cloud Services for File Synchronisation and Sharing
Storage solutions for a productionlevel cloud infrastructure Giacinto DONVITO INFN-Bari Synchronisation and Sharing 1 Outline Use cases Technologies evaluated Implementation (hw and sw) Problems and optimization
More informationSTeP-IN SUMMIT 2013. June 18 21, 2013 at Bangalore, INDIA. Performance Testing of an IAAS Cloud Software (A CloudStack Use Case)
10 th International Conference on Software Testing June 18 21, 2013 at Bangalore, INDIA by Sowmya Krishnan, Senior Software QA Engineer, Citrix Copyright: STeP-IN Forum and Quality Solutions for Information
More informationHow To Use Arcgis For Free On A Gdb 2.2.2 (For A Gis Server) For A Small Business
Esri Middle East and Africa User Conference December 10 12 Abu Dhabi, UAE Understanding ArcGIS in Virtualization and Cloud Environments Marwa Mabrouk Powerful GIS capabilities Delivered as Web services
More informationCopyright 1999-2011 by Parallels Holdings, Ltd. All rights reserved.
Parallels Virtuozzo Containers 4.0 for Linux Readme Copyright 1999-2011 by Parallels Holdings, Ltd. All rights reserved. This document provides the first-priority information on Parallels Virtuozzo Containers
More informationUsing SUSE Cloud to Orchestrate Multiple Hypervisors and Storage at ADP
Using SUSE Cloud to Orchestrate Multiple Hypervisors and Storage at ADP Agenda ADP Cloud Vision and Requirements Introduction to SUSE Cloud Overview Whats New VMWare intergration HyperV intergration ADP
More informationPARALLELS CLOUD SERVER
PARALLELS CLOUD SERVER Performance and Scalability 1 Table of Contents Executive Summary... Error! Bookmark not defined. LAMP Stack Performance Evaluation... Error! Bookmark not defined. Background...
More informationSUSE Cloud 5 Private Cloud based on OpenStack
SUSE Cloud 5 Private Cloud based on OpenStack Michał Jura Senior Software Engineer Linux HA/Cloud Developer mjura@suse.com 2 New solutions emerge: Infrastructure-as-Service Cloud = 3 SUSE Cloud Why OpenStack?
More informationFINANCIAL SERVICES BOARD
PROVISIONING OF AN ICT SERVICE MANAGEMENT SOLUTION The following questions were received by the Financial Services Board on bid FSB2013/011 and are answered accordingly: QUESTION 1 The bid response format
More informationLaCie 5big Backup Server
LaCie 5big Backup Server DESIGN BY NEIL POULTON Centralized Backup Appliance for Small Businesses Back Up 10 PCs and 25 Macs 10TB * Gigabit Ethernet The Right Backup Solution for Small Business Delivering
More informationIntroduction 1 Performance on Hosted Server 1. Benchmarks 2. System Requirements 7 Load Balancing 7
Introduction 1 Performance on Hosted Server 1 Figure 1: Real World Performance 1 Benchmarks 2 System configuration used for benchmarks 2 Figure 2a: New tickets per minute on E5440 processors 3 Figure 2b:
More informationBUILDING OF A DISASTER RECOVERY FRAMEWORK FOR E-LEARNING ENVIRONMENT USING PRIVATE CLOUD COLLABORATION
BUILDING OF A DISASTER RECOVERY FRAMEWORK FOR E-LEARNING ENVIRONMENT USING PRIVATE CLOUD COLLABORATION Satoshi Togawa 1 and Kazuhide Kanenishi 2 1 Faculty of Management and Information Science, Shikoku
More informationHadoop on OpenStack Cloud. Dmitry Mescheryakov Software Engineer, @MirantisIT
Hadoop on OpenStack Cloud Dmitry Mescheryakov Software Engineer, @MirantisIT Agenda OpenStack Sahara Demo Hadoop Performance on Cloud Conclusion OpenStack Open source cloud computing platform 17,209 commits
More informationHP Reference Architecture for OpenStack on Ubuntu 14.04 LTS
Technical white paper HP Reference Architecture for OpenStack on Ubuntu 14.04 LTS Table of contents Acknowledgements... 2 Overview... 2 About OpenStack... 2 Purpose of this reference architecture... 2
More informationCBE Architectural Overview and System Requirements
CBE Architectural Overview and System Requirements January 2015 ARCHITECTURAL OVERVIEW ARCHITECTURAL OVERVIEW EXAMPLE OF CBE SOFTWARE INSTALLATION The following diagram shows the users, programs in use
More informationDescription of Application
Description of Application Operating Organization: Coeur d Alene Tribe, Plummer, Idaho Community of Interest: U.S. Indian tribes and their governments; rural governments OS and software requirements: Microsoft
More informationSURFsara HPC Cloud Workshop
SURFsara HPC Cloud Workshop doc.hpccloud.surfsara.nl UvA workshop 2016-01-25 UvA HPC Course Jan 2016 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current
More informationCisco is a registered trademark or trademark of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.
Legal Notices Copyright 1999, 2009 BMC Software, Inc. Copyright 1996-2014 Numara Software, Inc. BMC, BMC Software, and the BMC Software logo are the exclusive properties of BMC Software, Inc., are registered
More informationDéployer son propre cloud avec OpenStack. GULL 18.11.2014 François Deppierraz francois.deppierraz@nimag.net
Déployer son propre cloud avec OpenStack GULL francois.deppierraz@nimag.net Who Am I? System and Network Engineer Stuck in the Linux world for almost 2 decades Sysadmin who doesn't like to type the same
More informationSystem Requirements Table of contents
Table of contents 1 Introduction... 2 2 Knoa Agent... 2 2.1 System Requirements...2 2.2 Environment Requirements...4 3 Knoa Server Architecture...4 3.1 Knoa Server Components... 4 3.2 Server Hardware Setup...5
More informationWhy Choose Desktop as a Service (DaaS)? A TCO Study
Why Choose Desktop as a Service (DaaS)? A TCO Study by Warning: reading and acting on the advice in this document could save you 25% of your current desktop service delivery costs Introduction Physical
More informationThe deployment of OHMS TM. in private cloud
Healthcare activities from anywhere anytime The deployment of OHMS TM in private cloud 1.0 Overview:.OHMS TM is software as a service (SaaS) platform that enables the multiple users to login from anywhere
More informationStorPool Distributed Storage Software Technical Overview
StorPool Distributed Storage Software Technical Overview StorPool 2015 Page 1 of 8 StorPool Overview StorPool is distributed storage software. It pools the attached storage (hard disks or SSDs) of standard
More informationNetwork Station - Thin Client Computing - Overview
Network Station - Thin Client Computing - Overview Overview The objective of this document is to help develop an understanding of a Server Based Computing/Thin-Client environment using MS Windows NT 4.0,
More information1.0 Hardware Requirements:
01 - ServiceDesk Plus - Best Practices We appreciate you choosing ServiceDesk Plus for your organization to deliver world-class IT services. Before installing the product, take a few minutes to go through
More informationRally Installation Guide
Rally Installation Guide Rally On-Premises release 2015.1 rallysupport@rallydev.com www.rallydev.com Version 2015.1 Table of Contents Overview... 3 Server requirements... 3 Browser requirements... 3 Access
More informationUbuntu and Hadoop: the perfect match
WHITE PAPER Ubuntu and Hadoop: the perfect match February 2012 Copyright Canonical 2012 www.canonical.com Executive introduction In many fields of IT, there are always stand-out technologies. This is definitely
More informationRelease Notes for Fuel and Fuel Web Version 3.0.1
Release Notes for Fuel and Fuel Web Version 3.0.1 June 21, 2013 1 Mirantis, Inc. is releasing version 3.0.1 of the Fuel Library and Fuel Web products. This is a cumulative maintenance release to the previously
More informationMicrosoft Hyper-V chose a Primary Server Virtualization Platform
Roger Shupert, Integration Specialist } Lake Michigan College has been using Microsoft Hyper-V as it s primary server virtualization platform since 2008, in this presentation we will discuss the following;
More informationNutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure
Nutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure with VMware vsphere 5 and View 5 Table of Contents 1. Executive Summary...1 2. Introduction to Project Colossus...2 2.1.
More informationMEGA Web Application Architecture Overview MEGA 2009 SP4
Revised: September 2, 2010 Created: March 31, 2010 Author: Jérôme Horber CONTENTS Summary This document describes the system requirements and possible deployment architectures for MEGA Web Application.
More informationPARALLELS SERVER BARE METAL 5.0 README
PARALLELS SERVER BARE METAL 5.0 README 1999-2011 Parallels Holdings, Ltd. and its affiliates. All rights reserved. This document provides the first-priority information on the Parallels Server Bare Metal
More informationSYNNEFO: A COMPLETE CLOUD PLATFORM OVER GOOGLE GANETI WITH OPENSTACK APIs VANGELIS KOUKIS, TECH LEAD, SYNNEFO
SYNNEFO: A COMPLETE CLOUD PLATFORM OVER GOOGLE GANETI WITH OPENSTACK APIs VANGELIS KOUKIS, TECH LEAD, SYNNEFO 1 Synnefo cloud platform An all-in-one cloud solution Written from scratch in Python Manages
More informationGetting Started with OpenStack and VMware vsphere TECHNICAL MARKETING DOCUMENTATION V 0.1/DECEMBER 2013
Getting Started with OpenStack and VMware vsphere TECHNICAL MARKETING DOCUMENTATION V 0.1/DECEMBER 2013 Table of Contents Introduction.... 3 1.1 VMware vsphere.... 3 1.2 OpenStack.... 3 1.3 Using OpenStack
More informationNebula Cloud Computing Project: Background, Technology, Operations, Challenges, and Status
Nebula Cloud Computing Project: Background, Technology, Operations, Challenges, and Status Raymond G. O Brien ARC CTO for IT Nebula Background Nebula cloud project evolved from a web app platform development
More informationCloud on TEIN Part I: OpenStack Cloud Deployment. Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University
Cloud on TEIN Part I: OpenStack Cloud Deployment Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University Outline Objectives Part I: OpenStack Overview How OpenStack
More informationHow To Use Mindarray For Business
Minder Network Performance Monitoring Monitor everything about your Network performance Discover, visualize and monitor your complete IT Infrastructure in less than an hour. Mindarray s Minder is a powerful
More informationVirtual Desktops Security Test Report
Virtual Desktops Security Test Report A test commissioned by Kaspersky Lab and performed by AV-TEST GmbH Date of the report: May 19 th, 214 Executive Summary AV-TEST performed a comparative review (January
More informationServervirualisierung mit Citrix XenServer
Servervirualisierung mit Citrix XenServer Paul Murray, Senior Systems Engineer, MSG EMEA Citrix Systems International GmbH paul.murray@eu.citrix.com Virtualization Wave is Just Beginning Only 6% of x86
More informationPart 1 - What s New in Hyper-V 2012 R2. Clive.Watson@Microsoft.com Datacenter Specialist
Part 1 - What s New in Hyper-V 2012 R2 Clive.Watson@Microsoft.com Datacenter Specialist Microsoft Cloud OS Vision Public Cloud Azure Virtual Machines Windows Azure Pack 1 Consistent Platform Windows Azure
More informationOutline. Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models
1 2 Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 3 Introduction What is Virtualization Station? Allows users to create and operate
More informationGEM Network Advantages and Disadvantages for Stand-Alone PC
Possible Configurations Turns your Contacts into a Business Network focussed on you GEM can be configured to run in many different ways. From simple stand-alone PC s or Mac s, through Client Server on
More informationVirtual Server and Storage Provisioning Service. Service Description
RAID Virtual Server and Storage Provisioning Service Service Description November 28, 2008 Computer Services Page 1 TABLE OF CONTENTS INTRODUCTION... 4 VIRTUAL SERVER AND STORAGE PROVISIONING SERVICE OVERVIEW...
More informationHow To Use Openstack On Your Laptop
Getting Started with OpenStack Charles Eckel, Cisco DevNet (eckelcu@cisco.com) Agenda What is OpenStack? Use cases and work loads Demo: Install and operate OpenStack on your laptop Getting help and additional
More informationSUSE Cloud Installation: Best Practices Using an Existing SMT and KVM Environment
Best Practices Guide www.suse.com SUSE Cloud Installation: Best Practices Using an Existing SMT and KVM Environment Written by B1 Systems GmbH Table of Contents Introduction...3 Use Case Overview...3 Hardware
More informationWith Red Hat Enterprise Virtualization, you can: Take advantage of existing people skills and investments
RED HAT ENTERPRISE VIRTUALIZATION DATASHEET RED HAT ENTERPRISE VIRTUALIZATION AT A GLANCE Provides a complete end-toend enterprise virtualization solution for servers and desktop Provides an on-ramp to
More informationTips for getting started! with! Virtual Data Center!
Tips for getting started with Virtual Data Center Last Updated: 1 July 2014 Table of Contents Safe Swiss Cloud Self Service Control Panel 2 Please note the following about for demo accounts: 2 Add an Instance
More informationEMC Smarts SAM, IP, ESM, MPLS, NPM, OTM, and VoIP Managers 9.4.1 Support Matrix
EMC Smarts SAM, IP, ESM, MPLS, NPM, OTM, and VoIP Managers 9.4.1 Version 9.4.1.0 302-002-262 REV 01 Abstract Smarts 9.4.1 Suite can be installed in a typical or a fully distributed, multi-machine production
More informationVirtzone Cloud Control User Guide
Virtzone Cloud Control User Guide August 2013 Table of Contents 1. What is Virtzone Cloud Control?... 3 2. What this document covers... 3 This document covers the basic steps required to log on to and
More informationAdvancement in Virtualization Based Intrusion Detection System in Cloud Environment
Advancement in Virtualization Based Intrusion Detection System in Cloud Environment Jaimin K. Khatri IT Systems and Network Security GTU PG School, Ahmedabad, Gujarat, India Mr. Girish Khilari Senior Consultant,
More informationTechnical Brief. Userful Multiplatform Desktop Virtualization Software
Technical Brief Userful Multiplatform Desktop Virtualization Software 11.04.2014 SUMMARY: This Technical Brief will summarize the installation and set up of Userful Multiplatform desktop virtualization
More informationBuilding a Penetration Testing Virtual Computer Laboratory
Building a Penetration Testing Virtual Computer Laboratory User Guide 1 A. Table of Contents Collaborative Virtual Computer Laboratory A. Table of Contents... 2 B. Introduction... 3 C. Configure Host Network
More informationJOB ORIENTED VMWARE TRAINING INSTITUTE IN CHENNAI
JOB ORIENTED VMWARE TRAINING INSTITUTE IN CHENNAI Job oriented VMWARE training is offered by Peridot Systems in Chennai. Training in our institute gives you strong foundation on cloud computing by incrementing
More informationDeploying workloads with Juju and MAAS in Ubuntu 13.04
Deploying workloads with Juju and MAAS in Ubuntu 13.04 A Dell Technical White Paper Kent Baxley Canonical Field Engineer Jose De la Rosa Dell Software Engineer 2 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES
More informationRED HAT ENTERPRISE VIRTUALIZATION 3.0
OVERVIEW Red Hat Enterprise Virtualization (RHEV) is a complete virtualization management solution for server and desktop virtualization and the first enterprise-ready, fully open-source virtualization
More informationA PERFORMANCE ANALYSIS of HADOOP CLUSTERS in OPENSTACK CLOUD and in REAL SYSTEM
A PERFORMANCE ANALYSIS of HADOOP CLUSTERS in OPENSTACK CLOUD and in REAL SYSTEM Ramesh Maharjan and Manoj Shakya Department of Computer Science and Engineering Dhulikhel, Kavre, Nepal lazymesh@gmail.com,
More informationPARALLELS SERVER 4 BARE METAL README
PARALLELS SERVER 4 BARE METAL README This document provides the first-priority information on Parallels Server 4 Bare Metal and supplements the included documentation. TABLE OF CONTENTS 1 About Parallels
More informationPortal for ArcGIS. Satish Sankaran Robert Kircher
Portal for ArcGIS Satish Sankaran Robert Kircher ArcGIS A Complete GIS Data Management Planning & Analysis Field Mobility Operational Awareness Constituent Engagement End to End Integration Collect, Organize,
More informationWhite Paper. Recording Server Virtualization
White Paper Recording Server Virtualization Prepared by: Mike Sherwood, Senior Solutions Engineer Milestone Systems 23 March 2011 Table of Contents Introduction... 3 Target audience and white paper purpose...
More informationCisco Intelligent Automation for Cloud
Product Data Sheet Cisco Intelligent Automation for Cloud Early adopters of cloud-based service delivery were seeking additional cost savings beyond those achieved with server virtualization and abstraction.
More informationCLOUD COMPUTING & SECURITY -A PRACTICAL APPROACH
CLOUD COMPUTING & SECURITY -A PRACTICAL APPROACH ORGANIZED BY र ट र य इल क ट र नक एव स चन प र य गक स थ न, ग रखप र National Institute of Electronics and Information Technology (NIELIT) Gorakhpur An Autonomous
More informationAn Intro to OpenStack. Ian Lawson Senior Solution Architect, Red Hat ilawson@redhat.com
An Intro to OpenStack Ian Lawson Senior Solution Architect, Red Hat ilawson@redhat.com What is OpenStack? What is OpenStack? Fully open source cloud operating system Comprised of several open source sub-projects
More information