GeoManitoba Spatial Data Infrastructure Update Presented by: Jim Aberdeen Shawn Cruise
Organization Overview Manitoba Innovation Energy and Mines Business Transformation and Technology (BTT) Application Development and Integration (New) Application Management Services (Support) Infrastructure Management Services BTT - IT provider for the Province of Manitoba procurement, installation, maintenance, technical support, enhancement, upgrade, hardware, software and services negotiating services, licences and maintenance and support agreements for hardware and software.
Presentation Overview Spatial Data Infrastructure Data Architecture Map Services Performance Testing Scalable Architecture Geoportal Server
Project Description Overview The purpose for the Spatial Data Infrastructure (SDI) project is to design, build and implement a SDI that provides access to the provincial spatial framework, its users and its stakeholders. SDI Project has a Two-Stream Approach Management Framework SDI Core
Spatial Data Infrastructure
Data Architecture Department Operational Data maintained on the file system or preferably in an Enterprise Geodatabase Staging Area Area to review datasets before release (Internal) Spatial Data Warehouse Restricted to Internal Government consumers (External) Publication Data Warehouse Available for external consumption
Data Architecture
Map Services GIS analyst creates maps. Maps are published to ArcGIS Server as map services. Map services are delivered as web services to be consumed by many different client applications. Desktop computers Tablets Smartphones Map services can be dynamic or cached.
Map Services Dynamic map services read from the data store on each map request. Cached map services respond to map requests using a hierarchical set of image tiles.
Map Services Demo
Performance Testing Map service looks fine and loads fast, but how will it perform under load? Use Web Performance testing tools offered by Microsoft Visual Studio Ultimate. Define performance testing parameters How many users? What types of requests? Frequency of requests? Criteria for failure? Criteria for success?
Performance Testing Map service requests are URLs with parameters Bounding box parameter can be changed to request different extents Determine test area and generate random extents Group similar extents into web tests Assign a priority to each test
Performance Testing 50 users Half second average response time About 4 requests per second About 15 KB per map
Performance Testing
Performance Testing Slow! Fast!
Performance Testing Each row represents a virtual user. Length of bar is wait request time. Gaps are specified think time.
Performance Testing CPU utilization spikes are indicators of an inefficient map service. CPU utilization graphs should be smooth under load. Blue is number of users. Red is CPU utilization on ArcGIS Server. Orange is CPU utilization on ArcSDE.
Performance Testing Cause: Delay drawing large area under load Effect: Impacts otherwise fast response times Each color represents a test. X is time, Y is request service time.
Performance Testing Load test results suggest problems with map service as defined when displaying a larger area. ArcGIS Server and ArcSDE working too hard because of map service inefficiencies. Need to use tool like MXDPerfStat to improve map performance. Infrastructure resources must be conserved for other map services.
Scalable Architecture ArcGIS Server 10.1 is designed for scalability. Servers can be organized into groups called clusters. Infrastructure can be optimized for cluster s services. System architecture abstracts details from the end user.
Scalable Architecture
Scalable Architecture
Scalable Architecture
Scalable Architecture
Scalable Architecture
Esri Geoportal Server Free, open source product that enables discovery and use of geospatial resources including datasets, rasters, and Web services. With Geoportal Server you can: Reduce time and redundancy Maintain data integrity Enable easy search and discovery
Esri Geoportal Server Demo
Q & A jim.aberdeen@gov.mb.ca shawn.cruise@gov.mb.ca