I G E O N - I N D I A, Status Report - Sep, INDIA STATUS REPORT - SEPTEMBER 2007

Transcription

1 I G E O N - I N D I A, Status Report - Sep, 2007 I -INDIA STATUS REPORT - SEPTEMBER 2007 San Diego Supercomputer Center, UCSD, San Diego & University of Hyderabad, India Abstract As part of its international activities, the Geosciences Network project has initiated collaborations with the University of Hyderabad, India. This effort called, igeon-india, is funded by the Indo-US Science and Technology Forum. The goal of the project is to promote the use of cyberinfrastructure at participating institutions in India to facilitate the sharing of geosciences data via GEON. The lead institution in India, which is the University of Hyderabad, has deployed a GEON portal at their site in Hyderabad to enable local scientists to register their data sets. This document provides a status report of the tasks accomplished as part of the igeon-india program following the igeon, Geosciences Network Cyberinfrastructure Workshop. Briefly, the main accomplishments include identification and deployment of hardware and system software resources in a distributed grid spanning University of Hyderabad and University of Pune. We identified a third site, Adikavi Nannaya University at Rajahmundry, which would be joining this grid. We also deployed the portal middleware framework at these sites and started developing various tools and applications. ht tp ://hyd ge on.uoh yd.er net.i n ht tp :// eon gri d.org

2 Table of Contents Systems and Middleware Deployment 3 Hardware Deployment 3 Hardware Specification 3 igeon-india Partner Sites 3 Hardware Deployment Process 3 Portal Deployment 4 Software Development Efforts 5 Workshops 7 References and Resources 9 References 9 Contacts 9 Appendix (Screenshots) 10 igeon-india 2 Status Report Sep 2007

3 Systems and Middleware Deployment Hardware Deployment The igeon-india grid is a distributed grid composed of dedicated hardware resources physically located at partner sites spread across India. Each partner site hosts of a minimum of one single igeon-india PoP (Point of Presence) server-class machine: a dual-processor linuxbased server machine running the GEON Software Stack. Some sites may have additional hardware resources and other sites have additional resources that are not dedicated to igeon but are accessible to igeon users. Each igeon PoP provides capabilities to 1. Provide the partner with means to develop and deploy services and serve datasets for the users at their site and for the broader igeon community. 2. Help the partner site integrate local department or campus resources. 3. Provide resources for system-level components (e.g.. data caching, monitoring, etc). Hardware Specification igeon PoP is a server class machine with dual core Intel Xeon processor. It has 4-8 GB RAM and about 200 to 500 GB SAS disk. The server comes with duals gigabit NIC s and redundant power supply. igeon-india Partner Sites GEON Software Stack Gridsphere Portal 2 (With Core GEON Services) Apache Ant Postgres Jakarta Tomcat Proj 4.4.9, Geos Postgis NWS , INCA Tripwire (Rocks Roll) Globus Axis 1.2 JDK 1.4.2_04 (Rocks Roll) The current set of participating sites includes University of Hyderabad and University of Pune. Adikavi Nannaya University at Rajahmundry has been identified as the third partner site that would be joining the igeon-india grid. Hardware Deployment Process Condor and PBS (Rocks Rolls) Trained students from University of Hyderabad were sent to University of Pune. With assistance from the local departments at the university of Pune the students were able to setup the node. They were also able to complete the necessary post installation configuration that enables remote access to this machine from university of Hyderabad. The same set of students will soon be traveling to Rajahmundry to setup the node at Adikavi Nannaya University. igeon-india 3 Status Report Sep 2007

4 Portal Deployment A fundamental objective of the igeon-india project is to develop data sharing frameworks--in the process, identifying best practices and developing capabilities and tools to enable advances in how geoscience research is done. The portal framework, which plays a key role in facilitating this objective, is implemented using GridSphere and a portlet-based framework that provides a uniform authentication environment with access to a rich set of functionality, including the ability to register data and ontologies into the system; smart search capability; access to a variety of geoscience-related tools; access to Grid-enabled geoscience applications; and a customizable private work space from which users have access to the scientific workflow environment, which allows them to easily author and execute processing pipelines for data analysis, modeling, and visualization. The data portal infrastructure deployed at the University of Hyderabad consists of the following components: 1. A Portal Server, which runs the portal software, The system is a rack-mounted, server-class machine with GB raw SAS disk, dual core GHz Intel Xeon processors, 4-8 GB of RAM, dual gigabit network interfaces, and redundant power supplies. The portal server runs the GEON software stack, including the portal software and provides connectivity to and interoperability among the other igeon-india systems. 2. A Data Server, which provides storage and other data management services. This system is also a rack-mounted, server-class machine with dual core GHz Intel Xeon processors. It includes a total of Terabytes of raw drive space. The data nodes are configured with RAID disks in order to deal with unforeseen disk failures. (Note: At this time SRB is running on the Portal server but this will be moved to new Data server as soon as it becomes available) The Portal Server runs the Rocks cluster management software and a standardized GEON software stack, which includes the GEON Portal and its dependent libraries, including software tools developed in the GEON project. The so-called core portal functionality is generic, e.g. search and data ingestion capabilities, and can mostly be leveraged out of the box by other projects. The Data Server provides the capability to host data registered through the portal and also provides other data management services. The Data Server runs the SDSC Storage Resource Broker (SRB) software, which provides a number of built-in data management services. The Data Server could also host additional data management services, e.g. GIS software. The Portal Server can communicate with Web services hosted at remote locations using the standard web service protocols. igeon-india 4 Status Report Sep 2007

5 Software Development Efforts As part of the igeon-india effort a number of software development projects have been identified and undertaken at the university of Hyderabad. Geoinformatics Toolbox: A collection of functions/web services bundled together to provide specific functionality. Services developed will include, o Converting topo maps to shape files Reading appropriate images Filters Thinning algorithm Cleaning of small segments Tracking algorithm Conversion into shape files o o o o o Formatting and Uploading Datasets Geo-referencing Data Raster to Vector Conversion (Shape files) Image Enhancement, Color Image Processing, Image Restoration Analysis of Image: Tone, Shape, Pattern Once developed, these services will be deployed on the igeon PoP and will also be available from the igeon portal. GIS Applications: Some tools are currently being developed using ArcIMS software and google mapping interface. These tools will provide a map interface to remote or local data and provide users with options to either view metadata about the data, download data or view data using ArcIMS interfaces. Registering Data: Many datasets have been identified and will be registered to the igeon-india portal. Other users and scholars will be encouraged to register more data to the portal and make it available to the broader igeon community. Search Distributed Catalogs: We are investigating ways to search and query across catalogs in a distributed portal architecture. This API will provide users the capability to search for datasets and resources across any of the distributed GEON portals including the main GEON portal at SDSC and the igeon-india igeon-india 5 Status Report Sep 2007

6 portal at the University of Hyderabad and possibly any GEON portal deployed in the wide area network. Deploying LiDAR data processing framework: The LiDAR data processing architecture will be deployed at the University of Hyderabad. This includes deploying the cluster, installing partitioned DB2 database with spatial extensions and the LiDAR workflow-processing engine. Authorization functionality in the GEON framework: We are also investigating ways to implement authorization in GEON by extending the Grid Account Management Architecture (GAMA) framework. GAMA provides the basic user authentication in GEON. Apart from the projects listed above a number of other software development projects will be identified and undertaken. Some of these projects could be completed as part of the M.Tech and MCA courses at the participating universities. igeon-india 6 Status Report Sep 2007

7 Workshops The igeon Geosciences Network Cyberinfrastructure Workshop was held at the University of Hyderabad, India, on Aug 3-8, This is the second such workshop in India. The first one was held from October 24-27, The workshop was co-organized by GEON collaborators, Prof. K.V. Subbarao, University Center for Earth and Space Sciences, Prof. Arun Agarwal, Center for Modeling, Simulation, and Design, University of Hyderabad, and GEON PI, Chaitan Baru from San Diego Supercomputing Centre (SDSC). Workshop instructors included SDSC team members Ashraf Memon and Sandeep Chandra. The igeon activity in India is supported by a grant from the Indo- US Science and Technology Forum (IUSSTF), New Delhi. The PIs for this grant are Profs. K V Subbarao and Arun Agarwal (India), and Dr. Chaitan Baru, Prof. Randy Keller, and Prof. Mark Gahegan (US). The theme of the workshop was Networking Indian Geoscience Community through igeon. The workshop highlighted features of GEON and discussed its architecture from programmer/user perspective. This was followed by lab demos. Many domain experts discussed application challenges and need for such an infrastructure. The workshop included establishing a full-fledged GEON node with the Portal middleware infrastructure and a series of lectures on research topics in GEON. The node will be used to register some of the data that is readily available at the University of Hyderabad and also host GIS based applications, tools and services that are developed locally. The workshop concluded with a Panel discussion. Following were some of the observations: Heterogeneity is the hallmark of the workshop: Bringing Computer Scientists, Geoscientists together and making them talk. Need to deal with specific application, field related problems: We cannot have single Universal portal ever. Has to be driven by the contributors. Availability of datasets: There is willingness to share data. Value based processing can be done by researchers, scientists etc. Scientists should register their published work. Agencies to upload their apps, tools and algorithms: This should be possible, except for anything that is patented. Forum for development of standards in a number of areas: E.g. metadata, data formats, and digitization of paper maps, with the ultimate goal to collect and register data from students through projects igeon-india 7 Status Report Sep 2007

8 Well knit community building with support of University of Hyderabad: Linkages/partnership with stake holders. As part of the this effort it was decided to establish igeon-india PoPs at University of Pune and Rajamundary as phase- I of networking (Urban vs Rural). Survey for the kind of datasets to be submitted and served from the igeon- India portal: Including services that can be made available. Next igeon-india Workshop: Can possibly be collocated with Geological Society of India annual meeting. Workshop material is available at: (The igeon-india workshop and the follow up work was funded by the Indo-US technology forum.) igeon-india 8 Status Report Sep 2007

9 References and Resources References Deploying Data Portals, Sandeep Chandra, Kai Lin, Choonhan Youn, Geoinformatics 2007, San Diego, CA. GEON Project, GEON Portal, University of Hyderabad igeon-india Portal, University of Pune igeon-india PoP, Center for Modeling and Simulation Design, University of Hyderabad, University Center for Earth and Space Science, University of Hyderabad. Department of Computer and Information Sciences, University of Hyderabad, Indo-US Science and Technology Forum, A mailing list, igeon-india@geongrid.org has been created and all the Contacts participants from the igeon workshop have been added to this mailing list. The mailing list will be used to discuss various issues. University of Hyderabad Prof. Arun Agarwal (aruncs@uohyd.ernet.in) Prof K. V. Subbarao (subbu@uohyd.ernet.in) Dr. Rajeev Wankar (wankarcs@uohyd.ernet.in) San Diego Supercomputer Center Dr. Chaitan Baru (baru@sdsc.edu) Sandeep Chandra (chandras@sdsc.edu) Ashraf Memon (amemon@sdsc.edu) igeon-india 9 Status Report Sep 2007

10 Appendix (Screenshots) Figure 1: igeon-india Portal Deployed at the University of Hyderabad igeon-india 10 Status Report Sep 2007

11 Figure 2: GIS apps being developed for the igeon-india portal igeon-india 11 Status Report Sep 2007

12 Figure 3: igeon-india sites that have been identified and will be established soon igeon-india 12 Status Report Sep 2007