an insight into systems from acquisition to dissemination



Similar documents
Archiving and Managing Remote Sensing Data Using State of the Art Storage Technologies

ARCHIVING AND MANAGING REMOTE SENSING DATA USING STATE OF THE ART STORAGE TECHNOLOGIES

Vinay K Dadhwal Director. 50 th Session of Scientific & Technical Subcommittee of COPUOS, Feb., 2013, Vienna

Implementing a Digital Video Archive Based on XenData Software

SAN TECHNICAL - DETAILS/ SPECIFICATIONS

Astrium GEO UK Multi-Mission PDGS Facilities and Services

Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software

RFP - Equipment for the Replication of Critical Systems at Bank of Mauritius Tower and at Disaster Recovery Site. 06 March 2014

Solution Brief: Creating Avid Project Archives

Thematic Unit of Excellence on Computational Materials Science Solid State and Structural Chemistry Unit, Indian Institute of Science

Appendix 3. Specifications for e-portal

UN 4013 V - Virtual Tape Libraries solutions update...

Implementing a Digital Video Archive Using XenData Software and a Spectra Logic Archive

Massive SAN Backups. HP World 2002 Los Angeles, CA September, 2002 Denys Beauchemin. The Innovators. We watch your data

Patriot Hardware and Systems Software Requirements

CONSTRUCTION / SERVICE BILLING SYSTEM SPECIFICATIONS

HITACHI VIRTUAL STORAGE PLATFORM FAMILY MATRIX

Arkivum's Digital Archive Managed Service

Implementing Offline Digital Video Storage using XenData Software

Bhuvan. Indian Earth Observation Visualization. Indian Space Research Organisation. Multi Resolution. Societal Applications

Matthew Parker Chief Technologist Dimensional DBA, LLC

XenData Product Brief: SX-550 Series Servers for LTO Archives

IBM TSM DISASTER RECOVERY BEST PRACTICES WITH EMC DATA DOMAIN DEDUPLICATION STORAGE

Keys to Successfully Architecting your DSI9000 Virtual Tape Library. By Chris Johnson Dynamic Solutions International

Data Information and Management System (DIMS) The New DIMS Hardware

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007

NETGEAR SMB Storage Line Update and ReadyNAS 2100 Introduction

New Cluster-Ready FAS3200 Models

25 Years of Indian Remote Sensing Satellite (IRS) Series

Tier 2 Nearline. As archives grow, Echo grows. Dynamically, cost-effectively and massively. What is nearline? Transfer to Tape

Data Management using Hierarchical Storage Management (HSM) with 3-Tier Storage Architecture

Product Brief: XenData X2500 LTO-6 Digital Video Archive System

Solid State Storage in the Evolution of the Data Center

Best in Class Storage Solutions for BS2000/OSD

Computer System. Chapter Introduction

(Scale Out NAS System)

EMC VNX FAMILY. Copyright 2011 EMC Corporation. All rights reserved.

ETERNUS Storage Systems. Fujitsu America Inc

M.Sc. IT Semester III VIRTUALIZATION QUESTION BANK Unit 1 1. What is virtualization? Explain the five stage virtualization process. 2.

IBM Smart Business Storage Cloud

Comparison of Native Fibre Channel Tape and SAS Tape Connected to a Fibre Channel to SAS Bridge. White Paper

The safer, easier way to help you pass any IT exams. Exam : Storage Sales V2. Title : Version : Demo 1 / 5

HP Store Once. Backup to Disk Lösungen. Architektur, Neuigkeiten. rené Loser, Senior Technology Consultant HP Storage Switzerland

HPC Update: Engagement Model

Extreme Scalability and Flexibility for Content Management Throughout Its Lifecycle

Backup and Recovery Redesign with Deduplication

XenData Video Edition. Product Brief:

Study of virtual data centers for cost savings and management

HITACHI VIRTUAL STORAGE PLATFORM FAMILY MATRIX

CHESS DAQ* Introduction

Deploying and managing a Visualization Onera

EO Applications in India for governance & citizens

The Archival Upheaval Petabyte Pandemonium Developing Your Game Plan Fred Moore President

All India Institute of Medical Sciences, Bhubaneswar Sijua, Bhubaneswar, Odisha

INDIAN INSTITUTE OF TECHNOLOGY KANPUR Department of Mechanical Engineering

The skinny on storage clusters

Intro to AWS: Storage Services

Energy Efficient Storage - Multi- Tier Strategies For Retaining Data

Sun Constellation System: The Open Petascale Computing Architecture

DPAD Introduction. EMC Data Protection and Availability Division. Copyright 2011 EMC Corporation. All rights reserved.

XenData Product Brief: SX-250 Archive Server for LTO

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

THE SUN STORAGE AND ARCHIVE SOLUTION FOR HPC

XenData Video Edition. Product Brief:

Tape Storage at Sun. Dwayne Edling Manager Archive Development Sun Microsystems, Inc.

OAISYS and Toshiba: Call Recording Solution Configuration. An OAISYS White Paper

Netapp HPC Solution for Lustre. Rich Fenton UK Solutions Architect

Fujitsu PRIMERGY Servers Portfolio

Certification Document macle GmbH Grafenthal-S1212M 24/02/2015. macle GmbH Grafenthal-S1212M Storage system

Enable Data Collaboration Through Powerful Storage Efficiencies

CONVERGED VIRTUAL STORAGE

Cost Effective Backup with Deduplication. Copyright 2009 EMC Corporation. All rights reserved.

Document Control Sheet

Avaya Call Recording Solution Configuration

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC

Benefits of Networked Storage: iscsi & Fibre Channel SANs. David Dale, NetApp

FlexArray Virtualization

PROPRIETARY CISCO. Cisco Cloud Essentials for EngineersV1.0. LESSON 1 Cloud Architectures. TOPIC 1 Cisco Data Center Virtualization and Consolidation

A Virtual Tape Library Architecture & Its Benefits

ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013

Budget code: Atlas Project ID 71598; activity 1; budget line To the Project Manager of the ORASECOM Project.

Protect Data... in the Cloud

EMC DATA PROTECTION. Backup ed Archivio su cui fare affidamento

Cisco for SAP HANA Scale-Out Solution on Cisco UCS with NetApp Storage

Ignify ecommerce. Item Requirements Notes

Infortrend ESVA Cluster File System Competitor Analysis

Globus and the Centralized Research Data Infrastructure at CU Boulder

A value-added service and solutions company focused on media-optimized, data storage-intensive workflows. SAN Scale-Out NAS Data Protection

Data Centre of the Future

Application Note. Configuring a NEO Tape Library with Symantec Backup Exec and NetApp NDMP Environment. Technical Bulletin. November 2013.

Avid ISIS v4.7.7 Performance and Redistribution Guide

præsentation oktober 2011

Hosting Solutions Made Simple. Managed Services - Overview and Pricing

Large Scale Storage. Orlando Richards, Information Services LCFG Users Day, University of Edinburgh 18 th January 2013

Technology Insight Series

CONTRACTING AUTHORITY'S CLARIFICATIONS

Microsoft Exchange 2010 on Dell Systems. Simple Distributed Configurations

10th TF-Storage Meeting

Virtualization, Business Continuation Plan & Disaster Recovery for EMS -By Ramanj Pamidi San Diego Gas & Electric

Technical Support Services Contract Solicitation G14PS00053 Questions and Responses from EROS Site Visits December 2, 2014

Transcription:

an insight into systems from acquisition to dissemination P Shasidhar Reddy Manager Computer Systems National Remote Sensing Centre

Satellite data acquisition planning, reception, processing and dissemination for various Indian and foreign satellites Systematic archival of remote sensing data Providing geospatial solutions to various user agencies Support to disaster monitoring and management Online visualization and download services for Online visualization and download services for satellite data and thematic information

Antarctica Data Reception Station Overall picture Data Reception at IGS 3D Visualization Lab IMGEOS Data Reception Data Processing Systems Data Storage & Archival UOPS Automation Systems FTP Delivery Disaster Management Support Programme Natural resource management & geospatial applications IMGEOS Bhuvan Users Users

Design Philosophy Complete Chain Automation Always on No Single point of failure Optimal redundancies Satellite data available online Environment friendly Green Data Centre Energy efficient systems Green Building Solar Power Generation

IMGEOS Architecture Diagram Gigabit Ethernet Antennas (4) Station Automation DI (4) ADP (3) ADIF Server DPS (17) Browse (1) 1. Workflow (2) 2. Scheduler (3) Hierarchical Storage Management System SAN Infrastructure with 100TB FC & 400TB SATA Tape Library FC Web Server (2) UOPS (2) Failure Analysis ( 2) Data Screening (5) Workstations PQC (10) DQE (6) Workstations VADS (10) User Services(5) Workstations Media generation Workstations (5) Data Exchange Gateway & Firewall FTP Server (2) PPS (2) Gigabit Ethernet Cat -II Cat -I Cat -IV Cat -III Workstation DI Direct Ingest, ADP- Ancillary Data Processing, DPS- Data Processing System, PQC- Prod Quality Check, DQE- Data Quality Eval, PPS- Payload Pass Prog, ADIF- Ancillary Data Infor Format. 5

.architecture continued Total of 60 multi-core Servers Tier-3 Data Center Entire enterprise is based on RHEL Dynamic work order scheduling Data processing on compute clusters 3 tier SAN storage N+1 redundant architecture Tier-1 with 100TB HS storage Tier-2 with 400TB MS storage Tier-3 Online TapeLibrary of 3 PB StorNext Filesystem for shared access with a Global name space. Three copies of data are kept online. One copy of data is kept in Vaults

IMGEOS STORAGE ARCHITECTURE.architecture continued 100TB FC SAN Disk Storage 400TB SATA SAN 3 PB Tape Library Hierarchical Storage Management DMX-4 FC Disks RAID 5 / 1+0 16 FC Ports 2 Nos of CX-4 480 SATA Disks RAID 5 16 FC Ports SL 8500 TapeLibrary 3000 Slots LTO-6 Tapes 16 Drives 8 Robotic Arms

NDEM System Infrastructure Decision Support Centre National Database for Servers:- 11 Emergency Mgt. Workstations :- 23 NetApp FAS 3140 Unified storage Dual ACT-ACT Controllers FC and SAS Storage Total Usable Capcity ~ 15 TB National Database for Hazard Zonation & Early Warning VPN Communications Decision Support System Virtual Private Network for Disaster Management Flood Management Cyclone warning NRSC Drought Monitoring Landslide Hazard Zonation

RSA Systems Infrastructure 15 servers 10TB IBM NAS Gateway 300 39TB NetApp FAS 3140 Unified storage VTL Capacity ~ 20 TB LTO4 Tape Library with 2 Drives Softwares ERDAS, ArcGIS, ENVI-IDL, MATLAB, E-Cognition, Sarscape, PCI Geomatica, Autodesk, MIKE, etc Atmospheric Studies 1 TFLOP HPC 136 core Xeon based HPC Cluster Compute Nodes: - 8* 2 CPU Total Memory:- 384 GB PFS Storage capacity:- 10 TB Natural Resources Census Land use/ Land cover map Wasteland Mapping Inventory of Natural Resources & Periodic monitoring Forest Cover Mapping Snow/ Glacier Mapping Snow-melt Runoff Forecasting Glacier Retreat Study Total wastelands in the country Wasteland Atlas Digital database Forest Survey of India 1987 onwards (Landsat MSS to IRS LISS III) 1:50,000 scale

Visualisation Data Archive Thematic Services Geo-Processing

U ID 17 18 19 20 R e se t 4G b S A N S w itch 21 22 23 0 U ID 17 18 19 20 R e se t 4G b S A N S w itch 21 22 23 0 Internet Router BHUVAN ARCHITECTURE Firewall Active- Passive Load Balancer ftp Server Web Server C-7000 Blade Chassis Potlatch, Forum, TG & SFS 2D App NUIS, MDS DBS CAS, DP, Geo Pan, Geo pro Mapper, Smartrack, NOEDA SM Dev/ staging Load Balancer Active -Passive Redundant SAN Switches for High Availability Back up Tape Library No Single Point of Failure with multiple paths to SAN Storage 30TB HP EVA4400 SAN Storage

Ensures full immersion for 5 persons. Collaborative mode for concurrent control using gestures over 46 multi-touch table. Create animations and fly-throughs. Integrate 3D models of structures. Supports all standard raster and vector formats.

Back

All Current Data Linear Tape-Open (LTO) (most widely being used archival media) Native Capacity drives used at NRSC: 1.5TB; 1/2 width, 1280 tracks, 384kbpi RS-1 Carto-1 Carto-2 Landsat 1A / 1B 1C / 1D Digital Linear Tape (DLT) Native Capacity of the drives used at NRSC: 35GB / 160GB; ½ width, 256/ 896 tracks, 86/ 219kbpi High Density Digital Tape (HDT) (Now obsolete) Native Capacity of the drives used at NRSC: 10GB; 1 width 28 tracks, 33Kbpi, magnetic tape spool; Used for archiving IRS- 1A/1B/1C/1D/Landsat raw data; Data rate: up to 12MBps; Manual loading Used for archiving Resourcesat 1 & 2, Cartosat 1 & 2 raw data; Data rate: 5/40 MBps; Untouched tape Used for archiving all current satellites raw data under IMGEOS; Data Rate: upto 140MBps; Untouched tape 1970 s 1990 s Late 90 s 2011 2011 date