University of Wisconsin SSEC Datacenter
|
|
|
- Gloria McKenzie
- 7 years ago
- Views:
Transcription
1 University of Wisconsin SSEC Datacenter 2015 McIDAS Users Group Meeting June 8, 2015
2 SSEC Data Center Mission Statement The SSEC Data Center mission is to create and maintain the facilities, human expertise and technology necessary to provide SSEC scientists and collaborators with the highest quality geophysical data in a timely fashion and to provide real-time data access, archive and retrieval services as necessary to support SSEC s scientific programs.
3 SSEC Data Center Provide timely, high quality real-time and archive data, reliably to SSEC scientists and collaborators.
4 Data Center History New building at 1225 W Dayton First 7.3 meter antennas installed Official National Archive 1969 Jan May McIDAS first used in Data Center First SMS-1 data received Routine Archiving began
5 Data Center History 2 nd Generation 3 rd Generation National Hurricane Center Cape Canaveral Johnson Space Center
6 Data Center History 4 th Generation NCDC takes over GOES S4 Supecomputer installed Online archive begins GVAR Era begins International Geostationary Archive begins
7 Current Satellite Real-time Ingest & Distribution GOES-East GOES-East* Metadata inventory GOES-West GOES-West* External Sites SCP to Archive GOES-Test GOES-Test* MTSAT MTSAT* POES-Wallops POES-Gilmore ADDE Client server Requests http/ftp/wms server ldm University Community MSG MSG* FY2, Kalpana, COMS FY2, Kalpana, COMS ADDE Client server Requests Monitoring and Data QC DDS Polar Landsat-8 NFS mount direct access Internal Individuals (Interactive and automated product generation) *Live back up
8 SSEC Data Center Staffed M-F, 7:30 AM - 11:00 pm Central time. 3 FTE ~100% time Computer Operator (1 st shift) Computer Operator (1 st shift) Research Intern 5 FTE ~portions of their time Program Manager System Programmer Data Base Programmer Research Specialist (PM assistant) Antenna/Communication technician 2 Student programmers 2 student QC assistants (2 nd shift)
9 Data Center Facilities Over 2100 ft. Currently the Data Center has 44 racks representing over 1840 rack units of space. The Data Center s disk storage exceed 8 PBs. The entire room is on three 72 KW UPSs, of which, about 155 KW are in use. Non UPS power usage is ~17 KW. An additional 72 KW UPS for a smaller 5 th floor computer room Cooling provided by campus chilled water and outside air in the winter. Racks are cooled by 16 in row APC coolers. Gigabit and 10 Gigabit network (also 100 MB admin network, 40 Gigabit InfiniBand).
10 Server room layout SIPS System Research Clusters Shared Systems Real-time ingest, process, and distribution Research Clusters Shared Systems S4 Compute cluster
11 S4 Supercomputing Cluster Total compute: 3072 cores, 8TB memory Total storage: 456 TB 40 Gigabit/s InfiniBand Network Interconnect Funded by the NOAA & used by NOAA and UW researchers to run data assimilation experiments The system was designed, installed, and is maintained by the UW SSEC Technical Computing Group. S4 expansion complete. Additional 1600 cores, 10 TB memory and 1 PB storage.
12 C-Band 11 meter heated (87 West SES-2, POES Wallops Relay, MSG) 7.3 meter backup (101 West SES-1, POES Fairbanks Relay, MTSAT, Noaaport) 6.3 meter heated (101 West SES-1, POES Fairbanks Relay, MTSAT, Noaaport) L-Band 7.3 meter (75 West GOES-East Primary) 4.6 meter (135 West GOES-West Primary) 4.5 meter (60 West GOES-SA auto tracking) 4.5 meter (90 West GOES-test/spare) 3.7 meter (offline spare) X-Band 4.4 meter (Tracking EOS) X/L Band 2.4 meter (Tracking Suomi NPP, EOS, Metop A&B, NOAA-18, 19 and FY3)
13 SSEC Data Center Incoming Data May, GB/day via Satellite (C-band. L-band, X-band) GOES satellites ~96 GB/day International Geo Satellites ~360 GB/day NOAA Polar ~27 GB/day Landsat-8 ~50 GB/day Miscellaneous Polar and Non satellite ~85 GB/day MODIS polar from NASA archive ~150 GB/day NPP (VIIRS CrIS ATMS) ~1,800 GB/day 2,300+ GB/day via Internet (ftp, LDM, ADDE, http)
14 SSEC Data Center Outgoing Data Four primary methods of Data delivery 1.ADDE 2.HTTP 3.FTP 4.LDM (Unidata local data manager) ADDE HTTP LDM FTP
15 Outgoing Data May 2015 On average over 890,000 ADDE transactions per day Over 2.2 TB data distributed per day via ADDE In addition over 1 TB data distributed via ftp, http, and ldm
16 Real-time Data The SSEC Data Center receives data from 12 different geostationary satellites and 11 different polar orbiting satellites. Most data are available in near real-time via ADDE. Other methods of data access are available upon request.
17 Geostationary Satellites received GOES-13 -East (75 W) GOES-15 -West(135 W) GOES-14 -Test (105 W) Meteosat-10 (0 E) Meteosat-7 (57 E) COMS (128 E) FY-2D (86 E) FY-2G (105 E) MTSAT-2 (145 E) Himawari-8 (140 E Kalpana(74 E) INSAT-3D(83 E)
18
19 Geostationary Satellites Received at UW SSEC in 2015 Sub-Point Reception Method Source Latency Daily Volume GOES West L-Band DB <2 minutes 23 GB GOES West L-Band DB <2 minutes 23 GB GOES West L-Band DB <2 minutes 23 GB Meteosat-10 0 East C-Band Relay DB Relay <15 minutes 24 GB Meteosat-7 57 East Network Relay NESDIS ~30 minutes 2 GB Himawari East Network Relay NOAA STAR ~ 10 minutes 300 GB MTSAT East C-Band Relay DB Relay ~ 6 minutes 12GB Kalpana 74 East Network Relay ISRO minutes 1.4 GB Insat-3D 83 East Network Relay ISRO min 19 GB FY2D 86 East Network Relay ABOM minutes 4.7 GB FY2G 105 East Network Relay ABOM minutes 4.7 GB COMS 128 East Network Relay KMA 9-24 minutes 11 GB
20 Himawari-8
21 Himawari-8 Started receiving it routinely in March, 2015 via NOAA STAR HSF format data Archive on line March 2015 Present (~ 300 GB/day) Data are available via ADDE ~10 minutes after end of Image Receiving 10 minute Full Disks and 2.5 minute Target Sectors Operational after July 7, 2015
22 Insat-3D
23 Insat-3D Started receiving it routinely in April, 2014 HDF5 format data Archive on line April 2014 Present Data are available via ADDE 30 minutes to several hours after end of Image NASA LaRC funded ADDE server work. Should be in the first fasttrack release after Himawari fasttrack
24 Polar Satellites received NOAA-15 NOAA-18 NOAA-19 METOP-A METOP-B Aqua Terra Suomi-NPP Landsat-8 FY-3B GCOM-W1 24
25 Reception Method Domain ADDE Latency Instruments External Access NOAA-15 C-Band relay, DDS DB CONUS Global NOAA-18 DB L-Band, C-Band relay, DDS DB CONUS Global NOAA-19 DB L-Band, C-Band relay, DDS DB CONUS Global Metop-A DB L-Band, NOAA DDS DB CONUS Global Metop-B DB L-Band, NOAA DDS DB CONUS Global Suomi-NPP DB X/L Band, NASA Relay DB CONUS Global Aqua DB X-Band, NASA Relay DB CONUS Global Terra DB X-Band, NASA Relay DB CONUS Global DB <1 minutes after pass AVHRR, AMSU, DCS->level-1 ADDE All other instruments Level-0 NA DB <1 minutes after pass AVHRR->level-1 ADDE All other instruments Level-0 NA DB <1 minutes after pass AVHRR->level-1 ADDE CONUS <15 minutes after pass CONUS <15 minutes after pass CONUS <15 minutes after pass DB <15 minutes after pass DB <15 minutes after pass All other instruments Level-0 AVHRR ->level-1 AVHRR, IASI AVHRR ->level-1 AVHRR,IASI VIIRS VIIRS,ATMS, CrIS AIRS, MODIS -> Level-1 AIRS, MODIS MODIS -> Level-1 MODIS NA ADDE DB ftp (sips) ADDE DB ftp (sips) ADDE DB ftp (sips) ADDE DB ftp (sips) ADDE DB ftp (sips) Landsat-8 Network Relay (USGS) CONUS hours Level-1 ADDE, WMS Shizuku GCOM-W1 Polar Satellites Received at UW SSEC in 2015 DB X-Band CONUS DB <1 min after pass Level-0 SSEC ftp FY-3C DB X/L Band CONUS DB <1 min after pass Level-0 SSEC ftp
26 NOAAPORT/Conventional Data Model Output (GFS, RAP, etc) NEXRAD NWS Text output
27 Real-time Data Custom Products SSEC RealEarth via WMS
28 Archive Data As of May 2015, over 1,450 TBs online. (much of this is redundant) Grows approximately about ~150 TB/year US Geostationary Satellites GOES-8 through GOES-15 (1994-Present) (East, West, South America and test) GOES-1 through GOES-7 ( ) SMS-1&2 ( )
29 Archive Data International Geostationary Satellites GMS/MTSAT (1998-Present) Meteosat/Meteosat IODC (1998-Present) FY2 (2004-Present) Kalpana (2005-Present) Insat-3D (June 2014-Present) COMS (June 2012 Present) Himawari-8 (March 2015 Present)
30 Archive Data NOAAPORT/Conventional Data Model Output (1996-Present)* In situ Point Observations (1976-Present)
31 Current Satellite Archive GEOARC02 Distribution GEOARC03 GEOARC04 External Sites ftp/http/wms server LTO-5 backup GEOARC05 GEOARC06 GEOARC07 NFS mounts GEOARC GEOARC ADDE Client server Requests GEOARC08 Internal Individuals GEOARC09 GEOARC10 9 servers with ~1.2 pb disk Dell MD1200s, MD1000s Internal Cluster (300 core)
32 New Satellite Archive Distribution Zara Cluster (300 cores) PEATE (1000 cores) Lustre mount over Infiniband Lustre mount over Infiniband and local ADDE Lustre mount over Infiniband Lustre Satellite Archive GEOARC NFS mounts GEOARC External Sites ADDE Client server Requests ftp/http/wms server(s) s4 Cluster & S4 expansion (4,672 cores) Lustre 2.4 on ZFS 30 DELL MD1200s (4 TB disks) 12 DELL R720s OSS 2 DELL R720s MDS (Designed by Scott Nolin, Jesse Stroik, and John Lalande) FUSE mount dawgfs server NFS mount Internal Individuals (5000+ cores)
33 New Stuff
34 GOES-R Antenna Upgrade Summer 2015 New Feed DVB-S2 demodulator 7.3 meter diameter
35 GOES-R ADDE access to ABI (with tracking) Level-2 products via CSPP GEO (ADDE access when available) Archive CADU CCSDS and level-1 netcdf
36 Archive level 0 No ADDE service GOES-R
37 GOES-R Testing with GRB simulator now Developing new SDI for Ingest and serving
38 Event Handler Satellite Imagery Event Handler Provides users with notification of data availability Users will be able to subscribe and trigger processing based on event attributes Internal testing now. External access in 2016 Utilizes RabbitMQ
39 More methods of data access ADDE interface that returns netcdf McIDAS-X scripts in Python WMS server direct access to ADDE archive
40 Opening up the archive Starting in 2011, active McIDAS-X sites have access to archive data older than the previous month (limit of 5 GB/month) per site. Beginning in 2016, any user will have access to ADDE data older than 6 months in our satellite archive up to 5 GB/day.
41 Visualizing Operational Leo and Geo Satellites in Real-time Utilizing WebGL
42 SMS 1 & 2 Rescue SMS-1 &2 data for May 1974 July tapes Joint effort with NASA GSFC
43 End
University of Wisconsin SSEC Data Center. May 7, 2012
University of Wisconsin SSEC Data Center May 7, 2012 SSEC Data Center SSEC Data Center - Activities Assist Satellite Operations Control Center and other agencies in satellite checkout and troubleshooting
NOAA Direct Broadcast Real-Time Network: Current Status and Plans for Delivering Sounder Data to DRARS
NOAA Direct Broadcast Real-Time Network: Current Status and Plans for Delivering Sounder Data to DRARS Liam Gumley (NOAA DB Demonstration Technical Manager), Bruce Flynn, Heath Skarlupka, David Santek,
McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data
McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data Thomas Achtor, Thomas Rink, Thomas Whittaker, David Parker and David Santek Space Science
McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008
McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008 Tom Achtor, Tom Rink, Tom Whittaker, Dave Parker, Gail
Ensuring the Preparedness of Users: NOAA Satellites GOES R, JPSS Laura K. Furgione
Ensuring the Preparedness of Users: NOAA Satellites GOES R, JPSS Laura K. Furgione U.S. Permanent Representative with the WMO Deputy Director, NOAA s s National Weather Service WMO Executive Council 65
The MODIS online archive and on-demand processing
The MODIS online archive and on-demand processing Edward Masuoka NASA Goddard Space Flight Center, Greenbelt, MD, USA Production Driven by Science Over the Terra and Aqua mission lifetimes, better calibration
CLASS Access. 2015 NOAA Satellite Conference, April 27 May 1, 2015
NOAA s National Centers for Environmental Information CLASS Access 2015 NOAA Satellite Conference, April 27 May 1, 2015 NOAA Satellite and Information Service National Centers for Environmental Information
Denis Botambekov 1, Andrew Heidinger 2, Andi Walther 1, and Nick Bearson 1
Denis Botambekov 1, Andrew Heidinger 2, Andi Walther 1, and Nick Bearson 1 1 - CIMSS / SSEC / University of Wisconsin Madison, WI, USA 2 NOAA / NESDIS / STAR @ University of Wisconsin Madison, WI, USA
Building a Weather- Ready Nation. NWS Office of Dissemination Partners Meeting January 14, 2016 New Orleans, LA
Building a Weather- Ready Nation NWS Office of Dissemination Partners Meeting January 14, 2016 New Orleans, LA Topics Chronology One-NWS Network Dissemination outages during severe weather events Responses
McIDAS-X Software Development and Demonstration
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 8 June 2015 Overview McIDAS-X 2014.1 & 2015.1 McIDAS-XCD 2014.1 Software development and plans for version 2015.2 and beyond
Sodankylä National Satellite Data Center (NSDC): Current and Future Satellite Missions and Products
Sodankylä National Satellite Data Center (NSDC): Current and Future Satellite Missions and Products Timo Ryyppö, CSPP Users Group Meeting 2015 Content Introduction to Sodankylä site Facilities Satellites
NOAA Satellite Proving Ground Training and User Engagement
NOAA Satellite Proving Ground Training and User Engagement Tony Mostek and Brian Motta (NWS) Wendy Abshire (COMET) Update September 2012 VISIT Training Sessions in 2012 TROWAL Identification (winter weather
NOAA and Its Role in Managing Satellite Data
NOAA is dedicated to serving society by providing timely access to global environmental data from satellites and other sources to promote, protect, and enhance the Nation s economy, security, environment,
Utilization of satellites and products at Met Office since ET-SUP7
Utilization of satellites and products at Met Office since ET-SUP7 Simon J. Keogh WMO ET-SUP8 14-17 April 2014. Table of Contents Current data usage for NWP including new data assimilated since ET-SUP7
Suomi / NPP Mission Applications Workshop Meeting Summary
Suomi / NPP Mission Applications Workshop Meeting Summary Westin City Center, Washington, DC June 21-22, 2012 Draft Report (updated March 12, 2013) I. Background The Suomi National Polar- orbiting Partnership
The STAR Algorithm Integration Team (AIT) Research to Operations Process
The STAR Algorithm Integration Team (AIT) Research to Operations Process Presented by Tom King 1 The Problem Scientists write code that needs to go to operations, but:» Many scientists often prefer interpreted
Real-time and Archived Antarctic. Interactive Processing Tools
Real-time and Archived Antarctic Meteorological Data via a Synergy of Interactive Processing Tools Mark W. Seefeldt Department of Atmospheric and Oceanic Sciences University it of Colorado at Boulder,
Managing a local Galaxy Instance. Anushka Brownley / Adam Kraut BioTeam Inc.
Managing a local Galaxy Instance Anushka Brownley / Adam Kraut BioTeam Inc. Agenda Who are we Why a local installation Local infrastructure Local installation Tips and Tricks SlipStream Appliance WHO ARE
The DLR Multi Mission EO Ground Segment
The DLR Multi Mission EO Ground Segment Payload Ground Segment Erhard Diedrich Remote Sensing Workshop Mexico 22-24 April 2008 DLR Ground Segment for Earth Observation: Servicing GMES, national and commercial
Joint Polar Satellite System (JPSS)
Joint Polar Satellite System (JPSS) John Furgerson, User Liaison Joint Polar Satellite System National Environmental Satellite, Data, and Information Service National Oceanic and Atmospheric Administration
Technical Support Services Contract Solicitation G14PS00053 Questions and Responses from EROS Site Visits December 2, 2014
Technical Support Services Contract Solicitation G14PS00053 Questions and Responses from EROS Site Visits December 2, 2014 1. Question: Can you provide more information on how/what Landsat 7 and 8 data
Satellite User Readiness Navigation portal: Status and Development. (Submitted by the Secretariat) Summary and Purpose of Document
WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPEN PROGRAMME AREA GROUP ON INTEGRATED OBSERVING SYSTEMS INTER-PROGRAMME EXPERT TEAM ON SATELLITE UTILIZATION AND PRODUCTS FIRST SESSION
Overview of Data Visualization Tools. (Submitted by the Secretariat) Summary and Purpose of Document
WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPEN PROGRAMME AREA GROUP ON INTEGRATED OBSERVING SYSTEMS EXPERT TEAM ON SATELLITE UTILIZATION AND PRODUCTS SCOPE-Nowcasting Ad-hoc Steering
COORDINATION GROUP ON SATELLITE DATA REQUIREMENTS FOR RA III AND RA IV. Summary
COORDINATION GROUP ON SATELLITE DATA REQUIREMENTS FOR RA III AND RA IV 5 th Teleconference, 26 February 2014, 15.00 UTC Participants: Summary Estela Collini, SNM, Argentina (estela.collini@gmail.com) Luiz
CGMS-36, NOAA-WP-14 Prepared by C. Cao Agenda Item: II/2 Discussed in WG II
Prepared by C. Cao Agenda Item: II/2 Discussed in WG II A Web-based Interface for Near Real-time Instrument Performance Monitoring In response to CGMS Action 35.18 (GSICS GCC to propose a web-based interface
CONCEPTUAL DESIGN OF DATA ARCHIVE AND DISTRIBUTION SYSTEM FOR GEO-KOMPSAT-2A
CONCEPTUAL DESIGN OF DATA ARCHIVE AND DISTRIBUTION SYSTEM FOR GEO-KOMPSAT-2A In Jun Kim, Won Chan Jung, Byoung-Sun Lee, Do-Seob Ahn, Taeyoung Kim, Jaedong Jang, Hyunjong Oh ETRI, 218 Gajeong-ro, Yuseong-gu,
Earth remote sensing systems of middle and low resolution
Earth remote sensing systems of middle and low resolution Serial on-line remote sensing satellites delivering data available on the world market V.I. Gershenzon (ScanEx R&D Center) In 1980, graduated from
NASA's Earth Observing Data and Information System (EOSDIS)
NASA's Earth Observing Data and Information System (EOSDIS) Copernicus Big Data Workshop 13 March 2014 Brussels, Belgium Kevin Murphy EOSDIS System Architect NASA Goddard Space Flight Center Topics to
Options for filling the LEO-GEO AMV Coverage Gap Francis Warrick Met Office, UK
AMV investigation Document NWPSAF-MO-TR- Version. // Options for filling the LEO-GEO AMV Coverage Gap Francis Warrick Met Office, UK Options for filling the LEO-GEO AMV Coverage Gap Doc ID : NWPSAF-MO-TR-
Migrating NASA Archives to Disk: Challenges and Opportunities. NASA Langley Research Center Chris Harris June 2, 2015
Migrating NASA Archives to Disk: Challenges and Opportunities NASA Langley Research Center Chris Harris June 2, 2015 MSST 2015 Topics ASDC Who we are? What we do? Evolution of storage technologies Why
Ocean Colour experience SeaWiFS / MODIS / VIIRS
Ocean Colour experience SeaWiFS / MODIS / VIIRS Bryan Franz and the NASA Ocean Biology Processing Group presented by Ewa Kwiatkowska, EUMETSAT Sentinel-3 Cal/Val Meeting 20-22 March 2012 Goal Provide a
CLS Office/Beam line Data Storage System Specification CLS 9.8.92.1 Rev. 0
CLS Office/Beam line Data Storage System Specification CLS 9.8.92.1 Rev. 0 2003-02-11 Copyright 2003, Canadian Light Source, Inc. This document is the property of Canadian Light Source Incorporated (CLS).
Archiving and Managing Remote Sensing Data Using State of the Art Storage Technologies
Archiving and Managing Remote Sensing Data Using State of the Art Storage Technologies Ms B Lakshmi C Chandrasekhar Reddy SVSRK Kishore SDAPSA, NRSC, Hyderabad NRSC Functions Remote Sensing Data Acquisition
CEDA Storage. Dr Matt Pritchard. Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk
CEDA Storage Dr Matt Pritchard Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk How we store our data NAS Technology Backup JASMIN/CEMS CEDA Storage Data stored as files on disk. Data is migrated
MODIS direct broadcast data for enhanced forecasting and real-time environmental decision making. The role of Remote Sensing in Wildfire Management
MODIS direct broadcast data for enhanced forecasting and real-time environmental decision making The role of Remote Sensing in Wildfire Management Natural Disasters Natural disasters are continuously increasing
Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1
Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model Dr.
Storage of the Experimental Data at SOLEIL. Computing and Electronics
Storage of the Experimental Data at SOLEIL 1 the SOLEIL infrastructure 2 Experimental Data Storage: Data Hierarchisation Close Data : beamline local access 3 to 4 days min. Recent Data : fast access, low
The Benefits and Challenges in Global Meteorological Satellite Data Sharing
The Benefits and Challenges in Global Meteorological Satellite Data Sharing Ninghai Sun and Fuzhong Weng Center for Satellite Applica0ons and Research Na0onal Oceanic and Atmospheric Administra0on Presented
The Multimission National Center of the Italian Space Agency
The Multimission National Center of the Italian Space Agency L. Garramone - ASI GSCB Workshop, ESA/ESRIN Frascati Table of contents Multimission National Center (CNM): status of the activities; Main functions
DATA ACCESS AT EUMETSAT
1 EUM/OPS/VWG/15/793789 v1a DATA ACCESS AT EUMETSAT Copernicus Climate Data Store Workshop ECMWF 3-6 March 2015 Harald Rothfuss Overview of Presentation 1. Introduction to EUMETSAT 2. EUMETSAT Data Access
ADAGUC & PyTROLL. Maarten Plieger Ernst de Vreede. Application of polar orbiter products in weather forecasting Using open source tools and standards
Application of polar orbiter products in weather forecasting Using open source tools and standards ADAGUC & PyTROLL Maarten Plieger Ernst de Vreede Royal Netherlands Meteorological Institute (KNMI) R&D
NCDC s SATELLITE DATA, PRODUCTS, and SERVICES
**** NCDC s SATELLITE DATA, PRODUCTS, and SERVICES Satellite data and derived products from NOAA s satellite systems are available through the National Climatic Data Center. The two primary systems are
National Snow and Ice Data Center A brief overview and data management projects
Cooperative Institute for Research in Environmental Sciences University of Colorado National Snow and Ice Data Center A brief overview and data management projects Walt Meier, Mark Parsons, and Mark Serreze
The CLASS Cloud Access Pilot
The CLASS Cloud Access Pilot 16 May 2012 Kenneth S. Casey, NODC OnBehalf of the CLASS Operations Working Group (COWG) First, some context. The NOAA National Data Centers National Oceanographic Data Center
What is spectrum reallocation, and what does it have to do with weather satellites?
FAQ ========= SPECTRUM REALLOCATION ========= What is spectrum reallocation, and what does it have to do with weather satellites? Because of increasing demand for wireless smartphones, tablets, and Wi-Fi
CEOS contribution to the GEO Geohazard Supersite and Natural Laboratories Initiative Data access and license conditions
CEOS contribution to the GEO Geohazard Supersite and Natural Laboratories Initiative Data access and license conditions Ecuadorian Volcanoes Permanent Supersite December 8, 2014 1. Purpose and Scope This
Presented by Gary Davis, Director, Office of Systems Development NOAA/NESDIS/OSD. Fifty Years of Achievement
NOAA s Environmental Satellite Program: Past, Present, and Future Presented by Gary Davis, Director, Office of Systems Development NOAA/NESDIS/OSD 1 Space-Based Remote Sensors Changed Way We See Our World
The Virtual Laboratory for Satellite Training and Data Utilization
The Virtual Laboratory for Satellite Training and Data Utilization James F.W. Purdom Cooperative Institute for Research in the Atmosphere Colorado State University Fort Collins, Colorado purdom@cira.colostate.edu
Workload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace
Workload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace Beth Plale Indiana University plale@cs.indiana.edu LEAD TR 001, V3.0 V3.0 dated January 24, 2007 V2.0 dated August
NCDC Strategic Vision
NOAA s National Climatic Data Center World s Largest Archive of Climate and Weather Data Presented to: Coastal Environmental Disasters Data Management Workshop September 16, 2014 Stephen Del Greco Deputy
NOAA National Data Center. + CLASS Overview
An Overview of the NOAA National Data Center and CLASS Landscape + CLASS Overview Kenneth ths. Casey, NODC On Behalf of the CLASS Operations Working Group (COWG) + Kern Witcher, CLASS Program Manager Presentation
Data and Information Management for EO Data Centers. Eberhard Mikusch German Aerospace Center - German Remote Sensing Data Center
Data and Information Management for EO Data Centers Eberhard Mikusch German Aerospace Center - Mexico, 23. 04 2008 Earth Observation System Environment at DLR/DFD 10010 00101 Radar 10010 00101 Atmospheric
The storage features and needs for numerical modeling at ARPA FVG - CRMA
The storage features and needs for numerical modeling at ARPA FVG - CRMA The storage features and needs for numerical modeling at ARPA FVG - CRMA Scientific data management approaches, data analysis and
Marcus A. Watkins Director of the Joint Agency Satellite Division, Science Mission Directorate, NASA HQ, Washington DC
Marcus A. Watkins Director of the Joint Agency Satellite Division, Science Mission Directorate, NASA HQ, Washington DC Leads the Joint Agency Satellite Division (JASD) at NASA HQ in Washington, DC and
The safer, easier way to help you pass any IT exams. Exam : 000-115. Storage Sales V2. Title : Version : Demo 1 / 5
Exam : 000-115 Title : Storage Sales V2 Version : Demo 1 / 5 1.The IBM TS7680 ProtecTIER Deduplication Gateway for System z solution is designed to provide all of the following EXCEPT: A. ESCON attach
Big Data and Cloud Computing for GHRSST
Big Data and Cloud Computing for GHRSST Jean-Francois Piollé (jfpiolle@ifremer.fr) Frédéric Paul, Olivier Archer CERSAT / Institut Français de Recherche pour l Exploitation de la Mer Facing data deluge
Technological Overview of High-Performance Computing. Gerolf Ziegenhain - TU Kaiserslautern, Germany
Technological Overview of High-Performance Computing Gerolf Ziegenhain - TU Kaiserslautern, Germany Outline of This Talk Give a glance at the important technologies The most important stuff is mentioned
Let s Talk Digital An Approach to Managing, Storing, and Preserving Time-Based Media Art Works. DAMS Branch Manager Smithsonian Institution, OCIO
Let s Talk Digital An Approach to Managing, Storing, and Preserving Time-Based Media Art Works DAMS Branch Manager Smithsonian Institution, OCIO 1 Love and Marriage Digital Asset Management?? Digital Diamonds
User's Guide for Building and Operating Environmental Satellite Receiving Stations
National Oceanic and Atmospheric Administration User's Guide for Building and Operating Environmental Satellite Receiving Stations Updated: February 2009 U.S. DEPARTMENT OF COMMERCE National Oceanic and
Securing Ground Control Systems
Securing Ground Control Systems Computer Sciences Corporation Mary Hunter / Tracy Dorsey 1 Securing Satellite Ground Control Systems! Ensure real-time command and control functions performed by flight
GRWG Web Meeting Meeting Nov. 25, 2008 Postponed to Dec. 16, 2008
GRWG Web Meeting Nov. 25, 2008 Postponed to Dec. 16, 2008 Agenda Tips and questions of Web Meeting (Uz) Highlights instead of demonstration or training Update on Hierarchical ATBD (Hewison) Action from
Wireless Networks and Power Quality
Will installing wireless networking change my back-up power requirements? What data do I need to know in order to determine my wireless network back-up power requirements? What other issues should I consider
McIDAS-V Tutorial Displaying Polar Satellite Imagery updated September 2015 (software version 1.5)
McIDAS-V Tutorial Displaying Polar Satellite Imagery updated September 2015 (software version 1.5) McIDAS-V is a free, open source, visualization and data analysis software package that is the next generation
The Design and Implementation of the Zetta Storage Service. October 27, 2009
The Design and Implementation of the Zetta Storage Service October 27, 2009 Zetta s Mission Simplify Enterprise Storage Zetta delivers enterprise-grade storage as a service for IT professionals needing
CLASS Data Access Tutorial
NOAA s National Centers for Environmental Information CLASS Data Access Tutorial April 24, 2015 NOAA Satellite and Information Service National Centers for Environmental Information Table of Contents CLASS
An Alternative Storage Solution for MapReduce. Eric Lomascolo Director, Solutions Marketing
An Alternative Storage Solution for MapReduce Eric Lomascolo Director, Solutions Marketing MapReduce Breaks the Problem Down Data Analysis Distributes processing work (Map) across compute nodes and accumulates
How To Run A Space Station From A Polar Relay Station
SSC space expertise on high latitudes FMV Sensor Symposium Stockholm, September 2014 Björn Ohlson 1 50 years in space 1961 The first sounding rocket launch from Sweden 1962 Building of Esrange starts 1966
Kathryn A. Shontz STAR-NDE Liaison IMSG at NOAA/NESDIS/STAR Camp Springs, MD 20746. Ingrid Guch, Aleksandar Jelenak and Kent Hughes NOAA/NESDIS/STAR
A Review of Improvements and Outstanding Challenges in Data Management and Stewardship by the Center for Satellite Applications and Research (STAR) in support of the NPOESS Preparatory Program (NPP) Satellite
NOAA Big Data Project. David Michaud Acting Director, Office of Central Processing Office Monday, August 3, 2015
NOAA Big Data Project David Michaud Acting Director, Office of Central Processing Office Monday, August 3, 2015 Central Processing Portfolio Benefits and Scope Central Processing Portfolio Benefits Ensures
PHP/MySQL APPLicAtion HoSting
PHP/MySQL Application Hosting Connectivity DMD PHP/MySQL Hosting is partnered with a Kansas City, USA based Data Center connected to the internet through multiple backbones to ensure that the data is transmitted
ScanEx Ground Stations Network: Network of ground stations receiving data from artificial Earth remote sensing satellites
ScanEx Ground Stations Network: Network of ground stations receiving data from artificial Earth remote sensing satellites 1 Contents Network general characteristics:... 3 1. General information about ScanEx
How To Build A Supermicro Computer With A 32 Core Power Core (Powerpc) And A 32-Core (Powerpc) (Powerpowerpter) (I386) (Amd) (Microcore) (Supermicro) (
TECHNICAL GUIDELINES FOR APPLICANTS TO PRACE 7 th CALL (Tier-0) Contributing sites and the corresponding computer systems for this call are: GCS@Jülich, Germany IBM Blue Gene/Q GENCI@CEA, France Bull Bullx
University of Wisconsin- Madison: Supporting Global Direct Broadcast Applications
University of Wisconsin- Madison: Supporting Global Direct Broadcast Applications Kathleen Strabala, Liam Gumley, Allen Huang UW-Madison, Space Science and Engineering Center (SSEC) Lots of Others James
Matsu: An Elastic Cloud Connected to a SensorWeb for Disaster. (Session 12F Working Group: Cloud Computing for Spacecraft Operations)
Matsu: An Elastic Cloud Connected to a SensorWeb for Disaster Response (Session 12F Working Group: Cloud Computing for Spacecraft Operations) Daniel Mandl - NASA/GSFC 3/2/11 1 SensorWeb High Level Architecture
NASA's Strategy and Activities in Server Side Analytics
NASA's Strategy and Activities in Server Side Analytics Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at the ESGF/UVCDAT Conference Lawrence Livermore National Laboratory
EUMETSAT Satellite Programmes
EUMETSAT Satellite Programmes Nowcasting Applications Developing Countries Marianne König marianne.koenig@eumetsat.int WSN-12 Rio de Janeiro 06-10 August 2012 27 Member States & 4 Cooperating States Member
AFS Usage and Backups using TiBS at Fermilab. Presented by Kevin Hill
AFS Usage and Backups using TiBS at Fermilab Presented by Kevin Hill Agenda History and current usage of AFS at Fermilab About Teradactyl How TiBS (True Incremental Backup System) and TeraMerge works AFS
HYCOM Meeting. Tallahassee, FL
HYCOM Data Service An overview of the current status and new developments in Data management, software and hardware Ashwanth Srinivasan & Jon Callahan COAPS FSU & PMEL HYCOM Meeting Nov 7-9, 7 2006 Tallahassee,
SUN ORACLE DATABASE MACHINE
SUN ORACLE DATABASE MACHINE FEATURES AND FACTS FEATURES From 2 to 8 database servers From 3 to 14 Sun Oracle Exadata Storage Servers Up to 5.3 TB of Exadata QDR (40 Gb/second) InfiniBand Switches Uncompressed
SR-IOV In High Performance Computing
SR-IOV In High Performance Computing Hoot Thompson & Dan Duffy NASA Goddard Space Flight Center Greenbelt, MD 20771 hoot@ptpnow.com daniel.q.duffy@nasa.gov www.nccs.nasa.gov Focus on the research side
Authors and Affiliations Kristopher Bedka 1, Cecilia Wang 1, Ryan Rogers 2, Larry Carey 2, Wayne Feltz 3, and Jan Kanak 4
1. Title Slide Title: Analysis of the Co-Evolution of Total Lightning, Ground-Based Radar-Derived Fields, and GOES-14 1-Minute Super Rapid Scan Satellite Observations of Deep Convective Cloud Tops Authors
Scientific Storage at FNAL. Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015
Scientific Storage at FNAL Gerard Bernabeu Altayo Dmitry Litvintsev Gene Oleynik 14/10/2015 Index - Storage use cases - Bluearc - Lustre - EOS - dcache disk only - dcache+enstore Data distribution by solution
McIDAS-V Tutorial Importing Data from Text Files updated June 2015 (software version 1.5)
McIDAS-V Tutorial Importing Data from Text Files updated June 2015 (software version 1.5) McIDAS-V is a free, open source, visualization and data analysis software package that is the next generation in
Satellite Snow Monitoring Activities Project CRYOLAND
Satellite Snow Monitoring Activities Project CRYOLAND Background material for participants to the Workshop on European Snow Monitoring Perspectives, Darmstadt, 4-5 December 2012. CryoLand provides Snow,
Tier 2 Nearline. As archives grow, Echo grows. Dynamically, cost-effectively and massively. What is nearline? Transfer to Tape
Tier 2 Nearline As archives grow, Echo grows. Dynamically, cost-effectively and massively. Large Scale Storage Built for Media GB Labs Echo nearline systems have the scale and performance to allow users
e-infrastructure of DIAS
e-infrastructure of DIAS Toshihiro Nemoto 1 Masaru Kitsuregawa 2 1 Earth Observation Data Integration and Fusion Initiative, The Univ. of Tokyo 2 Director General of National Institute of Informatics(NII)
Advances in Cloud Imager Remote Sensing
Advances in Cloud Imager Remote Sensing Andrew Heidinger NOAA/NESDIS/ORA Madison, Wisconsin With material from Mike Pavolonis, Robert Holz, Amato Evan and Fred Nagle STAR Science Symposium November 9,
Inge Os Sales Consulting Manager Oracle Norway
Inge Os Sales Consulting Manager Oracle Norway Agenda Oracle Fusion Middelware Oracle Database 11GR2 Oracle Database Machine Oracle & Sun Agenda Oracle Fusion Middelware Oracle Database 11GR2 Oracle Database
Final report on RAD service chain evolution
MACC-II Deliverable D_122.5 Final report on RAD service chain evolution Date: 07/2014 Lead Beneficiary: DLR (#11) Nature: R Dissemination level: PP Grant agreement n 283576 2 / 9 Table of Contents 1. Hardware
Dell PowerVault DL2200 & BE 2010 Power Suite. Owen Que. Channel Systems Consultant Dell
Dell PowerVault DL2200 & BE 2010 Power Suite Owen Que Channel Systems Consultant Dell Dell PowerVault DL2200 powered by Symantec Backup Exec 2010 1 Replace Tape with Deduplication Customer Storage Challenge
MODIS Collection-6 Standard Snow-Cover Products
MODIS Collection-6 Standard Snow-Cover Products Dorothy K. Hall 1 and George A. Riggs 1,2 1 Cryospheric Sciences Laboratory, NASA / GSFC, Greenbelt, Md. USA 2 SSAI, Lanham, Md. USA MODIS Collection-6 Standard
Deploying Exchange Server 2007 SP1 on Windows Server 2008
Deploying Exchange Server 2007 SP1 on Windows Server 2008 Product Group - Enterprise Dell White Paper By Ananda Sankaran Andrew Bachler April 2008 Contents Introduction... 3 Deployment Considerations...
Datacenter Infrastructure Management (DCIM) Solution
Datacenter Infrastructure Management (DCIM) Solution Figure 1. Asset Management in 3D, Real-Time Reporting, CFD Modeling & Analysis Description Datacenter Clarity provides the tools to accurately and efficiently
Long term retention and archiving the challenges and the solution
Long term retention and archiving the challenges and the solution NAME: Yoel Ben-Ari TITLE: VP Business Development, GH Israel 1 Archive Before Backup EMC recommended practice 2 1 Backup/recovery process
Archiving Information Storage and Its Advantages
Data Archiving Using Enhanced MAID Aloke Guha CTO, 23nd IEEE13th NASA Mass Storage Conference May 18, 2006 Archive Data Needs Retention and Disposition Performance Corporate governance and regulatory guidelines
an insight into systems from acquisition to dissemination
an insight into systems from acquisition to dissemination P Shasidhar Reddy Manager Computer Systems National Remote Sensing Centre Satellite data acquisition planning, reception, processing and dissemination
Vess. Architectural & Engineering Specifications For Video Surveillance. A2200 Series. www.promise.com. Version: 1.2 Feb, 2013
Vess A2200 Series Architectural & Engineering Specifications Version: 1.2 Feb, 2013 www.promise.com Copyright 2013 Promise Technology, Inc. All Rights Reserved. No part of this document may be reproduced
Emergency Managers Weather Information Network (EMWIN) Service Transition 2016/2017
EMWIN Stakeholder Meeting April 19, 2015 Emergency Managers Weather Information Network (EMWIN) Service Transition 2016/2017 Dissemination Systems Team, NWS Office of Dissemination Program Manager: Craig
EO4CDS Pilot Project to Demonstrate Near Real Time Data Production from MetOp
EO4CDS Pilot Project to Demonstrate Near Real Time Data Production from MetOp Barry Latter on behalf of: Richard Siddans, Diane Knappett, Joanne Walker & Brian Kerridge (RAL-RSG) Sam Pepler (RAL-CEDA)
EMC VMAX3 FAMILY VMAX 100K, 200K, 400K
EMC VMAX3 FAMILY VMAX 100K, 200K, 400K The EMC VMAX3 TM family delivers the latest in Tier-1 scale-out multi-controller architecture with unmatched consolidation and efficiency for the enterprise. With