Data Visualization Workshop May 7, 2015 Introduction to Raster Graphics and Applications Richard Koehler, PhD, PH NOAA, Boulder, CO richard.koehler@noaa.gov Source: usgs.gov Source: nrcs.gov Source: noaa.gov
Workshop outline Morning: Intro and use of raster plots Background, summit to sea approach Examples with pattern identification Advanced analysis techniques Afternoon: Hands on how-to Data formatting Graph creation Tips and tricks
Speaker Background Position (current & past) NOAA/NWS, National Hydrologic and Geospatial Sciences Training Coordinator Director of Water Resources, EEC, Tucson, AZ Water Resources Hydrologist, Cochise County, AZ LCDR (ret), NOAA Ships Rainier, Whiting, NWRFC, CBRFC Geodesist, Defense Mapping Agency - Hydrologist, USFS (MBSNF) Education (Pacific NW related research) PhD Univ of Arizona (Watershed Mgmt & remote sensing - Snake and Colo) MS Naval Postgraduate School (Hydrographic Sciences - Columbia) MS, BS Univ of Arizona (Natural Resource Mgmt - Malheur Lake) Certification Professional Hydrologist - American Institute of Hydrology
https://www.meted.ucar.edu/ An Introduction to Geodetic Datums
Why this workshop? Summed up in one phrase: Big Data Focus on time series - observations, derived data, model output Bottom line - understand, restoration guide, forecast/predict/monitor, decision support, budget, QA/QC, user needs, project management
Visualization criteria Show all data no hiding or distorting View multiple timescales simultaneously Compare within and between datasets Display a large range and amount of data Identify trends and patterns; natural vs artificial Locate outliers and anomalies, QA/QC
Patterns - training your eyes to see Source: http://www.coolbubble.com
Time and space scales - ecology Source: NOAA
Time-series data displays Source: USGS Source: NOAA
Spaghetti plot Water Year: Oct 1 Sept 30 Assumption: Lines overlaid in a single plane Kettle River near Laurier, WA
Display evolution Alter the assumption:
Wire diagram Tilt and rotate display New perspective, aerial Hidden axis Spaghetti plot perspective, ground
Time map Dual timescale coordinate system Common framework for visualization and layering data
Streamflow MT Traditional hydrograph WA OR ID Flood of record Droughts of record What were the dates?
Raster hydrograph Clearwater River at Spalding, ID Discharge axis Flood of Record May 1948 Droughts of record Jan 1937, Dec 1952 (WY 1953) Missing + Dworshak operational event mark Source: USGS
Raster hydrograph Clearwater River at Spalding, ID Snowmelt runoff Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID Fall & Winter storms Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID Late summer low flow Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID Dworshak diversion tunnel closed Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID Weekend regulation pattern Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID Fall release Missing + Dworshak operational
Raster hydrograph Clearwater River at Spalding, ID July to Sept release Missing + Dworshak operational
Similar plots Plot name: Heat map Temporal raster plot Raster image Hovmöller diagram Waterfall plot Chromogram Pixel graph Image map Raster hydrograph Software: Graphics Excel, Matlab, OriginLab, SAS, Surfer, ArcGIS R *, Google Docs *, QGIS * Quantitative tools Surfer, ArcGIS, Mathematica, QGIS *, FRAGSTATS * * No cost options
ArcGIS plot Raster hydrograph created in ArcMap
Online resources
Online resources Source: http://www.stccmop.org/saturn
Plot variations - Value ( v, such as observed or modeled) - Change in value (Dv/Dt, very helpful in quality checks) - Running sum (Sv) - Maximum or minimum (v max, v min, annual series) - Threshold (v crit or specific number) - Calculated ( f(v), percentile, return frequency) - Combine, layer displays (raster with contours)
Annual Series Annual maximum daily mean flow (cfs)
Annual Series Annual maximum daily mean flow (cfs) + Dworshak operational
Flood frequency flows Return period flows + + Dworshak operational Pre-dam record used to compute flood frequency design flows
Traditional plot water temperature
Daily maximum water temperature Temperature synced with summer flow, except for recent years. Note link with power production. missing
Water temperature range (max min) What patterns are seen here? missing
Flow vs daily max water temp Identify flows where daily max water temp 20 C
Overlay multiple datasets Flow and max water temp Overlays helps identify coincidence Warning: Coincidence does not always imply a connection. Water temp 20 C missing
Reservoir water temp (avg) Bonneville Reservoir 20-15 - 10-5 - 0 - Source: http://www.nwd-wc.usace.army.mil/
Lower Columbia River Reservoir System Source: http://www.nwd-wc.usace.army.mil/
Bonneville adult chinook Daily Count, (2010 2014, 5 years) Source: http://www.fpc.org/
Bonneville adult chinook Daily Count, (1938 2014, 76 years) Source: http://www.nwd-wc.usace.army.mil/
Bonneville adult chinook - update
Envelope curve Bonneville adult chinook count and water temperature 1,000 adult chinook/day 48 F, 8.9 C
Bonneville adult chinook Daily Count Annual Max Daily Count
Bonneville adult chinook Running annual total daily count missing
Bonneville adult chinook Running annual total daily count and annual max missing
Bonneville adult chinook Running total and annual max Monthly PDO index missing Source: noaa
Lower Columbia River system Daily count at four lower projects Bonneville The Dalles John Day McNary
SNOTEL example Crater Meadow, ID
Snow Water Equivalent
Snow Water Equivalent
Snow Water Equivalent
SWE and Precipitation SWE (15 inches) Precip (20 inches)
Paleo-hydrology analysis Annual volume estimated with tree ring data Jackson Lake at Dam on Snake River near Moran, WY Estimated annual volume (ac-ft) 10% wettest 10% driest Century http://treeflow.info/pnw/snakemoran.html#reconstruction
Paleo-hydrology analysis Jackson Lake at Dam on Snake River near Moran, WY Annual volume (ac-ft)
Tides (6 minute interval) Astoria 4.0 Astoria, OR tides (2014) 87,415 data points Portland 3.5 3.0 Depth meters (MLLW) 2.5 2.0 1.5 1.0 0.5 0.0-0.5-1.0 1/1 1/31 3/2 4/1 5/1 5/31 6/30 7/30 8/29 9/28 10/28 11/27 12/27 Source: http://tidesandcurrents.noaa.gov
Tides (6 minute interval) Astoria, OR tides (2014) 87,415 data points Missing
Streamflow and energy generation The Dalles, OR Mean daily streamflow (cfs) Total daily energy generation (MWH) Source: http://www.nwd-wc.usace.army.mil/ Maximum generation 43,400 MWH
Flow regime and geology Dr. Gordon Grant USFS - OSU study McKenzie River at Outlet of Clear Lake, OR Elev = 3,015 ft, Drainage area = 92.40 mi 2 High Cascade geology High bedrock perm, Mtn/Trans terrain Moderate/High soil perm Lookout Creek near Blue River, OR Elev = 1,378 ft Drainage area =24.10 mi 2 Western Cascade geology Low bedrock perm, Mtn terrain Low soil perm Source: Grant et al., 2010. Streamflow response to climate warming in mountain regions: Integrating the effects of snowpack and groundwater dynamics. http://www.fs.fed.us/psw/cirmount/meetings/mtnclim/2010/talks/pdf/grant_talk2010.pdf
Flow regime and geology Flow (cfs) Clear Lake, OR High soil perm Winter: longer duration Summer: higher baseflow Flow (cfs) Lookout Creek, OR Low soil perm Winter: shorter duration Summer: low baseflow
QA/QC MT Days without data can provide information Fort Peck computed daily inflow (~72 yrs, 26,300 values) ID WY Missing
Summary Alternate display of data Online resources Multiple applications Variety of plots and combinations
Questions?
Break Back in 15 minutes
Additional slides
Colorado River Water Availability Study How can climate simulations for water resources be re-purposed? Topics Hydrometeorology Climate change Water supply Consumptive use Decision support Reservoir management Instream flows Data visualization Elements a. Sites = 845 Diversions, Reservoirs, Stream gages, ISF reaches, Natural Flow Nodes, b. Parameters = 26 Demand, CU, Loss, Flow, c. Climate scenarios = 11 Historic, 2040 & 2070 simulations
Current data display Elements a. Sites 1 b. Parameters 1 c. Scenarios 11 a. Colorado River nr CO-UT state line b. Upstream Inflow c. All climate scenarios
Current data display Elements a. Sites 1 b. Parameters 1 c. Scenarios 11 a. Colorado River nr CO-UT state line b. Upstream Inflow c. All climate scenarios
Current data display Elements 1. Sites 1 2. Parameters 1 3. Scenarios 11 1. Colorado River nr CO-UT state line 2. Upstream Inflow 3. All climate scenarios
Proposed data display Elements 1. Sites 1 2. Parameters 1 3. Scenarios 1 1. Colorado River nr CO-UT state line 2. Upstream Inflow 3. Historic climate scenario
Proposed data display Elements 1. Sites 1 2. Parameters 1 3. Scenarios 1 1. Colorado River nr CO-UT state line 2. Upstream Inflow 3. 2070 G climate scenario
New product display Elements 1. Sites 1 2. Parameters 1 3. Scenarios 2 1. Colorado River nr CO-UT state line 2. D Upstream Inflow (new) 3. (2070 G) (Historic)
Potential new products Elements A. B. C. D. E. Sites 1 2 1 1 multiple Parameters 1 1 2 1 multiple Scenarios 1 1 1 2 multiple A. Temporal signature B. Up and downstream - or - basin to basin comparison C. Dual parameter comparison D. Scenario difference comparison (as shown earlier) E. More complex intercomparisons
ArcMap plot