Data quality assurance for Basin-scale real-time water quality management

Transcription

1 Data quality assurance for Basin-scale real-time water quality management Nigel W.T. Quinn, PhD, P.E., D.WRE Berkeley National Laboratory US Bureau of Reclamation February 24, 2014

2 ACKNOWLEDGMENTS US Bureau of Reclamation : Dr. Jobaid Kabir Roberta Tassey Dr. Jun Wang Michael Mosley Regional Water Quality Control Board : Jim Brownell California Dept. of Water Resources : Ernie Taylor Joe Tapia Westside Drainage Authority : Joe McGahan Kisters International Inc. : Noah Walker Klaus Kisters

3 SALINITY REGULATION IN WESTERN SAN JOAQUIN VALLEY OF CALIFORNIA The Central Valley Regional Water Quality Control Board has adopted an alternative stakeholder-centric approach to salinity planning and regulation real-time salinity management Requires dischargers that are otherwise subject to WDR s to adopt a Board approved real-time salinity management program Program to include monitoring, real-time data access, modeling and decision support High reliance on sensor networks and the development of a stakeholder supported sensor web Compliance date in July 2014

4 DEFINITIONS ASSIMILATIVE CAPACITY The mass load of a pollutant that can be safely discharged to a receiving water without exceeding the water quality objective or standard for that pollutant. REAL-TIME WATER QUALITY MANAGEMENT A coordinated and cooperative set of actions based on realtime forecasts of river water quality to consistently meet water quality objectives

5

6 PROJECT OBJECTIVE Enhance decision support capability basin-wide to meet future TMDL salt load allocations Increase awareness of salt load export among water district managers and agency personnel use Grassland Water District as exemplar Satisfy CRWQCB criteria for development of a real-time water quality management program Development of monitoring networks Coordination of drainage salt load export Promote data and information sharing as it relates to salt load management data quality assurance Formation of a stakeholder institution responsible for Basin-wide salt management

7 MONITORING

8

9

10 LIMITATIONS OF YSI-EcoNET Provides data and time series plots of flow or EC for one site at a time can t visualize output for channels within entire district Time series plots of parameters tedious to create Can t calculate salt load reports only measured parameter values no QA capability Provides limited support for real-time salt export decision making can t combine data to view daily, weekly or monthly salt exports to Mud Slough and SJR Inability to share portions of data with public or State and Federal refuges all of site is either public or private (username and password protected)

11 CURRENT REAL-TIME DATA FLOW AND QUALITY ASSURANCE PROCESSING (GWD)

12 Visualization Tool Overview

13

14 DATA QUALITY CONTROL AND STAKEHOLDER ASSURANCE Stakeholders not used to data sharing Gun-shy of being over-cooperative with regulators Risk averse data may be used against them Many water districts cannot afford solutions requiring dedicated staff commitment some software solutions require high skill levels

15 REAL-TIME QA TOPICS COVERED Interpolation algorithms (linear, non-linear etc.) for missing time series data Out of bounds errors Sensor drift and fitting QA points Data shifts

16 QC/QA Control Bars Original data cannot be edited, cannot be deleted (Only duplicated values may be altered) Each time-series maintains QC flag information Each data point maintains QC flag information and remarks User defined Data Integrity (Plausibility/Validation) flags are auto generated. Altered data maintains audit trail (User, date altered, period of data altered description and/or comment) Color coded QC flags for easy interpretation Flyover popups provide detailed QC/QA information

17 The type of interpolation between two points of data can be set during the import of the original data. The interpolation type can be changed as data is used to make other derived time series using the transformation functions.

18 If Linear interpolation is chosen for a time series, WISKI will automatically draw a line between two successive points of data such that no visible gap in data appears. Validator and correction agents within WISKI allow you to insert gaps in your data based on user-defined rules (eg. Cannot have more than 1 hr distance between two data points).

19

20 Time series with many gaps Select an area you want to work on editing

21 Data gaps now filled and you can change the status and enter pre-defined remarks and free comments about the edit performed.

22 Data shift using the pop-up window options.

23 Data shift can also be applied manually in the graphical editing area, or in the table

24 Often sensors drift over time. WISKI allows you to correct for drift by linearly interpolating a correction to make values correlate with QA QC points (eg. manual observations).

25 AUTOMATED DRIFT CORRECTION OF REAL-TIME DATA IN WISKI Manual Readings

26

27 WISKI WEB PRO for Intranet WISKI WEB PUBLIC for Internet Display Compliance Levels Utilizes graphical user interface to access data Data can be copied from screen or downloaded

28

29 Future Work Customize tools with input from users Develop heuristics (simple expert systems) to make predictions of east-side reservoir releases and westside return flows Apply visualization tool in other Districts and along the SJR Upgrade sensor networks using WISKI-SODA to directly import real-time data into WISKI database