GANDALF Software tool for time series data processing, management and reporting Introduction GANDALF is software for processing, control and presentation of time series data, mainly focused on urban drainage data processing. All of the tools and/or user defined links can be organized as separate projects equivalent to monitoring campaigns. There is number of procedures for dependent data calculations using empirical equations and regression relations. Software also supports various data formats of different monitoring devices, such as water level monitors, flowmeters, raingauges etc. Both, raw and processed data can be stored in different formats, including time series for mathematical simulation by DHI software. All time series can be browsed, edited and presented in text and/or graphical form. The picture "Gandalf screen" introduces the environment and the basic structure of the software. It gives the user an overview of the program features, editing facilities, graphical presentations etc. The main view/environment consists from two parts. In the left part of the view there is a tree corresponding to the programme structure, in the right part data are displayed corresponding to the selected branch. The handling of the structure is the same as in the view in different programs, e.g. Window Explorer, Internet Explorer, etc. The tree in the left part can be developed to various levels. The local menu for every active view can be displayed using the right mouse button. The menu differs with the type of selected element. Projects The category Project is the place where the user makes all data operating. New project could be created pressing the right mouse button on the item Projects. The local menu appears with options "New,
Delete, Rename and Properties". If New is selected, name of the project is automatically generated. The default directory for the data can be assigned using Properties in the local menu. Time series Every time series must be created in the TS branch before its first use. User creates new (empty) TS using the local menu item New Time Series. The first three items in the local menu (New, Delete, Rename) belongs to the standard ones, existing for all items. The command Open will open "Time series editor". Command Edit Flag command will open the editor, which is focused to the flag editing (for more information see following chapter). Data can be imported into the time series using pre defined imports including direct import of DHI data format as well as using standard Copy/Paste commands. Opening editor, data can be edited, inserted, deleted, copied and pasted using standard Windows commands. Command Edit Flag will open the editor, which is focused to the flag editing. Each individual record (date/time + value) can be labeled by any of the following flags: Edited, Computed, Mismatch, User. The first (Edited) and second (Computed) flag are automatically generated by the system in case the user perform editing/computation of the value/time series. User cannot customize those flags. The flag Mismatch is generated during the imports (for some of monitoring devices), but the user can edit them. The last flag (User) could be fully defined by the user. Flags can be edited individually and/or globally on selected data sets. The user can select zoom on the graphical part of the editor. After that the dialog for the flag modification can be opened by the click on the right mouse button on the top of the edited part of the window. Global selection can be modified in the combination of the time and/or value intervals. Actual graphical zoom can be used for those intervals after selecting the Zoom button. User can select, which flags [Mismatch or User] and to which status [no change, checked or not checked] will be set up. As the advance option the user can set up the additional condition for the flags. Those selections can be
used as an export filter and for computation. Flags can be visualised in the graphical part of the Flag Editor using the command from the local menu. Monitoring points This part of the programme is basically used for getting up of the project structure including data and objects, created in the other parts of the Gandalf. Time series, Monitoring Devices and Graphical presentations can be assigned to the Monitoring point. Also additional data can be saved for each of Monitoring points using the local menu, e.g, name, sewer type, co ordinates, GID ID etc.. Also Imports and Computations related to the monitoring site can be assigned to it here. All features, prepared in the other part of the project can be opened from this place. All data assigned to one monitoring point are used for standard reporting. The picture "Monitoring points" describes the way of monitoring project getting up assigning time series, imports, computations and graphical presentation to appropriate monitoring points. Graphical presentations Graphical Presentations in GANDALF include Time Series Graphs, Horizontal Plans, Scatter Graphs and Statistics.Time series can be presented in the graphical form. User can add a name to the definition of the particular presentation and use it in the future.
Time series graph A new presentation is created by using the function New in local menu. The maximum length of the gap in the data series represented as time interval where data are missing must be defined in the dialogue. There is a possibility to draw several graphs divided horizontally in the presentation view within one presentation. These graphical areas are inserted using a local menu Add view opened upper the presentation. A name must be given to the particular area. Every area contains a component for inserting time series that are drown accordingly to the primary or secondary Y axe. Time series added to the axes must exist (defined) in the menu Time series. Prepared presentation can be shown be using Open option in the local menu. See more on picture "Graphical presentations". Lot of different presentations can be prepared and after that used in one project. Each times series, even when it is used in more presentations, are loaded into the memory only once. More graphical presentations can be opened in one moment. Time series can be shifted in time by using the arrow keys or mouse. Pressing Esc key user can stop drawing of the series. Examples of Time Series Graph: Picture 1:
Picture 2: Picture 3:
Picture 4:
Horizontal plan Horizontal Plan can serve as basic navigation for whole system. Names, background bitmap image files and DXF files can be presented at Horizontal Plan. Fast navigation from point shown at Horizontal plan to Time serie graph is also available.
Scatter Graph Scatter Graph is graph of two time series, where the values from the same date and time from both time series are shown. Time series likewise their possible offset or converting to logarithm values, maximal time difference in seconds (only values from specified time series, which time difference is smaller than inserted number will be shown) and possibility of using Linear approximation is available.
Statistics Statistics of any Time Series can be shown by Duration Curve. HTML Presentation HTML presentation allows to save Timeserie plots, Horizontal plans and Scatter graphs into HTML file, which can be printed or presented later on. HTML Presentation is based on appropriate Graphical presentation, it means all parameters defined in Graphical presentation are taken in account for HTML Presentation. Computations The software can execute several types of dependent data computations. The user can define set of such computations. A name can be given to all these computations and they can be saved for the future use. Following computations are implemented in Gandalf: Exponential formula: Y = A *(x B)C + D Polynomial formula: Y = Ax4 + Bx3 + Cx2 + Dx + E Merge of time series: This computation merges two time series into one. User can define, which value will be used in the final TS in the case that values exist in both series for the same time step. The user must also define minimum time distance determining which time steps are identical. Manning formula including variable water level gradient and sediment table. User defines Manning coefficient and cross section of the monitoring site. Time series of the sediment depth can be used for description of the silt dynamics. Computation can be executed for constant water level slope or the slope can be dynamically computed from two time series of the water levels (depths). In this case both, vertical and horizontal distances of the water level monitoring sites must be defined. The user can also
select how many points from the time history will be used for the slope computation. Such averaging can help in the case of instabilities of depth measurement. In case of the negative slope zero discharges are computed and flag has marked the value. Equidistant this option is used for building the new time series with equidistant time step originating from the existing non equidistant one. Q velocity gives the possibility to compute discharge, which are based on the measured velocities, water levels, geometry of the profile and eventually time series of the sediment depth in the monitoring site. Q velocity gives the possibility to compute discharge, which are based on the measured velocities, water levels, geometry of the profile and eventually time series of the sediment depth in the monitoring site. V notch weir and rectangular weir using standard hydraulic equation for v notch weir Q = C * 8/15 * tg (alpha/2) * (2g)1/2 * h 5/2 and rectangular weir Q = C * 2/3 * (2g)1/2 * b * h 3/2 respectively. Linear combination allows the user to perform the linear combination (adding, subtraction, multiplication and division) of two time series. The multiplication factor is possible to assign each of performed time series. Average averaging (smoothing) the TS. The number of time steps which are being averaged is given by Counts and time step is assigned to defined a interval for computing a average value of this interval. The weight could be assigned to e given time step to compute weighed average. Time shift shifting the whole TS over given time. If the is box Shif to the Past checked the shift is done over the clock. Accumulative curve defines accumulative curve from the source data. Mask/Flag TransferMask Transfer and Flag Transfer are two different (but similar) processes, which set flags in TS, usually according to flags in another TS.
Imports/Exports Data can be imported/exported into/from the internal data format from the different range of the file formats provided by measuring devices (ADS, Accusonic, AGF, Fiedler, NOEL, Sigma,.). Also direct input/output of DHI text format (MOUSE.TXT) is supported. The offset and multiplication factor can be applied during the import. Import/Export definition (including parameters) can be saved for future use. The user can see a part of the imported file as the help for format selection. Time series are fully rewritten by the imported data. User can import new data into temporally time series and after that connect it to the existing time series. The picture "Imports" advice the user how to import external data files using the example of data measured by ADS 3600 flow monitor. The new ("Temporary") time series is created and data of water depth (originally in mm) are imported to the time series as water depth in meters. User Defined Import/Export User Defined Import/Exports allows to import any data from TXT file or export data to TXT file. This option extends standard predefined import and export formats defined in Import and Export menu. It allows to user modify the Import/Export based on individual needs and it allows to import data containing more than tree changes in one data field. To run the Import/Export you need to prepare and attach a script file which supports particular data format.
Items The items that will be measured within the monitoring campaigns are predefined in menu Items (e.g. water level, discharge, velocity, rain intensity, concentration, load, etc.). Here can be defined also secondary units for the above mentioned quantities (l/s, m3/s, ) together with the checking parameters. These units can be used in the graphical presentations and the composition of reports. The picture "Items" shows the user how to create an item, to define units and how to assign the item to selected time series. Picture also explains the sub item feature.
Devices A definition of monitoring equipment used in all projects can be found in the menu Devices. Before adding the specific device to the Monitoring Point the device must be created in this group. The video "Devices" describes how to create a device and assign it to the monitoring point.