OpenDAP configuration course

Transcription

1 July 8, 2009(revision 646)

2 1 Introduction 2 Overview 3 Architecture 4 Components 5 Hyrax Backend server Backend configuration Run 6 Frontend 7 NetCDF 8 Extra

3 Time schedule 13:00-13:30 Project overview 13:30-14:00 System architecture 14:00-14:45 System setup excercise 14:45-15:00 Coffee break 15:00-15:30 NetCDF introduction 15:30-16:15 Configuration excercise 16:15-17:00 Tweaking

4 Projects using OpenDAP MICORE BwN Matroos

5 MICORE

6 MICORE June June 2011 Historical storms (UALG, PT) Data standards (TUD, NL) Site monitoring (BRGM, FR) Modelling (Deltares, NL) Warning system (IMDC, BE) Dissemination (SGSS, IT) Project management (CFR Ufe, IT)

7 Building with Nature Building with Nature is an innovative, long-term research programme aimed at developing new design concepts for the layout and sustainable exploitation of river, coastal and delta areas. Its special feature is the synergy and cooperation that will allow natural ecosystems and human intervention to reinforce each other. Ecology and technology are involved at all phases of a project: design, assessment, selection, construction and management. The primary goal is ecologically, technically and socially sustainable development.

8 Building with Nature Partners Boskalis Van Oord IHC Merwede Deltares IMARES SHELL Witteveen + Bos DHV Royal Haskoning Technical University Delft

9 Matroos MATROOS stands for Multifunctional Access Tool for Operational Oceandata Services. MATROOS gives you easily access using your internet browser to all recent and historical model and monitoring data relevant to the storm surge forecasts. MATROOS offers also the facility of an international near-real time multi-model forecast analysis: water level forecasting data and weather forecasting data from the NOOS partners around the North Sea can be intercompared.

10 Process

11 Extract

12 Transform

13 Load

14 Services

15 Provide

16 Extract Software Subversion provides version history, logging, changesets and filesystem storage for the raw data. The subversion server comes with the command line client. Apache provides authentication and authorization. Provides webdav for drive mapping. Hardware A fileserver is needed to store subversion repository. At Deltares we use drbd for high availability. Backup is needed to backup the repository.

17 Transform Software NetCDF itself should be installed as a library (dll for windows). Extra tools like nco and cdo for altering and combining netcdf files and gridspec-tools. Matlab TM is used for creating netcdf files from the raw data. Extra libraries required are mexnc and OpenEarthTools. Python is also used for creating netcdf files. Extra libraries are scipy and netcdf4-python Inspire guidelines are used to adhere to the ISO19115/119 standards. Use the editor to fill in metadata. Hardware Just a computer which can do some calculations.

18 Load Software OpenDAP server for giving access to generated netcdf files. We use hyrax and thredds. Tomcat runs java web applications. It is quite easy to setup. Apache runs as a reverse proxy in front of the tomcat, also again auth & auth. Hardware Fileserver should host the netcdf files. This one should probably be inside the DMZ. Use to upload files. Application server should host the Tomcat application. On the same machine as the fileserver for performance.

19 Provide Software OpenEarthTools contains a lot of matlab TM tools to work with the datasets. Open Source GUI tools for displaying and browsing netcdf files and opendap servers. Examples are ncbrowse, IDV, netcdf-ui. Geoserver server for running OGC services. Also a Tomcat application. Hardware Application server should host Tomcat application.

20 Hyrax

21 System setup excercise download hyrax

22 Downloading software download OLFS web archive download all rpm s below Linux CentOS 5.2 (i386) download tomcat 6

23 Extract rpms Extract rpms rpm2cpio f i l e n a m e. rpm c p i o idmv

24 Backend server Copy & Change script move to your home directory mv u s r e t c v a r Edit the besctl file to refer to instead of /usr/bin

25 Backend configuration Edit the configuration so it refers to your home directory edit configuration emacs nw / e t c / bes. c o n f

26 Run Run the backend server start bes cd / u s r / b i n. / b e s c t l s t a r t Create the directory /var/run mkdir / v a r / run cd / u s r / b i n. / b e s c t l s t a r t

27 Extract tomcat server Extract the java components of the server t a r x z f t a r x z f apache tomcat 6. t a r. gz o l f s webapp. t g z

28 NetCDF Data Model

29 Extra excercise Setup thredds server (15min) Configure thredds server (45min) Security settings (30min) Look at url rewriting (30min) Caching (30min) Command line tools (30min)