Don Bartley Technology Research. Open Source Activity at the Australian Bureau of Statistics

Transcription

1 Don Bartley Technology Research Open Source Activity at the Australian Bureau of Statistics

2 Purpose Abstract: The ABS has been exploring possibilities/opportunities with open source products and approaches over the last few years. These include platforms, developer tools and support, products for specific purposes, collaboration environments, licencing, communities of interest and practices and the open source philosophies underpinning them. The movement towards collaborative activities in developing and sharing ICT capabilities has been a major driver. The development of National Data Network using open source products and approaches has significantly improved our understanding, experiences and capabilities in this area. We have built an open source development stack (J-ABS) for use by developers; we have been using open source products (like the statistical system R); we have collaborated on projects (like Data Ferrett); we have collaborated with open source federated single signon and attribute exchange frameforks (like Shibboleth); we have explored licence issues with content usage (Creative Commons) and have been developing and encouraging community processes within the ABS. This presentation will touch on a number of these initiatives in the ABS.

3 Purpose Outline some open source activities at ABS Explorations, Tools, Communities Open source categories/topics NDN lead project, experience, skills Internal Developer Toolsets and support Some activities & explorations Communities CofIs (and CoPs) Conclude

4 Why Open Source? Collaboration and sharing drivers Build for external as well as internal usage Opportunities in using Open Source products.

5 What do we mean by open source? Platforms Products Developer tools and support Collaboration environments, projects Licences source code available Communities

6 National Data Network

7

8 one of the ABS s responses NDN Consortium Principles Data managed as an asset exposed as broadly as practicable used responsibly conditions of use privacy principles, applicable laws quality of data clearly described Work collaboratively, avoid duplication of effort

9 NDN Architecture using open source technology and standards NDN content (information resources*): documents, spreadsheets database files, presentations PDFs, MP3s links to resources found on the Web pod casts geospatial services statistical services SOAP Web services (e.g. ABS address coder) restful Web services * any type of file and almost any type of service NDN Public Search NDN Portal Discussion Forums Forum Members Web Browser NDN RichClient NDN Central NDN Node NDN Node NDN Catalogue NDN Members Resources Resources

10 NDN Current Collaborations Collaborative development agreement is in place with the US Census Bureau DataFerrett Collaboration on Shibboleth Federated Identity Management MAMS project (Macquarie Uni. MELCOE) Collaboration on Creation Commons (digital licence management)

11 Developer Toolset J-ABS

12

13 How do the technologies work together? Eclipse IDE ANT JUnit Tomcat JDK5 Frameworks RCP/SWT JAX-WS JSF Remoting Presentation (Logic) Tier Business Services Tier POJOS ResultSets Business Process Logic Tier Spring Hibernate Data Logic Tier JDBC Data Connector Tier Subversion Oracle MySQL Data Storage Tier

14 Some Activities and Explorations

15 Some Activities and Explorations 1 Activities are project linked or small tech futures explorations Data visualisation, animation, spatial GapMinder, Geoserver, Community Map builder, others Data element repositories, Terminology servers European Environ DER, CaCore, cadsr, EVS and DTS, Coders lucene search, mysql

16 Some Activities and Explorations - 2 Activities are project linked or small tech futures explorations: Single signon, identity, credentials Shibboleth for internal use? Survey Tools for internal usage Analytics Data Ferrett for internal usage R and others (used in RADL, and methodology) Others

17 Communities Communities of Practice Communities of Interest (CofIs) Collaboration/KM Green IT Open Source Systems Architecture (& project Jupiter) Testing XML

18 Wrapup Activities in many areas Platforms Products Developer tools and support Collaboration environments, projects Licences source code available Communities

19 Open Source Activity at the Australian Bureau of Statistics THANK YOU