This vision will be accomplished by targeting 3 Objectives that in time are further split is several lower level sub-objectives:

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "This vision will be accomplished by targeting 3 Objectives that in time are further split is several lower level sub-objectives:"

Transcription

1 Title: Common solution for the (very-)large data challenge Acronym: VLDATA Call: EINFRA-1 (Focus on Topic 5) Deadline: Sep. 2nd 2014 This proposal complements: Title: e-connecting Scientists Call: EINFRA-9 (VRE) Deadline: Jan. 14th Objectives: The mission/vision/endgoal of VLDATA is to provide a common solution for handling large and extremely large common scientific data in a costeffective way. This solution builds on existing pan-european e- Infrastructure and tools to provide an interoperable, efficient and sustainable platform for scientific user communities, in particular, to support a new generation of data scientists. The success of this project will secure European leadership on the development and support of big data and global data science and, therefore, will contribute to the leadership of European scientists and enterprises in many research and innovation fields :) This vision will be accomplished by targeting 3 Objectives that in time are further split is several lower level sub-objectives: O1: a "flexible and extendable" platform supporting common solutions for large scale distributed data processing and analysis, ensuring interoperability among existing e-infrastructure providers. * O1.1: (WP2,3,5) provide a common solution using generic e-infrastructure for processing large scale or extremely large scale of scientific data in a robust, efficient and cost-effective way. * O1.2: (WP6) provide a flexible and customizable platform that can be extended to cover the specific requirements of each community. O2: standardized solutions aiming to a global interoperability of open access for large-scale data processing, minimizing unnecessary large transfers * O2.1: (WP2) provide common language and standard for handling big volume of data * O2.2: (WP2,3,5) improve the efficiency of distributed data processing by providing smart data and computing management platform * O2.3: (WP2,3,5) enable effective handling of big data samples by

2 integrating new technologies * O2.4: (WP8) assess the value of this generic solution towards relevant stakeholders: end scientists, their management, funding agencies, policy makers, companies and the society at large O3: Increase the number of users and Research Infrastructure projects making efficient use of existing e-infrastructure resources, designing appropriate exploitation strategies and a long-term sustainability plan. * O3.1: (WP5,7) deliver ready-to-use high-quality standard products for internal and external usage, enhancing interdisciplinary dat sciences at a global scale * O3.2: (WP6,9) increase the degree of the open access of large scale distributed data * O3.3: (WP9) educate new generation of data scientists and the society in general 1.3 Concept and approach - Concepts (main ideas, models and assumptions): make IT simple * Simplicity: VLDATA provides an abstraction of the different Resources that are all made accessible the end user via the same interfaces. * Transparency: Users are allowed to specify their Workflows/Pipelines with different levels of abstractions. The platform takes care of the necessary Resource Allocation to fulfill the required specifications. * Extendability and flexibility: VLDATA provides an API that allows users to extend the provided functionality by developing new or customized components * Reliability: Quality standards and extensive validation in several scientific domains to ensure the readiness-to-use and robustness of VLDATA based solutions * Scalability: Modular implementation allowing horizontal (amount of connected Resources or Users) and vertical (amount of processed Units) scaling to adapt VLDATA to the needs of each particular community or Research Infrastructure project. * Smart and intelligent: building on collected experience and monitoring

3 data, algorithm can look for optimized scheduling/searching strategies, including automated decision making based on usage traces and expectations. * Cost-effective: Building up on existing well-established solutions and incrementally extending and developing to address new challenges with an evolving validated common solution, avoiding unnecessary duplicated efforts. * Resource description semantic Model (building blocks): - Collaborative modular architecture, with multiple layers sharing the same Framework and Basic modules, allowing horizontal & vertical scaling to ensure scalability. - Open, iterative, incremental and parallel, requirement-driven development process. Agile(?) methodology. - Standard procedures for quality assurance, including security, platform integration and validation, including reference benchmarks, and release procedures in accordance with requirements for production level services. Layers: (result of 10 evolution of DIRAC development effort) - Framework: (communication, security, access control, user/group management, DBs) - Basic modules: SystemLogging, Configuration, Accounting, Monitoring - Low level modules: File Catalog, Resource Status, Request Management, Workload Management - High level modules: Data Management, Workflow Management - Interfaces: User - Resource Assumption: [Describe and explain the overall concept underpinning the project. Describe the main ideas, models or assumptions involved. Identify any trans-disciplinary considerations;] - Current solution can be evolved into the new general platform to be widely applied. - Evolution from grids to clouds, but heterogeneity will increased - Large degree of commonality on low-level requirements and tools between different scientific domains - Fast grow of data and computing requirements almost doubling every year. Aggregated estimation close exabyte level in 5 years from now (EGI expects Cores and 1?? exabyte of scientific data by 2020). (Ref: - Similar grow in number of data objects, computing units and end users (60

4 % of ESFRI projects completed or launched by 2015). - New scientific domains are entering the digital era 4th paradigm of science, new data science is emerging ( collaboration/fourthparadigm/) - Data is to be made openly available beyond the community that produced them, down to the citizens that might also contribute to its further processing - Common development and validation provides robustness as well as costsaving and, thus, enables sustainability - TRL [Describe the positioning of the project e.g. where it is situated in the spectrum from "idea to application", or from "lab to market". Refer to Technology Readiness Levels where relevant.] From 5-6 towards Links [Describe any national or international research and innovation activities which will be linked with the project, especially where the outputs from these will feed into the project;] (Past Inputs) * building on 15 year HEP experience, transferring this expertise and knowledge to other domains * DataGrid -> EGI, WLCG, NorduGrid, OSG, NeCTAR, EUDAT (Concurrent inputs) * EIROForum: (e-infrastructure commons architecture, p, 19) * Forth paradigm of science, (e-infrastructure providers) * EUDAT-2, EGI-2, EduGain, RDA, SWAMP, GEANT, PRACE, NRENs, Commercial Providers (Technology providers) DIRAC dcache InSilicoLab ARC (Clients) * ESFRIs * ESFRI-clusters * other Relevant Research Infrastructure projects (like those in the European strategy for particle physics) at national or international level, that may or may not have yet access to large resources the e-infrastructure * Other data sources: Smart cities, sensor networks, (Competitors, possible future partners)

5 Condor (misses connection Workload - Data) Panda (misses generality) glite (misses community management, too complex) globus-online Related Work Commercial cloud solutions HelixNebula Microsoft Azure GoogleApps Research Community <-> Experiments (Research Infrastructure projects) 1.4 Ambition [Describe the advance your proposal would provide beyond the state-of-theart, and the extent the proposed work is ambitious. Your answer could refer to the ground-breaking nature of the objectives, concepts involved, issues and problems to be addressed, and approaches and methods to be used. Describe the innovation potential which the proposal represents. Where relevant, refer to products and services already available on the market. Please refer to the results of any patent search carried out.] - Methodology G. Technology readiness levels (TRL) Where a topic description refers to a TRL, the following definitions apply, unless otherwise specified: -TRL 1: basic principles observed -TRL 2: technology concept formulated -TRL 3: experimental proof of concept -TRL 4: technology validated in lab -TRL 5: technology validated in relevant environment (industrially relevant environment in the case of key enabling technologies) -TRL 6: technology demonstrated in relevant environment (industrially relevant environment in the case of key enabling technologies) -TRL 7: system prototype demonstration in operational environment -TRL 8: system complete and qualified -TRL 9: actual system proven in operational environment (competitive manufacturing in the case of key enabling technologies; or in space)

6 2. Impact 2.1 Expected impact [Please be specific, and provide only information that applies to the proposal and its objectives. Wherever possible, use quantified indicators and targets.] [The mission/vision/end-goal of VLDATA is to provide a common solution for handling large and extremely large common scientific data in a costeffective way. This solution builds on existing pan-european e- Infrastructure and tools to provide an interoperable, efficient and sustainable platform for scientific user communities, in particular, to support a new generation of data scientists. The success of this project will secure European leadership on the development and support of big data and global data science and, therefore, will contribute to the leadership of European scientists and enterprises in many research and innovation fields :)] DIRECT impact. scalability, robustness (for the Research Infrastructure) The expected impact is that participating RI projects will be able to operate their Distributed Computing Systems efficiently processing their large volume research data, making it available to their end users in reliable and cost-effective way, which couldn't be achieved before, which may lead to new way of organizing science activities, leading to significant scientific break throughs. By providing important functional components (e.g., ) which was missing from existing practices, VLDATA platform will make possible the transparent integration of resources, hiding the complexity from use, resulting in the extension of the scale of the resources Resource Infrastructure projects can utilize. This will increase the number of RI using the project tools and the number of different types of resources reachable through the tools. :) simplicity (for the user: scientist/operator) cost-efficiency (for funding agencies) reduce the duplication efforts, maximizing the use of EU-invest e- Infrastructures, enlarging the user communities, providing efficient data processing services, providing advanced technology by integrating the state-of-the-art which reduces development cost significantly. (also the processing algorithm ) avoid lock-in Indirect impact: large user community

7 - science - innovation - society - industry - citizens - policy maker - new generation data scientists On the other hand, the scale of the data challenge requires simple but intelligent solutions to integrate resources from different e- Infrastructure providers. 2.2 Measures to maximize impact a) Dissemination and exploitation of results [Dissemination and exploitation measures should address the full range of potential users and uses including research, commercial, investment, social, environmental, policy making, setting standards, skills and educational training.] [The approach to innovation should be as comprehensive as possible, and must be tailored to the specific technical, market and organizational issues to be addressed.] b) Communication activities [Describe the proposed communication measures for promoting the project and its findings during the period of the grant. Measures should be proportionate to the scale of the project, with clear objectives. They should be tailored to the needs of various audiences, including groups beyond the project's own community. Where relevant, include measures for public/societal engagement on issues related to the project.] c) Internationalization WP6:

8 Belle II: - Usage of DIRAC for the Experiment, use case presented: * Common access to various platforms: Grid + cloud + cluster + HPC * Support for Monitoring for Workflow management tools * Integrate for the needs of other participants * User interface EU-T0: Virtual data centers / New Virtualization techniques? PAO: - Usage of DIRAC for the Experiment, data taking -> 2022 * using a standard solution will help the sustainability. * Extend functionality for their use case. * Common access to various platforms: Grid + cloud + cluster + HPC (follow evolution of providers) in particular OSG * Open Access to data EU-T0: Data locality LHCb: - should cover Run 2 needs and target to the needs of Run 3 (DAQ Upgrade) * Data rate will be increase by a factor ~5, 10 PB/year. * Integration of Cloud resources. * Massive data-driven Workflows for users. * Data preservation (?) * Resource (cpu/storage/network/...) description/monitoring/availability/ management, smart allocation * Smart/Intelligent/dynamic data placement strategies (network) EU-T0: New Virtualization techniques, Resource description/monitoring/ availability, Virtual data centers, Data locality EISCAT_3D: * searching data (metadata catalog), intelligent searching (patterns recognition) * visualization, * flexible interconnection of different resources, central (HPC) + distributed (Grid/Cloud) * time constrained massive data reduction (10 PB -> 1 PB / month??), including the possibility for users defined algorithm. EU-T0: Others: - EU-T0: - Virtual distributed data centers on demand (STN) - Data locality (Smart/Intelligent/dynamic data placement strategies (STN)) - New Virtualization techniques

9 WP1 Coordination (UB, Spain) External Advisory board (EUDAT, OGF, RDA, OSG, ) WP2 Requirement analysis & Design (CU, UK) WP3 Data-driven development( UB, Spain) WP4 User-driven development( CYFRONET, Poland) WP5 ( UAB, Spain) WP6 XXXXXX - LHCb (CNRS/INFN) - Belle II (Institut Jozef Stefan, UniMB, Mariborand UniLJ,Slovenia) - EISCAT_3D (SNIC, Sweden/EISCAT Science Associate) - PAO (CESNET, Czech Republic) - BES III (INFN-Torino, Italy) - XXXX - YYYY - DIRAC 4 EGI, multi-community solution EGI ( EGI.eu, the Netherlands) WP7 Dissemination (CNRS, France) EGI.eu EUDAT? WP8 Exploitation (ETL, UK) Open DISData Collaboration WP9 Communication, Internationalization (UvA, the Netherlands) DIRAC Consortium, EGI.eu WP 7 -> WP 9 Communication (Internationalization) WP 8 -> Exploitation (business/revenue model) WP 9 -> WP 7 Dissemination (+training) Description Objectives Tasks -> Deliverables Outputs (Internal + External) Risks Possible relevant Milestone

10

Horizon 2020. Research e-infrastructures Excellence in Science Work Programme 2016-17. Wim Jansen. DG CONNECT European Commission

Horizon 2020. Research e-infrastructures Excellence in Science Work Programme 2016-17. Wim Jansen. DG CONNECT European Commission Horizon 2020 Research e-infrastructures Excellence in Science Work Programme 2016-17 Wim Jansen DG CONNECT European Commission 1 Before we start The material here presented has been compiled with great

More information

Workprogramme 2014-15

Workprogramme 2014-15 Workprogramme 2014-15 e-infrastructures DCH-RP final conference 22 September 2014 Wim Jansen einfrastructure DG CONNECT European Commission DEVELOPMENT AND DEPLOYMENT OF E-INFRASTRUCTURES AND SERVICES

More information

INDIGO DataCloud. Technical Overview RIA-653549. Giacinto.Donvito@ba.infn.it. INFN-Bari

INDIGO DataCloud. Technical Overview RIA-653549. Giacinto.Donvito@ba.infn.it. INFN-Bari INDIGO DataCloud Technical Overview RIA-653549 Giacinto.Donvito@ba.infn.it INFN-Bari Agenda Gap analysis Goals Architecture WPs activities Conclusions 2 Gap Analysis Support federated identities and provide

More information

EGI Compute and Data Services for Open Access in H2020

EGI Compute and Data Services for Open Access in H2020 EGI Compute and Data Services for Tiziana Ferrari Technical Director, EGI.eu tiziana.ferrari@egi.eu 25/02/14 1 EGI-InSPIRE RI-261323 Outline What is EGI? Services for Researchers Supporting Open Access

More information

Scalable End-User Access to Big Data http://www.optique-project.eu/ HELLENIC REPUBLIC National and Kapodistrian University of Athens

Scalable End-User Access to Big Data http://www.optique-project.eu/ HELLENIC REPUBLIC National and Kapodistrian University of Athens Scalable End-User Access to Big Data http://www.optique-project.eu/ HELLENIC REPUBLIC National and Kapodistrian University of Athens 1 Optique: Improving the competitiveness of European industry For many

More information

e-infrastructures: a digital game changer

e-infrastructures: a digital game changer e-infrastructures: a digital game changer Pisa, 14 July 2015 Carlos Morais Pires European Commission e-infrastructures, DG CNECT.C1 Author s views do not commit the European Commission summary 1/ Policy

More information

Interaction with other IT projects: EUDAT2020, VLDATA, ENVRI PLUS,

Interaction with other IT projects: EUDAT2020, VLDATA, ENVRI PLUS, Interaction with other IT projects: EUDAT2020, VLDATA, ENVRI PLUS, A. Spinuso, L. Trani, A. Strollo and D. Bailo EPOS PP final meeting, Rome, 22-24 October 2014 OUTLINE WG1 and the EIDA use case A modular

More information

Achieve Economic Synergies by Managing Your Human Capital In The Cloud

Achieve Economic Synergies by Managing Your Human Capital In The Cloud Achieve Economic Synergies by Managing Your Human Capital In The Cloud By Orblogic, March 12, 2014 KEY POINTS TO CONSIDER C LOUD S OLUTIONS A RE P RACTICAL AND E ASY TO I MPLEMENT Time to market and rapid

More information

The challenge of managing research data. Axel Berg

The challenge of managing research data. Axel Berg The challenge of managing research data Axel Berg Context The data deluge cannot be stopped Without adequate data management: - the ever-growing amounts and complexity of data will be non-controllable

More information

WORK PROGRAMME 2014 2015 Topic ICT 9: Tools and Methods for Software Development

WORK PROGRAMME 2014 2015 Topic ICT 9: Tools and Methods for Software Development WORK PROGRAMME 2014 2015 Topic ICT 9: Tools and Methods for Software Development Dr. Odysseas I. PYROVOLAKIS European Commission DG CONNECT Software & Services, Cloud odysseas.pyrovolakis@ec.europa.eu

More information

Enterprise SOA Strategy, Planning and Operations with Agile Techniques, Virtualization and Cloud Computing

Enterprise SOA Strategy, Planning and Operations with Agile Techniques, Virtualization and Cloud Computing Enterprise SOA Strategy, Planning and Operations with Agile Techniques, Virtualization and Cloud Computing Presented by : Ajay Budhraja, Chief, Enterprise Services ME (Engg), MS (Mgmt), PMP, CICM, CSM,

More information

Challenges in Hybrid and Federated Cloud Computing

Challenges in Hybrid and Federated Cloud Computing Cloud Day 2011 KTH-SICS Cloud Innovation Center and EIT ICT Labs Kista, Sweden, September 14th, 2011 Challenges in Hybrid and Federated Cloud Computing Ignacio M. Llorente Project Director Acknowledgments

More information

EU H2020 funding opportunities. Mauro Morandin INFN PD

EU H2020 funding opportunities. Mauro Morandin INFN PD EU H2020 funding opportunities Mauro Morandin INFN PD Agenda Introduction and some general comments Examples of opportunities in Excellent Science National programs Conclusions 2 The issue of sustainability

More information

e-irg workshop Dublin 22-23 May 2013 Track 1: Coordination of e-infrastructures

e-irg workshop Dublin 22-23 May 2013 Track 1: Coordination of e-infrastructures e-irg workshop Dublin 22-23 May 2013 Track 1: Coordination of e-infrastructures Rossend Llurba e-irgsp3 Track 1 2 sessions Session 1 (Chair: Lajos Balint) 4 presentations Bob Jones Stephen Moffat Sandra

More information

Concept and Project Objectives

Concept and Project Objectives 3.1 Publishable summary Concept and Project Objectives Proactive and dynamic QoS management, network intrusion detection and early detection of network congestion problems among other applications in the

More information

9360/15 FMA/AFG/cb 1 DG G 3 C

9360/15 FMA/AFG/cb 1 DG G 3 C Council of the European Union Brussels, 29 May 2015 (OR. en) 9360/15 OUTCOME OF PROCEEDINGS From: To: Council Delegations RECH 183 TELECOM 134 COMPET 288 IND 92 No. prev. doc.: 8970/15 RECH 141 TELECOM

More information

Status and Evolution of ATLAS Workload Management System PanDA

Status and Evolution of ATLAS Workload Management System PanDA Status and Evolution of ATLAS Workload Management System PanDA Univ. of Texas at Arlington GRID 2012, Dubna Outline Overview PanDA design PanDA performance Recent Improvements Future Plans Why PanDA The

More information

Private Cloud for the Enterprise: Platform ISF

Private Cloud for the Enterprise: Platform ISF Private Cloud for the Enterprise: Platform ISF A Neovise Vendor Perspective Report 2009 Neovise, LLC. All Rights Reserved. Background Cloud computing is a model for enabling convenient, on-demand network

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

EGI Federated Cloud, a building block for the Open Science Commons

EGI Federated Cloud, a building block for the Open Science Commons EGI Federated Cloud, a building block for the Open Science Commons Yannick LEGRÉ Director, EGI.eu www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under

More information

Reaching for the cloud: the potential and the reality of using cloud-based platforms. Speaker: Michael Michaelides October 22, 2015

Reaching for the cloud: the potential and the reality of using cloud-based platforms. Speaker: Michael Michaelides October 22, 2015 Reaching for the cloud: the potential and the reality of using cloud-based platforms Speaker: Michael Michaelides October 22, 2015 Within today s financial services (FS) marketplace, speed to market, agility

More information

8970/15 FMA/AFG/cb 1 DG G 3 C

8970/15 FMA/AFG/cb 1 DG G 3 C Council of the European Union Brussels, 19 May 2015 (OR. en) 8970/15 NOTE RECH 141 TELECOM 119 COMPET 228 IND 80 From: Permanent Representatives Committee (Part 1) To: Council No. prev. doc.: 8583/15 RECH

More information

Essential Elements of an IoT Core Platform

Essential Elements of an IoT Core Platform Essential Elements of an IoT Core Platform Judith Hurwitz President and CEO Daniel Kirsch Principal Analyst and Vice President Sponsored by Hitachi Introduction The maturation of the enterprise cloud,

More information

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling Miguel Cárdenas-Montes on behalf of Euforia collaboration Ibergrid 2008 May 12 th 2008 Porto Outline Project Objectives Members

More information

SIMATIC IT Production Suite Answers for industry.

SIMATIC IT Production Suite Answers for industry. Driving Manufacturing Performance SIMATIC IT Production Suite Answers for industry. SIMATIC IT at the intersection of value creation processes With SIMATIC IT, Siemens is broadening the scope of MES. Plant

More information

PRACE in building the HPC Ecosystem Kimmo Koski, CSC

PRACE in building the HPC Ecosystem Kimmo Koski, CSC PRACE in building the HPC Ecosystem Kimmo Koski, CSC 1 Petaflop computing First Steps and Achievements Production of the HPC part of the ESFRI Roadmap; Creation of a vision, involving 15 European countries

More information

Deploying Multiscale Applications on European e-infrastructures

Deploying Multiscale Applications on European e-infrastructures Deploying Multiscale Applications on European e-infrastructures 04/06/2013 Ilya Saverchenko The MAPPER project receives funding from the EC's Seventh Framework Programme (FP7/2007-2013) under grant agreement

More information

High Performance Computing in Horizon 2020. February 26-28, 2014 Fukuoka Japan

High Performance Computing in Horizon 2020. February 26-28, 2014 Fukuoka Japan High Performance Computing in Horizon 2020 Big Data and Extreme Scale Computing Workshop 51214 February 26-28, 2014 Fukuoka Japan Excellence in Science DG CONNECT European Commission Jean-Yves Berthou

More information

secure intelligence collection and assessment system Your business technologists. Powering progress

secure intelligence collection and assessment system Your business technologists. Powering progress secure intelligence collection and assessment system Your business technologists. Powering progress The decisive advantage for intelligence services The rising mass of data items from multiple sources

More information

IMPORTANT PROJECT OF COMMON EUROPEAN INTEREST (IPCEI)

IMPORTANT PROJECT OF COMMON EUROPEAN INTEREST (IPCEI) IMPORTANT PROJECT OF COMMON EUROPEAN INTEREST (IPCEI) ON HIGH PERFORMANCE COMPUTING AND BIG DATA ENABLED APPLICATIONS (IPCEI-HPC-BDA) European Strategic Positioning Paper Luxembourg, France, Italy (& Spain)

More information

White Paper Case Study: How Collaboration Platforms Support the ITIL Best Practices Standard

White Paper Case Study: How Collaboration Platforms Support the ITIL Best Practices Standard White Paper Case Study: How Collaboration Platforms Support the ITIL Best Practices Standard Abstract: This white paper outlines the ITIL industry best practices methodology and discusses the methods in

More information

EGI services for distribution and federation of data and computing

EGI services for distribution and federation of data and computing EGI services for distribution and federation of data and computing Tiziana Ferrari Technical Director, EGI.eu tiziana.ferrari@egi.eu March 2014 EGI-InSPIRE RI-261323 1 Accelerating Excellent Science MISSION.

More information

Architecture Principles

Architecture Principles Architecture Principles Table of Contents 1 GENERAL INFORMATION...2 2 INTENT...2 3 OWNERSHIP...2 4 APPLYING THE PRINCIPLES...2 5 ARCHITECTURAL OBJECTIVES...2 6 ARCHITECTURE PRINCIPLES...3 6.1 General...

More information

egov-bus Advanced egovernment Information Service Bus

egov-bus Advanced egovernment Information Service Bus egov-bus Advanced egovernment Information Service Bus egov-bus Advanced egovernment Information Service Bus (IST-4-026727-STP) January 2006 December 2008 The egov-bus was STREP (Specific Targeted Research

More information

for Oil & Gas Industry

for Oil & Gas Industry Wipro s Upstream Storage Solution for Oil & Gas Industry 1 www.wipro.com/industryresearch TABLE OF CONTENTS Executive summary 3 Business Appreciation of Upstream Storage Challenges...4 Wipro s Upstream

More information

CERN s Scientific Programme and the need for computing resources

CERN s Scientific Programme and the need for computing resources This document produced by Members of the Helix Nebula consortium is licensed under a Creative Commons Attribution 3.0 Unported License. Permissions beyond the scope of this license may be available at

More information

Bob Jones Technical Director bob.jones@cern.ch

Bob Jones Technical Director bob.jones@cern.ch Bob Jones Technical Director bob.jones@cern.ch CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST-2003-508833 EGEE Goal & Strategy Goal: Create a wide

More information

ICT 30-2015: Internet of Things and Platforms for Connected Smart Objects

ICT 30-2015: Internet of Things and Platforms for Connected Smart Objects LEIT ICT WP2014-15 ICT 30-2015: Internet of Things and Platforms for Connected Smart Objects Francisco Ibanez-Gallardo DG CONNECT, Network Technologies Werner Steinhögl DG CONNECT, Complex Systems & Advanced

More information

EUDAT. Collaborative Data Infrastructure. Towards the convergence of Compute, Data, Knowledge and Scientific Instruments. Giuseppe Fiameni CINECA

EUDAT. Collaborative Data Infrastructure. Towards the convergence of Compute, Data, Knowledge and Scientific Instruments. Giuseppe Fiameni CINECA EUDAT Collaborative Data Infrastructure Towards the convergence of Compute, Data, Knowledge and Scientific Instruments Giuseppe Fiameni CINECA www.eudat.eu EUDAT receives funding from the European Union's

More information

White Paper: Cloud for Service Providers

White Paper: Cloud for Service Providers White Paper: Cloud for Service Providers September 2011 Cloud for Service Providers This paper describes the architectural outline of an infrastructure as a Service (IaaS) cloud that Zimory built for an

More information

Data Analytics, Management, Security and Privacy (Priority Area B)

Data Analytics, Management, Security and Privacy (Priority Area B) PRIORITY AREA B: DATA ANALYTICS, MANAGEMENT, SECURITY AND PRIVACY ACTION PLAN Data Analytics, Security and Privacy (Priority Area B) Context Data is growing at an exponential rate; information on the web

More information

NIST Cloud Computing Program Activities

NIST Cloud Computing Program Activities NIST Cloud Computing Program Overview The NIST Cloud Computing Program includes Strategic and Tactical efforts which were initiated in parallel, and are integrated as shown below: NIST Cloud Computing

More information

KPMG Advisory. Microsoft Dynamics CRM. Advisory, Design & Delivery Services. A KPMG Service for G-Cloud V. April 2014

KPMG Advisory. Microsoft Dynamics CRM. Advisory, Design & Delivery Services. A KPMG Service for G-Cloud V. April 2014 KPMG Advisory Microsoft Dynamics CRM Advisory, Design & Delivery Services A KPMG Service for G-Cloud V April 2014 Table of Contents Service Definition Summary (What s the challenge?)... 3 Service Definition

More information

Cloud Computing Paradigm

Cloud Computing Paradigm Cloud Computing Paradigm Julio Guijarro Automated Infrastructure Lab HP Labs Bristol, UK 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

More information

Make the Most of Big Data to Drive Innovation Through Reseach

Make the Most of Big Data to Drive Innovation Through Reseach White Paper Make the Most of Big Data to Drive Innovation Through Reseach Bob Burwell, NetApp November 2012 WP-7172 Abstract Monumental data growth is a fact of life in research universities. The ability

More information

Microsoft Research Worldwide Presence

Microsoft Research Worldwide Presence Microsoft Research Worldwide Presence MSR India MSR New England Redmond Redmond, Washington Sept, 1991 San Francisco, California Jun, 1995 Cambridge, United Kingdom July, 1997 Beijing, China Nov, 1998

More information

HEP Software Collaboration Governance, Fermilab Perspective!

HEP Software Collaboration Governance, Fermilab Perspective! HEP Software Collaboration Governance, Fermilab Perspective Panagiotis Spentzouris, with Daniel Elvira and Rob Roser HEP Software Collaboration Meeting CERN, April 3 rd 2014 HEP Computing Facing Many Challenges

More information

Federation of Cloud Computing Infrastructure

Federation of Cloud Computing Infrastructure IJSTE International Journal of Science Technology & Engineering Vol. 1, Issue 1, July 2014 ISSN(online): 2349 784X Federation of Cloud Computing Infrastructure Riddhi Solani Kavita Singh Rathore B. Tech.

More information

Workspaces Concept and functional aspects

Workspaces Concept and functional aspects Mitglied der Helmholtz-Gemeinschaft Workspaces Concept and functional aspects A You-tube for science inspired by the High Level Expert Group Report on Scientific Data 21.09.2010 Morris Riedel, Peter Wittenburg,

More information

OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds

OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds sm OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds SM Table of Contents Legal Notice... 3 Executive Summary... 4 Purpose... 5 Overview... 5 Interoperability... 6 Service

More information

Proposal template (technical annex) Health, demographic change and wellbeing Two-stage Research and Innovation actions Innovation actions

Proposal template (technical annex) Health, demographic change and wellbeing Two-stage Research and Innovation actions Innovation actions Proposal template (technical annex) Health, demographic change and wellbeing Two-stage Research and Innovation actions Innovation actions Note: This is for information only. The definitive templates to

More information

HOW TO DO A SMART DATA PROJECT

HOW TO DO A SMART DATA PROJECT April 2014 Smart Data Strategies HOW TO DO A SMART DATA PROJECT Guideline www.altiliagroup.com Summary ALTILIA s approach to Smart Data PROJECTS 3 1. BUSINESS USE CASE DEFINITION 4 2. PROJECT PLANNING

More information

Cloud and Big Data Standardisation

Cloud and Big Data Standardisation Cloud and Big Data Standardisation EuroCloud Symposium ICS Track: Standards for Big Data in the Cloud 15 October 2013, Luxembourg Yuri Demchenko System and Network Engineering Group, University of Amsterdam

More information

CONNECTING DATA WITH BUSINESS

CONNECTING DATA WITH BUSINESS CONNECTING DATA WITH BUSINESS Big Data and Data Science consulting Business Value through Data Knowledge Synergic Partners is a specialized Big Data, Data Science and Data Engineering consultancy firm

More information

EUDAT. Towards a pan-european Collaborative Data Infrastructure

EUDAT. Towards a pan-european Collaborative Data Infrastructure EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland EISCAT User Meeting, Uppsala,6 May 2013 2 Exponential growth Data trends Zettabytes

More information

Overview. EU Energy Focus. Key aspects of Horizon 2020. EU Energy Focus. Funding Actions eligibility and funding rates

Overview. EU Energy Focus. Key aspects of Horizon 2020. EU Energy Focus. Funding Actions eligibility and funding rates Overview Addressing the evaluation criteria 12 th March 2015 Introduction Topics covered by May deadline Evaluation criteria Key messages Evaluator comments Common feedback services Funded by the Department

More information

Federated Identity Management Interest Group

Federated Identity Management Interest Group 1 Federated Identity Management Interest Group The FIM interest group (FIMig) is an international crossdomain interest group to work on all issues related to the use FIM for the implementation of AAIs

More information

Unterstützung datenintensiver Forschung am KIT Aktivitäten, Dienste und Erfahrungen

Unterstützung datenintensiver Forschung am KIT Aktivitäten, Dienste und Erfahrungen Unterstützung datenintensiver Forschung am KIT Aktivitäten, Dienste und Erfahrungen Achim Streit Steinbuch Centre for Computing (SCC) KIT Universität des Landes Baden-Württemberg und nationales Forschungszentrum

More information

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com W H I T E P A P E R A p p l i c a t i o n D e l i v e r y f o r C l o u d S e r v i c e s : C u s t o m i z i n g S e r v i c e C r e a t i o n i n V i r t u a l E n v i r o n m e n t s Sponsored by: Brocade

More information

High Performance Computing: implementing the strategy

High Performance Computing: implementing the strategy High Performance Computing: implementing the strategy PRACE Scientific Conference Leipzig 16 June 2013 Kostas Glinos Head of Unit - e-infrastructure European Commission - DG CONNECT HPC: What for? Weather,

More information

Seed4C: A Cloud Security Infrastructure validated on Grid 5000

Seed4C: A Cloud Security Infrastructure validated on Grid 5000 Seed4C: A Cloud Security Infrastructure validated on Grid 5000 E. Caron 1, A. Lefray 1, B. Marquet 2, and J. Rouzaud-Cornabas 1 1 Université de Lyon. LIP Laboratory. UMR CNRS - ENS Lyon - INRIA - UCBL

More information

e-infrastructures in Horizon 2020 Vision, approach, drivers, policy background, challenges, WP structure INFODAY France Paris, 25 mars 2014

e-infrastructures in Horizon 2020 Vision, approach, drivers, policy background, challenges, WP structure INFODAY France Paris, 25 mars 2014 e-infrastructures in Horizon 2020 Vision, approach, drivers, policy background, challenges, WP structure INFODAY France Paris, 25 mars 2014 Jean-Luc Dorel European Commission DG CNECT einfrastructure Vision

More information

A public-private partnership building a multidisciplinary cloud platform for data intensive science

A public-private partnership building a multidisciplinary cloud platform for data intensive science A public-private partnership building a multidisciplinary cloud platform for data intensive science Bob Jones Head of openlab IT dept CERN 3 September 2013 This document produced by Members of the Helix

More information

" ANNEX 4. 4. European research infrastructures (including e-infrastructures).."

 ANNEX 4. 4. European research infrastructures (including e-infrastructures).. EN ANNEX 4 " ANNEX 4 HORIZON 2020 WORK PROGRAMME 2016 2017 4..." This draft text is submitted to the Horizon 2020 Programme Committee as the basis for an exchange of views. The text is still subject to

More information

How can the Future Internet enable Smart Energy?

How can the Future Internet enable Smart Energy? How can the Future Internet enable Smart Energy? FINSENY overview presentation on achieved results Prepared by the FINSENY PMT April 2013 Outline Motivation and basic requirements FI-PPP approach FINSENY

More information

OpenNebula Leading Innovation in Cloud Computing Management

OpenNebula Leading Innovation in Cloud Computing Management OW2 Annual Conference 2010 Paris, November 24th, 2010 OpenNebula Leading Innovation in Cloud Computing Management Ignacio M. Llorente DSA-Research.org Distributed Systems Architecture Research Group Universidad

More information

EDISON: Coordination and cooperation to establish new profession of Data Scientist for European Research and Industry

EDISON: Coordination and cooperation to establish new profession of Data Scientist for European Research and Industry EDISON: Coordination and cooperation to establish new profession of Data Scientist for European Research and Industry Yuri Demchenko University of Amsterdam EDISON Education for Data Intensive Science

More information

Grid Computing vs Cloud

Grid Computing vs Cloud Chapter 3 Grid Computing vs Cloud Computing 3.1 Grid Computing Grid computing [8, 23, 25] is based on the philosophy of sharing information and power, which gives us access to another type of heterogeneous

More information

PanDA. A New Paradigm for Computing in HEP. Through the Lens of ATLAS and Other Experiments. Kaushik De

PanDA. A New Paradigm for Computing in HEP. Through the Lens of ATLAS and Other Experiments. Kaushik De PanDA A New Paradigm for Computing in HEP Through the Lens of ATLAS and Other Experiments Univ. of Texas at Arlington On behalf of the ATLAS Collaboration ICHEP 2014, Valencia Computing Challenges at the

More information

PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland

PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland High Performance Computing A Key Technology 1. Supercomputing is the tool for solving the most challenging problems through simulations; 2. Access

More information

How to write a successful proposal

How to write a successful proposal How to write a successful proposal Miriam de Angelis NCP Smart, green and integrated transport NCP Climate action, environment, resource efficiency and raw materials APRE ESTIMATION OF EFFORTS EC SURVEY

More information

Course Outline. Module 1: Introduction to Data Warehousing

Course Outline. Module 1: Introduction to Data Warehousing Course Outline Module 1: Introduction to Data Warehousing This module provides an introduction to the key components of a data warehousing solution and the highlevel considerations you must take into account

More information

Building a Converged Infrastructure with Self-Service Automation

Building a Converged Infrastructure with Self-Service Automation Building a Converged Infrastructure with Self-Service Automation Private, Community, and Enterprise Cloud Scenarios Prepared for: 2012 Neovise, LLC. All Rights Reserved. Case Study Report Introduction:

More information

Overview of the EU Data Grid Project

Overview of the EU Data Grid Project DataGrid is a project funded by the European Union Grid Tutorial 8/10/2003 n 1 Overview of the EU Data Grid Project The European DataGrid Project Team http://www.eu-datagrid.org The EU DataGrid (EDG) Project

More information

D3.4.1: Data Fusion Tools

D3.4.1: Data Fusion Tools COMPETITIVINESS AND INNOVATION FRAMEWORK PROGRAMME CIP-ICT-PSP-2013-7 Pilot Type B WP3 Service platform integration and deployment in cloud infrastructure D3.4.1: Data Fusion Tools Deliverable Lead: NETCAD

More information

The Future of Census Bureau Operations

The Future of Census Bureau Operations The Future of Census Bureau Operations Version 1.0 April 25, 2013 The Future of Census Bureau Operations Page ii [This page intentionally left blank] The Future of Census Bureau Operations Page iii Document

More information

IAAS CLOUD EXCHANGE WHITEPAPER

IAAS CLOUD EXCHANGE WHITEPAPER IAAS CLOUD EXCHANGE WHITEPAPER Whitepaper, July 2013 TABLE OF CONTENTS Abstract... 2 Introduction... 2 Challenges... 2 Decoupled architecture... 3 Support for different consumer business models... 3 Support

More information

Fast track to Innovation: a new instrument in Horizon 2020

Fast track to Innovation: a new instrument in Horizon 2020 Fast track to Innovation: a new instrument in Horizon 2020 29.01.2015 Webinar Ines Haberl Austrian Research Promotion Agency 29.01.2015 Webinar Fast track to Innovation in Horizon 2020 Content 1. Concept

More information

Analytics Strategy Information Architecture Data Management Analytics Value and Governance Realization

Analytics Strategy Information Architecture Data Management Analytics Value and Governance Realization 1/22 As a part of Qlik Consulting, works with Customers to assist in shaping strategic elements related to analytics to ensure adoption and success throughout their analytics journey. Qlik Advisory 2/22

More information

Research proposal (Part B)

Research proposal (Part B) Research and Innovation Actions (RIA) Innovation Actions (IA) Research proposal (Part B) Version 1.1 3 November 2014 Disclaimer This document is aimed at informing potential applicants for Horizon 2020

More information

Scientific Data Infrastructure: activities in the Capacities Programme of FP7

Scientific Data Infrastructure: activities in the Capacities Programme of FP7 Scientific Data Infrastructure: activities in the Capacities Programme of FP7 Presentation at the PARSE.Insight Workshop, Darmstadt, 21 September 2009 Carlos Morais Pires European Commission - DG INFSO

More information

Solution brief. HP CloudSystem. An integrated and open platform to build and manage cloud services

Solution brief. HP CloudSystem. An integrated and open platform to build and manage cloud services Solution brief An integrated and open platform to build and manage cloud services The industry s most complete cloud system for enterprises and service providers Approximately every decade, technology

More information

Proposal Template (Technical Annex) ECSEL Research and Innovation Actions (RIA) ECSEL Innovation Actions (IA) Calls 2016

Proposal Template (Technical Annex) ECSEL Research and Innovation Actions (RIA) ECSEL Innovation Actions (IA) Calls 2016 Proposal Template (Technical Annex) ECSEL Research and Innovation Actions (RIA) ECSEL Innovation Actions (IA) Calls 2016 Please follow the structure of this template when preparing your proposal. It has

More information

The EGI pan-european Federation of Clouds

The EGI pan-european Federation of Clouds The EGI pan-european Federation of Clouds CGW12 Cracow, 22-24 Oct 2012 Matteo Turilli Senior Research Associate Chair EGI Federated Clouds Task Force Oxford e-research Centre University of Oxford matteo.turilli@oerc.ox.ac.uk

More information

The project for the 21st Century city

The project for the 21st Century city The project for the 21st Century city Coruña Smart City will mark a turning point in the type of city we expect to live in Coruña A Coruña, in the north west of spain, holds a population of 250,000 residents

More information

Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control

Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control EP/K006487/1 UK PI: Prof Gareth Taylor (BU) China PI: Prof Yong-Hua Song (THU) Consortium UK Members: Brunel University

More information

Big Workflow: More than Just Intelligent Workload Management for Big Data

Big Workflow: More than Just Intelligent Workload Management for Big Data Big Workflow: More than Just Intelligent Workload Management for Big Data Michael Feldman White Paper February 2014 EXECUTIVE SUMMARY Big data applications represent a fast-growing category of high-value

More information

SIGMA CRIS: SCIENTIFIC OUTPUTS, INTEGRATION AND INTEROPERABILITY

SIGMA CRIS: SCIENTIFIC OUTPUTS, INTEGRATION AND INTEROPERABILITY SIGMA CRIS: SCIENTIFIC OUTPUTS, INTEGRATION AND INTEROPERABILITY From an On-Premise solution to service model for SIGMA CONSORTIUM Jordi Cuní Chief Information Officer SIGMA AIE EUNIS 2015 SIGMA AIE SIGMA

More information

What is a life cycle model?

What is a life cycle model? What is a life cycle model? Framework under which a software product is going to be developed. Defines the phases that the product under development will go through. Identifies activities involved in each

More information

Implementing a Data Warehouse with Microsoft SQL Server 2012

Implementing a Data Warehouse with Microsoft SQL Server 2012 Course 10777A: Implementing a Data Warehouse with Microsoft SQL Server 2012 Course Details Course Outline Module 1: Introduction to Data Warehousing This module provides an introduction to the key components

More information

SQL Server 2012 Business Intelligence Boot Camp

SQL Server 2012 Business Intelligence Boot Camp SQL Server 2012 Business Intelligence Boot Camp Length: 5 Days Technology: Microsoft SQL Server 2012 Delivery Method: Instructor-led (classroom) About this Course Data warehousing is a solution organizations

More information

Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data

Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data Simon Lambert Scientific Computing Department STFC UK Types of

More information

Course 10777A: Implementing a Data Warehouse with Microsoft SQL Server 2012

Course 10777A: Implementing a Data Warehouse with Microsoft SQL Server 2012 Course 10777A: Implementing a Data Warehouse with Microsoft SQL Server 2012 OVERVIEW About this Course Data warehousing is a solution organizations use to centralize business data for reporting and analysis.

More information

NEC Cloud Computing System

NEC Cloud Computing System General Explanation of Special Issue NEC Cloud Computing System Empowering users with the capability to utilize IT services via networks whenever they desire, cloud computing represents a paradigm shift

More information

Proposal template (Technical annex) Research and Innovation actions

Proposal template (Technical annex) Research and Innovation actions Proposal template (Technical annex) Research and Innovation actions Please follow the structure of this template when preparing your proposal. It has been designed to ensure that the important aspects

More information

2) Xen Hypervisor 3) UEC

2) Xen Hypervisor 3) UEC 5. Implementation Implementation of the trust model requires first preparing a test bed. It is a cloud computing environment that is required as the first step towards the implementation. Various tools

More information

EXPLORATORY RESEARCH IN ATM. David Bowen Chief ATM 4 th May 2015

EXPLORATORY RESEARCH IN ATM. David Bowen Chief ATM 4 th May 2015 EXPLORATORY RESEARCH IN ATM David Bowen Chief ATM 4 th May 2015 1 ATM Research in Europe HORIZON Transport Challenges smart, green and integrated transport FlightPath 2050 five challenges to aviation beyond

More information

Implementing a Data Warehouse with Microsoft SQL Server 2012

Implementing a Data Warehouse with Microsoft SQL Server 2012 Course 10777A: Implementing a Data Warehouse with Microsoft SQL Server 2012 Length: Audience(s): 5 Days Level: 200 IT Professionals Technology: Microsoft SQL Server 2012 Type: Delivery Method: Course Instructor-led

More information

EL Program: Smart Manufacturing Systems Design and Analysis

EL Program: Smart Manufacturing Systems Design and Analysis EL Program: Smart Manufacturing Systems Design and Analysis Program Manager: Dr. Sudarsan Rachuri Associate Program Manager: K C Morris Strategic Goal: Smart Manufacturing, Construction, and Cyber-Physical

More information