Public Administration and Information Technology

Size: px
Start display at page:

Download "Public Administration and Information Technology"

Transcription

1

2 Public Administration and Information Technology Volume 10 Series Editor Christopher G. Reddick San Antonio, Texas, USA

3 More information about this series at

4 Marijn Janssen Maria A. Wimmer Ameneh Deljoo Editors Policy Practice and Digital Science Integrating Complex Systems, Social Simulation and Public Administration in Policy Research 2123

5 Editors Marijn Janssen Faculty of Technology, Policy, and Management Delft University of Technology Delft The Netherlands Ameneh Deljoo Faculty of Technology, Policy, and Management Delft University of Technology Delft The Netherlands Maria A. Wimmer Institute for Information Systems Research University of Koblenz-Landau Koblenz Germany ISBN ISBN (ebook) Public Administration and Information Technology DOI / Library of Congress Control Number: Springer Cham Heidelberg New York London Springer International Publishing Switzerland 2015 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. Printed on acid-free paper Springer is part of Springer Science+Business Media (

6 Preface The last economic and financial crisis has heavily threatened European and other economies around the globe. Also, the Eurozone crisis, the energy and climate change crises, challenges of demographic change with high unemployment rates, and the most recent conflicts in the Ukraine and the near East or the Ebola virus disease in Africa threaten the wealth of our societies in different ways. The inability to predict or rapidly deal with dramatic changes and negative trends in our economies and societies can seriously hamper the wealth and prosperity of the European Union and its Member States as well as the global networks. These societal and economic challenges demonstrate an urgent need for more effective and efficient processes of governance and policymaking, therewith specifically addressing crisis management and economic/welfare impact reduction. Therefore, investing in the exploitation of innovative information and communication technology (ICT) in the support of good governance and policy modeling has become a major effort of the European Union to position itself and its Member States well in the global digital economy. In this realm, the European Union has laid out clear strategic policy objectives for 2020 in the Europe 2020 strategy 1 : In a changing world, we want the EU to become a smart, sustainable, and inclusive economy. These three mutually reinforcing priorities should help the EU and the Member States deliver high levels of employment, productivity, and social cohesion. Concretely, the Union has set five ambitious objectives on employment, innovation, education, social inclusion, and climate/energy to be reached by Along with this, Europe 2020 has established four priority areas smart growth, sustainable growth, inclusive growth, and later added: A strong and effective system of economic governance designed to help Europe emerge from the crisis stronger and to coordinate policy actions between the EU and national levels. To specifically support European research in strengthening capacities, in overcoming fragmented research in the field of policymaking, and in advancing solutions for 1 Europe v

7 vi Preface ICT supported governance and policy modeling, the European Commission has cofunded an international support action called egovpolinet 2. The overall objective of egovpolinet was to create an international, cross-disciplinary community of researchers working on ICT solutions for governance and policy modeling. In turn, the aim of this community was to advance and sustain research and to share the insights gleaned from experiences in Europe and globally. To achieve this, egovpolinet established a dialogue, brought together experts from distinct disciplines, and collected and analyzed knowledge assets (i.e., theories, concepts, solutions, findings, and lessons on ICT solutions in the field) from different research disciplines. It built on case material accumulated by leading actors coming from distinct disciplinary backgrounds and brought together the innovative knowledge in the field. Tools, methods, and cases were drawn from the academic community, the ICT sector, specialized policy consulting firms as well as from policymakers and governance experts. These results were assembled in a knowledge base and analyzed in order to produce comparative analyses and descriptions of cases, tools, and scientific approaches to enrich a common knowledge base accessible via This book, entitled Policy Practice and Digital Science Integrating Complex Systems, Social Simulation, and Public Administration in Policy Research, is one of the exciting results of the activities of egovpolinet fusing community building activities and activities of knowledge analysis. It documents findings of comparative analyses and brings in experiences of experts from academia and from case descriptions from all over the globe. Specifically, it demonstrates how the explosive growth in data, computational power, and social media creates new opportunities for policymaking and research. The book provides a first comprehensive look on how to take advantage of the development in the digital world with new approaches, concepts, instruments, and methods to deal with societal and computational complexity. This requires the knowledge traditionally found in different disciplines including public administration, policy analyses, information systems, complex systems, and computer science to work together in a multidisciplinary fashion and to share approaches. This book provides the foundation for strongly multidisciplinary research, in which the various developments and disciplines work together from a comprehensive and holistic policymaking perspective. A wide range of aspects for social and professional networking and multidisciplinary constituency building along the axes of technology, participative processes, governance, policy modeling, social simulation, and visualization are tackled in the 19 papers. With this book, the project makes an effective contribution to the overall objectives of the Europe 2020 strategy by providing a better understanding of different approaches to ICT enabled governance and policy modeling, and by overcoming the fragmented research of the past. This book provides impressive insights into various theories, concepts, and solutions of ICT supported policy modeling and how stakeholders can be more actively engaged in public policymaking. It draws conclusions 2 egovpolinet is cofunded under FP 7, Call identifier FP7-ICT , URL:

8 Preface vii of how joint multidisciplinary research can bring more effective and resilient findings for better predicting dramatic changes and negative trends in our economies and societies. It is my great pleasure to provide the preface to the book resulting from the egovpolinet project. This book presents stimulating research by researchers coming from all over Europe and beyond. Congratulations to the project partners and to the authors! Enjoy reading! Thanassis Chrissafis Project officer of egovpolinet European Commission DG CNECT, Excellence in Science, Digital Science

9 Contents 1 Introduction to Policy-Making in the Digital Age... 1 Marijn Janssen and Maria A. Wimmer 2 Educating Public Managers and Policy Analysts in an Era of Informatics Christopher Koliba and Asim Zia 3 The Quality of Social Simulation: An Example from Research Policy Modelling Petra Ahrweiler and Nigel Gilbert 4 Policy Making and Modelling in a Complex World Wander Jager and Bruce Edmonds 5 From Building a Model to Adaptive Robust Decision Making Using Systems Modeling Erik Pruyt 6 Features and Added Value of Simulation Models Using Different Modelling Approaches Supporting Policy-Making: A Comparative Analysis Dragana Majstorovic, Maria A.Wimmer, Roy Lay-Yee, Peter Davis and Petra Ahrweiler 7 A Comparative Analysis of Tools and Technologies for Policy Making Eleni Kamateri, Eleni Panopoulou, Efthimios Tambouris, Konstantinos Tarabanis, Adegboyega Ojo, Deirdre Lee and David Price 8 Value Sensitive Design of Complex Product Systems Andreas Ligtvoet, Geerten van de Kaa, Theo Fens, Cees van Beers, Paulier Herder and Jeroen van den Hoven ix

10 x Contents 9 Stakeholder Engagement in Policy Development: Observations and Lessons from International Experience Natalie Helbig, Sharon Dawes, Zamira Dzhusupova, Bram Klievink and Catherine Gerald Mkude 10 Values in Computational Models Revalued Rebecca Moody and Lasse Gerrits 11 The Psychological Drivers of Bureaucracy: Protecting the Societal Goals of an Organization Tjeerd C. Andringa 12 Active and Passive Crowdsourcing in Government Euripidis Loukis and Yannis Charalabidis 13 Management of Complex Systems: Toward Agent-Based Gaming for Policy Wander Jager and Gerben van der Vegt 14 The Role of Microsimulation in the Development of Public Policy Roy Lay-Yee and Gerry Cotterell 15 Visual Decision Support for Policy Making: Advancing Policy Analysis with Visualization Tobias Ruppert, Jens Dambruch, Michel Krämer, Tina Balke, Marco Gavanelli, Stefano Bragaglia, Federico Chesani, Michela Milano and Jörn Kohlhammer 16 Analysis of Five Policy Cases in the Field of Energy Policy Dominik Bär, Maria A.Wimmer, Jozef Glova, Anastasia Papazafeiropoulou and Laurence Brooks 17 Challenges to Policy-Making in Developing Countries and the Roles of Emerging Tools, Methods and Instruments: Experiences from Saint Petersburg Dmitrii Trutnev, Lyudmila Vidyasova and Andrei Chugunov 18 Sustainable Urban Development, Governance and Policy: A Comparative Overview of EU Policies and Projects Diego Navarra and Simona Milio 19 eparticipation, Simulation Exercise and Leadership Training in Nigeria: Bridging the Digital Divide Tanko Ahmed

11 Contributors Tanko Ahmed National Institute for Policy and Strategic Studies (NIPSS), Jos, Nigeria Petra Ahrweiler EA European Academy of Technology and Innovation Assessment GmbH, Bad Neuenahr-Ahrweiler, Germany Tjeerd C. Andringa University College Groningen, Institute of Artificial Intelligence and Cognitive Engineering (ALICE), University of Groningen, AB, Groningen, the Netherlands Tina Balke University of Surrey, Surrey, UK Dominik Bär University of Koblenz-Landau, Koblenz, Germany Cees van Beers Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Stefano Bragaglia University of Bologna, Bologna, Italy Laurence Brooks Brunel University, Uxbridge, UK Yannis Charalabidis University of the Aegean, Samos, Greece Federico Chesani University of Bologna, Bologna, Italy Andrei Chugunov ITMO University, St. Petersburg, Russia Gerry Cotterell Centre of Methods and Policy Application in the Social Sciences (COMPASS Research Centre), University of Auckland, Auckland, New Zealand Jens Dambruch Fraunhofer Institute for Computer Graphics Research, Darmstadt, Germany Peter Davis Centre of Methods and Policy Application in the Social Sciences (COMPASS Research Centre), University of Auckland, Auckland, New Zealand Sharon Dawes Center for Technology in Government, University at Albany, Albany, New York, USA xi

12 xii Contributors Zamira Dzhusupova Department of Public Administration and Development Management, United Nations Department of Economic and Social Affairs (UNDESA), NewYork, USA Bruce Edmonds Manchester Metropolitan University, Manchester, UK Theo Fens Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Marco Gavanelli University of Ferrara, Ferrara, Italy Lasse Gerrits Department of Public Administration, Erasmus University Rotterdam, Rotterdam, The Netherlands Nigel Gilbert University of Surrey, Guildford, UK Jozef Glova Technical University Kosice, Kosice, Slovakia Natalie Helbig Center for Technology in Government, University at Albany, Albany, New York, USA Paulier Herder Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Jeroen van den Hoven Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Wander Jager Groningen Center of Social Complexity Studies, University of Groningen, Groningen, The Netherlands Marijn Janssen Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Geerten van de Kaa Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Eleni Kamateri Information Technologies Institute, Centre for Research & Technology Hellas, Thessaloniki, Greece Bram Klievink Faculty of Technology, Policy and Management, Delft University of Technology, Delft, The Netherlands Jörn Kohlhammer GRIS, TU Darmstadt & Fraunhofer IGD, Darmstadt, Germany Christopher Koliba University of Vermont, Burlington, VT, USA Michel Krämer Fraunhofer Institute for Computer Graphics Research, Darmstadt, Germany Roy Lay-Yee Centre of Methods and Policy Application in the Social Sciences (COMPASS Research Centre), University of Auckland, Auckland, New Zealand Deirdre Lee INSIGHT Centre for Data Analytics, NUIG, Galway, Ireland

13 Contributors xiii Andreas Ligtvoet Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands Euripidis Loukis University of the Aegean, Samos, Greece Dragana Majstorovic University of Koblenz-Landau, Koblenz, Germany Michela Milano University of Bologna, Bologna, Italy Simona Milio London School of Economics, Houghton Street, London, UK Catherine Gerald Mkude Institute for IS Research, University of Koblenz-Landau, Koblenz, Germany Rebecca Moody Department of Public Administration, Erasmus University Rotterdam, Rotterdam, The Netherlands Diego Navarra Studio Navarra, London, UK Adegboyega Ojo INSIGHT Centre for Data Analytics, NUIG, Galway, Ireland Eleni Panopoulou Information Technologies Institute, Centre for Research & Technology Hellas, Thessaloniki, Greece Anastasia Papazafeiropoulou Brunel University, Uxbridge, UK David Price Thoughtgraph Ltd, Somerset, UK Erik Pruyt Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands; Netherlands Institute for Advanced Study, Wassenaar, The Netherlands Tobias Ruppert Fraunhofer Institute for Computer Graphics Research, Darmstadt, Germany Efthimios Tambouris Information Technologies Institute, Centre for Research & Technology Hellas, Thessaloniki, Greece; University of Macedonia, Thessaloniki, Greece Konstantinos Tarabanis Information Technologies Institute, Centre for Research & Technology Hellas, Thessaloniki, Greece; University of Macedonia, Thessaloniki, Greece Dmitrii Trutnev ITMO University, St. Petersburg, Russia Gerben van der Vegt Faculty of Economics and Business, University of Groningen, Groningen, The Netherlands Lyudmila Vidyasova ITMO University, St. Petersburg, Russia Maria A. Wimmer University of Koblenz-Landau, Koblenz, Germany Asim Zia University of Vermont, Burlington, VT, USA

14 Chapter 1 Introduction to Policy-Making in the Digital Age Marijn Janssen and Maria A. Wimmer We are running the 21st century using 20th century systems on top of 19th century political structures... John Pollock, contributing editor MIT technology review Abstract The explosive growth in data, computational power, and social media creates new opportunities for innovating governance and policy-making. These information and communications technology (ICT) developments affect all parts of the policy-making cycle and result in drastic changes in the way policies are developed. To take advantage of these developments in the digital world, new approaches, concepts, instruments, and methods are needed, which are able to deal with societal complexity and uncertainty. This field of research is sometimes depicted as e-government policy, e-policy, policy informatics, or data science. Advancing our knowledge demands that different scientific communities collaborate to create practice-driven knowledge. For policy-making in the digital age disciplines such as complex systems, social simulation, and public administration need to be combined. 1.1 Introduction Policy-making and its subsequent implementation is necessary to deal with societal problems. Policy interventions can be costly, have long-term implications, affect groups of citizens or even the whole country and cannot be easily undone or are even irreversible. New information and communications technology (ICT) and models can help to improve the quality of policy-makers. In particular, the explosive growth in data, computational power, and social media creates new opportunities for innovating the processes and solutions of ICT-based policy-making and research. To M. Janssen ( ) Faculty of Technology, Policy, and Management, Delft University of Technology, Delft, The Netherlands m.f.w.h.a.janssen@tudelft.nl M. A. Wimmer University of Koblenz-Landau, Koblenz, Germany Springer International Publishing Switzerland M. Janssen et al. (eds.), Policy Practice and Digital Science, Public Administration and Information Technology 10, DOI / _1

15 2 M. Janssen and M. A. Wimmer take advantage of these developments in the digital world, new approaches, concepts, instruments, and methods are needed, which are able to deal with societal and computational complexity. This requires the use of knowledge which is traditionally found in different disciplines, including (but not limited to) public administration, policy analyses, information systems, complex systems, and computer science. All these knowledge areas are needed for policy-making in the digital age. The aim of this book is to provide a foundation for this new interdisciplinary field in which various traditional disciplines are blended. Both policy-makers and those in charge of policy implementations acknowledge that ICT is becoming more and more important and is changing the policy-making process, resulting in a next generation policy-making based on ICT support. The field of policy-making is changing driven by developments such as open data, computational methods for processing data, opinion mining, simulation, and visualization of rich data sets, all combined with public engagement, social media, and participatory tools. In this respect Web 2.0 and even Web 3.0 point to the specific applications of social networks and semantically enriched and linked data which are important for policy-making. In policy-making vast amount of data are used for making predictions and forecasts. This should result in improving the outcomes of policy-making. Policy-making is confronted with an increasing complexity and uncertainty of the outcomes which results in a need for developing policy models that are able to deal with this. To improve the validity of the models policy-makers are harvesting data to generate evidence. Furthermore, they are improving their models to capture complex phenomena and dealing with uncertainty and limited and incomplete information. Despite all these efforts, there remains often uncertainty concerning the outcomes of policy interventions. Given the uncertainty, often multiple scenarios are developed to show alternative outcomes and impact. A condition for this is the visualization of policy alternatives and its impact. Visualization can ensure involvement of nonexpert and to communicate alternatives. Furthermore, games can be used to let people gain insight in what can happen, given a certain scenario. Games allow persons to interact and to experience what happens in the future based on their interventions. Policy-makers are often faced with conflicting solutions to complex problems, thus making it necessary for them to test out their assumptions, interventions, and resolutions. For this reason policy-making organizations introduce platforms facilitating policy-making and citizens engagements and enabling the processing of large volumes of data. There are various participative platforms developed by government agencies (e.g., De Reuver et al. 2013; Slaviero et al. 2010; Welch 2012). Platforms can be viewed as a kind of regulated environment that enable developers, users, and others to interact with each other, share data, services, and applications, enable governments to more easily monitor what is happening and facilitate the development of innovative solutions (Janssen and Estevez 2013). Platforms should provide not only support for complex policy deliberations with citizens but should also bring together policy-modelers, developers, policy-makers, and other stakeholders involved in policy-making. In this way platforms provide an information-rich, interactive

16 1 Introduction to Policy-Making in the Digital Age 3 environment that brings together relevant stakeholders and in which complex phenomena can be modeled, simulated, visualized, discussed, and even the playing of games can be facilitated. 1.2 Complexity and Uncertainty in Policy-Making Policy-making is driven by the need to solve societal problems and should result in interventions to solve these societal problems. Examples of societal problems are unemployment, pollution, water quality, safety, criminality, well-being, health, and immigration. Policy-making is an ongoing process in which issues are recognized as a problem, alternative courses of actions are formulated, policies are affected, implemented, executed, and evaluated (Stewart et al. 2007). Figure 1.1 shows the typical stages of policy formulation, implementation, execution, enforcement, and evaluation. This process should not be viewed as linear as many interactions are necessary as well as interactions with all kind of stakeholders. In policy-making processes a vast amount of stakeholders are always involved, which makes policymaking complex. Once a societal need is identified, a policy has to be formulated. Politicians, members of parliament, executive branches, courts, and interest groups may be involved in these formulations. Often contradictory proposals are made, and the impact of a proposal is difficult to determine as data is missing, models cannot Policy formulation Policymakers politicians experts Policy implementation Policy execution Administrative organizations businesses citizens Policy enforcement and evaluation Inspection and enforcement agencies Fig. 1.1 Overview of policy cycle and stakeholders

17 4 M. Janssen and M. A. Wimmer capture the complexity, and the results of policy models are difficult to interpret and even might be interpreted in an opposing way. This is further complicated as some proposals might be good but cannot be implemented or are too costly to implement. There is a large uncertainty concerning the outcomes. Policy implementation is done by organizations other than those that formulated the policy. They often have to interpret the policy and have to make implementation decisions. Sometimes IT can block quick implementation as systems have to be changed. Although policy-making is the domain of the government, private organizations can be involved to some extent, in particular in the execution of policies. Once all things are ready and decisions are made, policies need to be executed. During the execution small changes are typically made to fine tune the policy formulation, implementation decisions might be more difficult to realize, policies might bring other benefits than intended, execution costs might be higher and so on. Typically, execution is continually changing. Evaluation is part of the policy-making process as it is necessary to ensure that the policy-execution solved the initial societal problem. Policies might become obsolete, might not work, have unintended affects (like creating bureaucracy) or might lose its support among elected officials, or other alternatives might pop up that are better. Policy-making is a complex process in which many stakeholders play a role. In the various phases of policy-making different actors are dominant and play a role. Figure 1.1 shows only some actors that might be involved, and many of them are not included in this figure. The involvement of so many actors results in fragmentation and often actors are even not aware of the decisions made by other actors. This makes it difficult to manage a policy-making process as each actor has other goals and might be self-interested. Public values (PVs) are a way to try to manage complexity and give some guidance. Most policies are made to adhere to certain values. Public value management (PVM) represents the paradigm of achieving PVs as being the primary objective (Stoker 2006). PVM refers to the continuous assessment of the actions performed by public officials to ensure that these actions result in the creation of PV (Moore 1995). Public servants are not only responsible for following the right procedure, but they also have to ensure that PVs are realized. For example, civil servants should ensure that garbage is collected. The procedure that one a week garbage is collected is secondary. If it is necessary to collect garbage more (or less) frequently to ensure a healthy environment then this should be done. The role of managers is not only to ensure that procedures are followed but they should be custodians of public assets and maximize a PV. There exist a wide variety of PVs (Jørgensen and Bozeman 2007). PVs can be long-lasting or might be driven by contemporary politics. For example, equal access is a typical long-lasting value, whereas providing support for students at universities is contemporary, as politicians might give more, less, or no support to students. PVs differ over times, but also the emphasis on values is different in the policy-making cycle as shown in Fig In this figure some of the values presented by Jørgensen and Bozeman (2007) are mapped onto the four policy-making stages. Dependent on the problem at hand other values might play a role that is not included in this figure.

18 1 Introduction to Policy-Making in the Digital Age 5 accountability fair evidence-based will of the people public interest balancing of interests listening transparancy Policy enforcement and evaluation Policy formulation citizen involvement evidence-based protection of individual rights Policy execution Policy implementation accountability transparancy equal access efficiency fair honesty responsiveness timelessness reliable flexible efficiency robust Fig. 1.2 Public values in the policy cycle Policy is often formulated by politicians in consultation with experts. In the PVM paradigm, public administrations aim at creating PVs for society and citizens. This suggests a shift from talking about what citizens expect in creating a PV. In this view public officials should focus on collaborating and creating a dialogue with citizens in order to determine what constitutes a PV. 1.3 Developments There is an infusion of technology that changes policy processes at both the individual and group level. There are a number of developments that influence the traditional way of policy-making, including social media as a means to interact with the public (Bertot et al. 2012), blogs (Coleman and Moss 2008), open data (Janssen et al. 2012; Zuiderwijk and Janssen 2013), freedom of information (Burt 2011), the wisdom of the crowds (Surowiecki 2004), open collaboration and transparency in policy simulation (Wimmer et al. 2012a, b), agent-based simulation and hybrid modeling techniques (Koliba and Zia 2012) which open new ways of innovative policy-making. Whereas traditional policy-making is executed by experts, now the public is involved to fulfill requirements of good governance according to open government principles.

19 6 M. Janssen and M. A. Wimmer Also, the skills and capabilities of crowds can be explored and can lead to better and more transparent democratic policy decisions. All these developments can be used for enhancing citizen s engagement and to involve citizens better in the policy-making process. We want to emphasize three important developments The Availability of Big and Open Linked Data (BOLD) Policy-making heavily depends on data about existing policies and situations to make decisions. Both public and private organizations are opening their data for use by others. Although information could be requested for in the past, governments have changed their strategy toward actively publishing open data in formats that are readily and easily accessible (for example, European_Commission 2003; Obama 2009). Multiple perspectives are needed to make use of and stimulate new practices based on open data (Zuiderwijk et al. 2014). New applications and innovations can be based solely on open data, but often open data are enriched with data from other sources. As data can be generated and provided in huge amounts, specific needs for processing, curation, linking, visualization, and maintenance appear. The latter is often denoted with big data in which the value is generated by combining different datasets (Janssen et al. 2014). Current advances in processing power and memory allows for the processing of a huge amount of data. BOLD allows for analyzing policies and the use of these data in models to better predict the effect of new policies Rise of Hybrid Simulation Approaches In policy implementation and execution, many actors are involved and there are a huge number of factors influencing the outcomes; this complicates the prediction of the policy outcomes. Simulation models are capable of capturing the interdependencies between the many factors and can include stochastic elements to deal with the variations and uncertainties. Simulation is often used in policy-making as an instrument to gain insight in the impact of possible policies which often result in new ideas for policies. Simulation allows decision-makers to understand the essence of a policy, to identify opportunities for change, and to evaluate the effect of proposed changes in key performance indicators (Banks 1998; Law and Kelton 1991). Simulation heavily depends on data and as such can benefit from big and open data. Simulation models should capture the essential aspects of reality. Simulation models do not rely heavily on mathematical abstraction and are therefore suitable for modeling complex systems (Pidd 1992). Already the development of a model can raise discussions about what to include and what factors are of influence, in this way contributing to a better understanding of the situation at hand. Furthermore, experimentation using models allows one to investigate different settings and the influence of different scenarios in time on the policy outcomes.

20 1 Introduction to Policy-Making in the Digital Age 7 The effects of policies are hard to predict and dealing with uncertainty is a key aspect in policy modeling. Statistical representation of real-world uncertainties is an integral part of simulation models (Law and Kelton 1991). The dynamics associated with many factors affecting policy-making, the complexity associated with the interdependencies between individual parts, and the stochastic elements associated with the randomness and unpredictable behavior of transactions complicates the simulations. Computer simulations for examining, explaining, and predicting social processes and relationships as well as measuring the possible impact of policies has become an important part of policy-making. Traditional models are not able to address all aspects of complex policy interactions, which indicates the need for the development of hybrid simulation models consisting of a combinatory set of models built on different modeling theories (Koliba and Zia 2012). In policy-making it can be that multiple models are developed, but it is also possible to combine various types of simulation in a single model. For this purpose agent-based modeling and simulation approaches can be used as these allow for combining different type of models in a single simulation Ubiquitous User Engagement Efforts to design public policies are confronted with considerable complexity, in which (1) a large number of potentially relevant factors needs to be considered, (2) a vast amount of data needs to be processed, (3) a large degree of uncertainty may exist, and (4) rapidly changing circumstances need to be dealt with. Utilizing computational methods and various types of simulation and modeling methods is often key to solving these kinds of problems (Koliba and Zia 2012). The open data and social media movements are making large quantities of new data available. At the same time enhancements in computational power have expanded the repertoire of instruments and tools available for studying dynamic systems and their interdependencies. In addition, sophisticated techniques for data gathering, visualization, and analysis have expanded our ability to understand, display, and disseminate complex, temporal, and spatial information to diverse audiences. These problems can only be addressed from a complexity science perspective and with a multitude of views and contributions from different disciplines. Insights and methods of complexity science should be applied to assist policy-makers as they tackle societal problems in policy areas such as environmental protection, economics, energy, security, or public safety and health. This demands user involvement which is supported by visualization techniques and which can be actively involved by employing (serious) games. These methods can show what hypothetically will happen when certain policies are implemented.

21 8 M. Janssen and M. A. Wimmer 1.4 Combining Disciplines in E-government Policy-Making This new field has been shaped using various names, including e-policy-making, digital policy science, computational intelligence, digital sciences, data sciences, and policy informatics (Dawes and Janssen 2013). The essence of this field it that it is 1. Practice-driven 2. Employs modeling techniques 3. Needs the knowledge coming from various disciplines 4. It focused on governance and policy-making This field is practice-driven by taking as a starting point the public policy problem and defining what information is relevant for addressing the problem under study. This requires understanding of public administration and policy-making processes. Next, it is a key to determine how to obtain, store, retrieve, process, model, and interpret the results. This is the field of e-participation, policy-modeling, social simulation, and complex systems. Finally, it should be agreed upon how to present and disseminate the results so that other researchers, decision-makers, and practitioners can use it. This requires in-depth knowledge of practice, of structures of public administration and constitutions, political cultures, processes and culture and policy-making. Based on the ideas, the FP7 project EgovPoliNet project has created an international community in ICT solutions for governance and policy-modeling. The policy-making 2.0 LinkedIn community has a large number of members from different disciplines and backgrounds representing practice and academia. This book is the product of this project in which a large number of persons from various disciplines and representing a variety of communities were involved. The book shows experiences and advances in various areas of policy-making. Furthermore, it contains comparative analyses and descriptions of cases, tools, and scientific approaches from the knowledge base created in this project. Using this book, practices and knowledge in this field is shared among researchers. Furthermore, this book provides the foundations in this area. The covered expertise include a wide range of aspects for social and professional networking and multidisciplinary constituency building along the axes of technology, participative processes, governance, policy-modeling, social simulation, and visualization. In this way egovpolinet has advanced the way research, development, and practice is performed worldwide in using ICT solutions for governance and policy-modeling. Although in Europe the term e-government policy or e-policy, for short, is often used to refer to these types of phenomena, whereas in the USA often the term policy informatics is used. This is similar to that in the USA the term digital government is often used, whereas in Europe the term e-government is preferred. Policy informatics is defined as the study of how information is leveraged and efforts are coordinated towards solving complex public policy problems (Krishnamurthy et al. 2013, p. 367). These authors view policy informatics as an emerging research space to navigate through the challenges of complex layers of uncertainty within

22 1 Introduction to Policy-Making in the Digital Age 9 governance processes. Policy informatics community has created Listserv called Policy Informatics Network (PIN-L). E-government policy-making is closely connected to data science. Data science is the ability to find answers from larger volumes of (un)structured data (Davenport and Patil 2012). Data scientists find and interpret rich data sources, manage large amounts of data, create visualizations to aid in understanding data, build mathematical models using the data, present and communicate the data insights/findings to specialists and scientists in their team, and if required to a nonexpert audience. These are activities which are at the heart of policy-making. 1.5 Overview of Chapters In total 54 different authors were involved in the creation of this book. Some chapters have a single author, but most of the chapters have multiple authors. The authors represent a wide range of disciplines as shown in Fig The focus has been on targeting five communities that make up the core field for ICT-enabled policy-making. These communities include e-government/e-participation, information systems, complex systems, public administration, and policy research and social simulation. The combination of these disciplines and communities are necessary to tackle policy problems in new ways. A sixth category was added for authors not belonging to any of these communities, such as philosophy and economics. Figure 1.3 shows that the authors are evenly distributed among the communities, although this is less with the chapter. Most of the authors can be classified as belonging to the e-government/e-participation community, which is by nature interdisciplinary. Foundation The first part deals with the foundations of the book. In their Chap. 2 Chris Koliba and Asim Zia start with a best practice to be incorporated in public administration educational programs to embrace the new developments sketched in EGOV IS Complex Systems Public Administration and Policy Research Social Simulation Fig. 1.3 Overview of the disciplinary background of the authors other (philosophy, energy, economics, )

23 10 M. Janssen and M. A. Wimmer this chapter. They identify two types of public servants that need to be educated. The policy informatics include the savvy public manager and the policy informatics analyst. This chapter can be used as a basis to adopt interdisciplinary approaches and include policy informatics in the public administration curriculum. Petra Ahrweiler and Nigel Gilbert discuss the need for the quality of simulation modeling in their Chap. 3. Developing simulation is always based on certain assumptions and a model is as good as the developer makes it. The user community is proposed to assess the quality of a policy-modeling exercise. Communicative skills, patience, willingness to compromise on both sides, and motivation to bridge the formal world of modelers and the narrative world of policy-makers are suggested as key competences. The authors argue that user involvement is necessary in all stages of model development. Wander Jager and Bruce Edmonds argue that due to the complexity that many social systems are unpredictable by nature in their Chap. 4. They discuss how some insights and tools from complexity science can be used in policy-making. In particular they discuss the strengths and weaknesses of agent-based modeling as a way to gain insight in the complexity and uncertainty of policy-making. In the Chap. 5, Erik Pruyt sketches the future in which different systems modeling schools and modeling methods are integrated. He shows that elements from policy analysis, data science, machine learning, and computer science need to be combined to deal with the uncertainty in policy-making. He demonstrates the integration of various modeling and simulation approaches and related disciplines using three cases. Modeling approaches are compared in the Chap. 6 authored by Dragana Majstorovic, Maria A. Wimmer, Roy Lay-Yee, Peter Davis,and Petra Ahrweiler. Like in the previous chapter they argue that none of the theories on its own is able to address all aspects of complex policy interactions, and the need for hybrid simulation models is advocated. The next chapter is complimentary to the previous chapter and includes a comparison of ICT tools and technologies. The Chap. 7 is authored by Eleni Kamateri, Eleni Panopoulou, Efthimios Tambouris, Konstantinos Tarabanis, Adegboyega Ojo, Deirdre Lee, and David Price. This chapter can be used as a basis for tool selecting and includes visualization, argumentation, e-participation, opinion mining, simulation, persuasive, social network analysis, big data analytics, semantics, linked data tools, and serious games. Social Aspects, Stakeholders and Values Although much emphasis is put on modeling efforts, the social aspects are key to effective policy-making. The role of values is discussed in the Chap. 8 authored by Andreas Ligtvoet, Geerten van de Kaa, Theo Fens, Cees van Beers, Paulien Herder, and Jeroen van den Hoven. Using the case of the design of smart meters in energy networks they argue that policy-makers would do well by not only addressing functional requirements but also by taking individual stakeholder and PVs into consideration. In policy-making a wide range of stakeholders are involved in various stages of the policy-making process. Natalie Helbig, Sharon Dawes, Zamira Dzhusupova, Bram Klievink, and Catherine Gerald Mkude analyze five case studies of stakeholder

24 1 Introduction to Policy-Making in the Digital Age 11 engagement in policy-making in their Chap. 9. Various engagement tools are discussed and factors identified which support the effective use of particular tools and technologies. The Chap. 10 investigates the role of values and trust in computational models in the policy process. This chapter is authored by Rebecca Moody and Lasse Gerrits. The authors found that a large diversity exists in values within the cases. By the authors important explanatory factors were found including (1) the role of the designer of the model, (2) the number of different actors (3) the level of trust already present, and (4) and the limited control of decision-makers over the models. Bureaucratic organizations are often considered to be inefficient and not customer friendly. Tjeerd Andringa presents and discusses a multidisciplinary framework containing the drivers and causes of bureaucracy in the Chap. 11. He concludes that the reduction of the number of rules and regulations is important, but that motivating workers to understand their professional roles and to learn to oversee the impact of their activities is even more important. Crowdsourcing has become an important policy instrument to gain access to expertise ( wisdom ) outside own boundaries. In the Chap. 12, Euripids Loukis and Yannis Charalabidis discuss Web 2.0 social media for crowdsourcing. Passive crowdsourcing exploits the content generated by users, whereas active crowdsourcing stimulates content postings and idea generation by users. Synergy can be created by combining both approaches. The results of passive crowdsourcing can be used for guiding active crowdsourcing to avoid asking users for similar types of input. Policy, Collaboration and Games Agent-based gaming (ABG) is used as a tool to explore the possibilities to manage complex systems in the Chap. 13 by Wander Jager and Gerben van der Vegt. ABG allows for modeling a virtual and autonomous population in a computer game setting to exploit various management and leadership styles. In this way ABG contribute to the development of the required knowledge on how to manage social complex behaving systems. Micro simulation focuses on modeling individual units and the micro-level processes that affect their development. The concepts of micro simulation are explained by Roy Lay-Yee and Gerry Cotterell in the Chap. 14. Micro simulation for policy development is useful to combine multiple sources of information in a single contextualized model to answer what if questions on complex social phenomena. Visualization is essential to communicate the model and the results to a variety of stakeholders. These aspects are discussed in the Chap. 15 by Tobias Ruppert, Jens Dambruch, Michel Krämer, Tina Balke, Marco Gavanelli, Stefano Bragaglia, Federico Chesani, Michela Milano, and Jörn Kohlhammer. They argue that despite the significance to use evidence in policy-making, this is seldom realized. Three case studies that have been conducted in two European research projects for policymodeling are presented. In all the cases access for nonexperts to the computational models by information visualization technologies was realized.

25 12 M. Janssen and M. A. Wimmer Applications and Practices Different projects have been initiated to study the best suitable transition process towards renewable energy. In the Chap. 16 by Dominik Bär, Maria A. Wimmer, Jozef Glova, Anastasia Papazafeiropoulou,and Laurence Brooks five of these projects are analyzed and compared. They please for transferring models from one country to other countries to facilitate learning. Lyudmila Vidyasova, Andrei Chugunov, and Dmitrii Trutnev present experiences from Russia in their Chap. 17. They argue that informational, analytical, and forecasting activities for the processes of socioeconomic development are an important element in policy-making. The authors provide a brief overview of the history, the current state of the implementation of information processing techniques, and practices for the purpose of public administration in the Russian Federation. Finally, they provide a range of recommendations to proceed. Urban policy for sustainability is another important area which is directly linked to the first chapter in this section. In the Chap. 18, Diego Navarra and Simona Milio demonstrate a system dynamics model to show how urban policy and governance in the future can support ICT projects in order to reduce energy usage, rehabilitate the housing stock, and promote sustainability in the urban environment. This chapter contains examples of sustainable urban development policies as well as case studies. In the Chap. 19, Tanko Ahmed discusses the digital divide which is blocking online participation in policy-making processes. Structuration, institutional and actor-network theories are used to analyze a case study of political zoning. The author recommends stronger institutionalization of ICT support and legislation for enhancing participation in policy-making and bridging the digital divide. 1.6 Conclusions This book is the first comprehensive book in which the various development and disciplines are covered from the policy-making perspective driven by ICT developments. A wide range of aspects for social and professional networking and multidisciplinary constituency building along the axes of technology, participative processes, governance, policy-modeling, social simulation, and visualization are investigated. Policymaking is a complex process in which many stakeholders are involved. PVs can be used to guide policy-making efforts and to ensure that the many stakeholders have an understanding of the societal value that needs to be created. There is an infusion of technology resulting in changing policy processes and stakeholder involvement. Technologies like social media provides a means to interact with the public, blogs can be used to express opinions, big and open data provide input for evidence-based policy-making, the integration of various types of modeling and simulation techniques (hybrid models) can provide much more insight and reliable outcomes, gaming in which all kind of stakeholders are involved open new ways of innovative policymaking. In addition trends like the freedom of information, the wisdom of the crowds, and open collaboration changes the landscape further. The policy-making landscape is clearly changing and this demands a strong need for interdisciplinary research.

Closing the open public data feedback loop: the ENGAGE platform

Closing the open public data feedback loop: the ENGAGE platform Closing the open public data feedback loop: the ENGAGE platform Charalampos Alexopoulos 1, Anneke Zuiderwijk 2, Yannis Charalabidis 1, Euripides Loukis 1, 1 University of AEGEAN, Greece 2 Delft University

More information

Oral and Cranial Implants

Oral and Cranial Implants Oral and Cranial Implants Hugh Devlin Ichiro Nishimura Editors Oral and Cranial Implants Recent Research Developments Editors Hugh Devlin School of Dentistry University of Manchester Manchester United

More information

Big-Data Analytics and Cloud Computing

Big-Data Analytics and Cloud Computing Big-Data Analytics and Cloud Computing Marcello Trovati Richard Hill Ashiq Anjum Shao Ying Zhu Lu Liu Editors Big-Data Analytics and Cloud Computing Theory, Algorithms and Applications 123 Editors Marcello

More information

Lasers in Restorative Dentistry

Lasers in Restorative Dentistry Lasers in Restorative Dentistry Giovanni Olivi Matteo Olivi Editors Lasers in Restorative Dentistry A Practical Guide Editors Giovanni Olivi Rome Italy Matteo Olivi Rome Italy ISBN 978-3-662-47316-0 DOI

More information

Applying Comparative Effectiveness Data to Medical Decision Making

Applying Comparative Effectiveness Data to Medical Decision Making Applying Comparative Effectiveness Data to Medical Decision Making Carl V. Asche Editor Applying Comparative Effectiveness Data to Medical Decision Making A Practical Guide Adis Editor Carl V. Asche Research

More information

Your door to future governance solutions

Your door to future governance solutions Your door to future governance solutions www.egovlab.eu 2 3 not just in theory but also in practice 4 5 www.egovlab.eu * Word from egovlab s director Vasilis Koulolias: The power of information and communication

More information

Discussion Paper. This document is intended to nurture the debate of the informal Council of Ministers meeting in Turin on the 24 September.

Discussion Paper. This document is intended to nurture the debate of the informal Council of Ministers meeting in Turin on the 24 September. INFORMAL E.U. CULTURE MINISTERS MEETING Venaria Reale, Turin, 24 September 2014 Discussion Paper This document is intended to nurture the debate of the informal Council of Ministers meeting in Turin on

More information

Human Rights in European Criminal Law

Human Rights in European Criminal Law Human Rights in European Criminal Law ThiS is a FM Blank Page Stefano Ruggeri Editor Human Rights in European Criminal Law New Developments in European Legislation and Case Law after the Lisbon Treaty

More information

Automated Firewall Analytics

Automated Firewall Analytics Automated Firewall Analytics Ehab Al-Shaer Automated Firewall Analytics Design, Configuration and Optimization 123 Ehab Al-Shaer University of North Carolina Charlotte Charlotte, NC, USA ISBN 978-3-319-10370-9

More information

International Series on Consumer Science

International Series on Consumer Science International Series on Consumer Science For further volumes: http://www.springer.com/series/8358 Tsan-Ming Choi Editor Fashion Branding and Consumer Behaviors Scientific Models 1 3 Editor Tsan-Ming Choi

More information

SpringerBriefs in Criminology

SpringerBriefs in Criminology SpringerBriefs in Criminology More information about this series at http://www.springer.com/series/10159 Wesley G. Jennings Rolf Loeber Dustin A. Pardini Alex R. Piquero David P. Farrington Offending

More information

Spatial Inequalities

Spatial Inequalities Spatial Inequalities GeoJournal Library Volume 110 Managing Editor: Daniel Z. Sui, Columbus, Ohio, USA Founding Series Editor: Wolf Tietze, Helmstedt, Germany Editorial Board: Paul Claval, France Yehuda

More information

Use of e-participation Tools for Support of Policy Modelling at Regional Level

Use of e-participation Tools for Support of Policy Modelling at Regional Level The 5th Mediterranean Conference on Information Systems September 12-14, 2010, Tel-Aviv-Yaffo Use of e-participation Tools for Support of Policy Modelling at Regional Level Karol Furdik - Tomas Sabol Technical

More information

TEACHERS REFLECTIONS OVER PATHWAY CPD ACTIVITIES ON INQUIRY-BASED TEACHING

TEACHERS REFLECTIONS OVER PATHWAY CPD ACTIVITIES ON INQUIRY-BASED TEACHING TEACHERS REFLECTIONS OVER PATHWAY CPD ACTIVITIES ON INQUIRY-BASED TEACHING Anna Trifonova and Mario Barajas Universitat de Barcelona - Facultat de Pedagogia - DOE Abstract: Pathway project (FP7/2007-2013,

More information

European University Association Contribution to the Public Consultation: Science 2.0 : Science in Transition 1. September 2014

European University Association Contribution to the Public Consultation: Science 2.0 : Science in Transition 1. September 2014 European University Association Contribution to the Public Consultation: Science 2.0 : Science in Transition 1 September 2014 With 850 members across 47 countries, the European University Association (EUA)

More information

The Communication for Governance & Accountability Program

The Communication for Governance & Accountability Program Innovative Solutions for Governance The Communication for Governance & Accountability Program (CommGAP) Communication Communication links citizens, civil society, the media system and government, forming

More information

EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION

EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION EUROTECH UNIVERSITIES ALLIANCE CONTRIBUTION TO THE PUBLIC CONSULTATION SCIENCE 2.0-SCIENCE IN TRANSITION A: INTRODUCTION TO THE ALLIANCE S CONTRIBUTION The EuroTech Universities Alliance is a strategic

More information

Third Parliamentary Forum on Shaping the Information Society

Third Parliamentary Forum on Shaping the Information Society Third Parliamentary Forum on Shaping the Information Society ICT and the Global Economic Crisis: Current Situation and Future Perspectives 3-5 May 2010 Room B ITU Tower International Telecommunication

More information

Linked Open Government Data Analytics

Linked Open Government Data Analytics Linked Open Government Data Analytics Evangelos Kalampokis 1,2, Efthimios Tambouris 1,2, Konstantinos Tarabanis 1,2 1 Information Technologies Institute, Centre for Research & Technology - Hellas, Greece

More information

A Special Issue on Driving Public Innovation using Big and Open Linked Data (BOLD) Information Systems Frontiers

A Special Issue on Driving Public Innovation using Big and Open Linked Data (BOLD) Information Systems Frontiers CALL FOR PAPERS A Special Issue on Driving Public Innovation using Big and Open Linked Data (BOLD) Information Systems Frontiers Combining and sharing data from various sources has become an important

More information

Session Title: Teaching Computational Thinking through Mobilize and the New Big Data Explosion

Session Title: Teaching Computational Thinking through Mobilize and the New Big Data Explosion Session Title: Teaching Computational Thinking through Mobilize and the New Big Data Explosion MSP Project Name: MOBILIZE: Mobilizing for Innovative Computer Science Teaching and Learning Presenters: Jane

More information

Background paper to the Lund Declaration 2015

Background paper to the Lund Declaration 2015 Background paper to the Lund Declaration 2015 content Lund Declaration 2009...1 State of play and progress since 2009...1 A robust challenge-based approach for real solutions...2 Alignment...3 Frontier

More information

Co-operatives for Europe: Moving forward together

Co-operatives for Europe: Moving forward together Co-operatives for Europe: Moving forward together 3 In Finland, 75% of the population are members of a co-operative enterprise. In Belgium, when you enter a pharmacy, there is a 1 in 5 chance that you

More information

W3C USING OPEN DATA WORKSHOP VISUAL ANALYTICS FOR POLICY-MAKING OPPORTUNITIES AND RESEARCH CHALLENGES Francesco Mureddu, Tech4i2.

W3C USING OPEN DATA WORKSHOP VISUAL ANALYTICS FOR POLICY-MAKING OPPORTUNITIES AND RESEARCH CHALLENGES Francesco Mureddu, Tech4i2. W3C USING OPEN DATA WORKSHOP VISUAL ANALYTICS FOR POLICY-MAKING OPPORTUNITIES AND RESEARCH CHALLENGES Francesco Mureddu, Tech4i2.com www.crossover-project.eu #pmod BACKGROUND CROSSOVER project Bridging

More information

Shifting qualifications in journalism education in Europe and Russia

Shifting qualifications in journalism education in Europe and Russia Shifting qualifications in journalism education in Europe and Russia Nico Drok 1 Introduction Teaching journalism is not easy. And it probably never has been. Over the years there have been numerous and

More information

Mental Health Declaration for Europe

Mental Health Declaration for Europe WHO European Ministerial Conference on Mental Health Facing the Challenges, Building Solutions Helsinki, Finland, 12 15 January 2005 EUR/04/5047810/6 14 January 2005 52667 ORIGINAL: ENGLISH Mental Health

More information

Perspectives on the knowledge-based society

Perspectives on the knowledge-based society Perspectives on the knowledge-based society Interviews about Netherlands as knowledge land Editor: Inge Wichard In association with: Vincent Delemarre and Gerda Sulman (editor) Introduction The knowledge-based

More information

ROADMAP. Initial IA screening & planning of further work

ROADMAP. Initial IA screening & planning of further work ROADMAP Title of the initiative: Youth programme post 2013 Type of initiative (CWP/Catalogue/Comitology): CWP Lead DG: DG EAC/E-2, Youth in Action Unit Expected date of adoption of the initiative (month/year):

More information

Online Surveillance Awareness as Impact on Data Validity for Open-Source Intelligence?

Online Surveillance Awareness as Impact on Data Validity for Open-Source Intelligence? Online Surveillance Awareness as Impact on Data Validity for Open-Source Intelligence? Petra Saskia Bayerl 1( ) and Babak Akhgar 2 1 Rotterdam School of Management, Erasmus University, Rotterdam, Netherlands

More information

INTERNATIONAL COUNCIL OF NURSES

INTERNATIONAL COUNCIL OF NURSES INTERNATIONAL COUNCIL OF NURSES 3, place Jean-Marteau CH-1201 Geneva (Switzerland) Tel. (+41 22) 908 01 00 Fax (+41 22) 908 01 01 E-mail: icn@icn.ch Web site: www.icn.ch Guidelines on shaping effective

More information

UCL Public Policy Strategy

UCL Public Policy Strategy OFFICE OF THE VICE-PROVOST (RESEARCH) UCL Public Policy Strategy Executive Summary UCL is committed to using its expertise to address complex policy problems, and as a force for positive social change.

More information

ISSN 2443-8308. EaSI performance in 2014. Executive summary of EaSI Performance Monitoring Report 2014. Social Europe

ISSN 2443-8308. EaSI performance in 2014. Executive summary of EaSI Performance Monitoring Report 2014. Social Europe ISSN 2443-8308 EaSI performance in 2014 Executive summary of EaSI Performance Monitoring Report 2014 Social Europe The European Union Programme for Employment and Social Innovation (EaSI) aims to contribute

More information

THE FIVE-STAR DOCTOR: An asset to health care reform? Dr Charles Boelen World Health Organization, Geneva, Switzerland

THE FIVE-STAR DOCTOR: An asset to health care reform? Dr Charles Boelen World Health Organization, Geneva, Switzerland 1 THE FIVE-STAR DOCTOR: An asset to health care reform? Dr Charles Boelen World Health Organization, Geneva, Switzerland Defining universal challenges in health reform is itself a challenge, let alone

More information

to make EU Legislation more

to make EU Legislation more Using Argument Visualisation to make EU Legislation more transparent: the WAVE approach Konstantinos Parisopoulos, p, Information Systems Lab, University of Macedonia 1st International Conference on eparticipation

More information

Kansas Board of Regents Precollege Curriculum Courses Approved for University Admissions

Kansas Board of Regents Precollege Curriculum Courses Approved for University Admissions Kansas Board of Regents Precollege Curriculum Courses Approved for University Admissions Original Publication April 6, 2011 Revision Dates June 13, 2011 May 23, 2012 Kansas Board of Regents Precollege

More information

The Double Democratic Deficit Parliamentary Accountability and the Use of Force under International Auspices

The Double Democratic Deficit Parliamentary Accountability and the Use of Force under International Auspices The Double Democratic Deficit Parliamentary Accountability and the Use of Force under International Auspices Hans Born, Senior Fellow, DCAF Geneva Brussels, 29 April 2004 Presentation given at the Book

More information

Social Informatics Today and Tomorrow: Status, Problems and Prospects of Development of Complex Lines in the Field of Science and Education

Social Informatics Today and Tomorrow: Status, Problems and Prospects of Development of Complex Lines in the Field of Science and Education triplec 9(2): 460-465, 2011 ISSN 1726-670X http://www.triple-c.at Social Informatics Today and Tomorrow: Status, Problems and Prospects of Development of Complex Lines in the Field of Science and Education

More information

Health Policy and Management Course Descriptions

Health Policy and Management Course Descriptions Health Policy and Management Course Descriptions HPM 500 (2) Introduction to the US Health Care System Fall, spring. Required for all MPH students. Introduces students to the US health care system, both

More information

PROGRAM DIRECTOR: Arthur O Connor Email Contact: URL : THE PROGRAM Careers in Data Analytics Admissions Criteria CURRICULUM Program Requirements

PROGRAM DIRECTOR: Arthur O Connor Email Contact: URL : THE PROGRAM Careers in Data Analytics Admissions Criteria CURRICULUM Program Requirements Data Analytics (MS) PROGRAM DIRECTOR: Arthur O Connor CUNY School of Professional Studies 101 West 31 st Street, 7 th Floor New York, NY 10001 Email Contact: Arthur O Connor, arthur.oconnor@cuny.edu URL:

More information

DEGREE CURRICULUM BIG DATA ANALYTICS SPECIALITY. MASTER in Informatics Engineering

DEGREE CURRICULUM BIG DATA ANALYTICS SPECIALITY. MASTER in Informatics Engineering DEGREE CURRICULUM BIG DATA ANALYTICS SPECIALITY MASTER in Informatics Engineering Module general information Module name BIG DATA ANALYTICS SPECIALITY Typology Optional ECTS 18 Temporal organization C1S2

More information

ARCHIVE PhD IN THE SPOTLIGHT

ARCHIVE PhD IN THE SPOTLIGHT ARCHIVE PhD IN THE SPOTLIGHT Gwenda van der Vaart Gwenda van der Vaart is a PhD researcher at the Department of Cultural Geography, Faculty of Spatial Sciences, University of Groningen (http://www.rug.nl/staff/g.van.der.vaart/).

More information

How To Help The European Single Market With Data And Information Technology

How To Help The European Single Market With Data And Information Technology Connecting Europe for New Horizon European activities in the area of Big Data Márta Nagy-Rothengass DG CONNECT, Head of Unit "Data Value Chain" META-Forum 2013, 19 September 2013, Berlin OUTLINE 1. Data

More information

Online MPH Program Supplemental Application Handbook

Online MPH Program Supplemental Application Handbook Online MPH Program Supplemental Application Handbook Table of Contents Online MPH Supplemental Application Handbook Completing & Submitting the Supplemental Application 2 Eligible Previous Public Health

More information

ASPH Education Committee Master s Degree in Public Health Core Competency Development Project

ASPH Education Committee Master s Degree in Public Health Core Competency Development Project ASPH Education Committee Master s Degree in Public Health Core Competency Development Project Version 2.3 Word Format Domains and Competencies Only May 2007 Discipline-specific Competencies A. BIOSTATISTICS

More information

DECLARATION OF THE 7 th WORLD SCIENCE FORUM ON The Enabling Power of Science. 7 th World Science Forum, Budapest, 7 th November 2015 PREAMBLE

DECLARATION OF THE 7 th WORLD SCIENCE FORUM ON The Enabling Power of Science. 7 th World Science Forum, Budapest, 7 th November 2015 PREAMBLE DECLARATION OF THE 7 th WORLD SCIENCE FORUM ON The Enabling Power of Science 7 th World Science Forum, Budapest, 7 th November 2015 PREAMBLE With the encouragement and support of the founding organisations

More information

Primary Strategic Priority/Foundational Element/Integrating Theme Addressed:

Primary Strategic Priority/Foundational Element/Integrating Theme Addressed: Proposal Title: Transform Rutgers New Brunswick Campus into an Urban Sustainability Laboratory and Classroom Principle Initiator(s): Nenad Gucunski and Jie Gong Primary Contact Name and Number: Nenad Gucunski,

More information

Education-qualification degree: MASTER Proffessional qualification: Master of Social work. Mode of study: full-time

Education-qualification degree: MASTER Proffessional qualification: Master of Social work. Mode of study: full-time MASTER PROGRAM OF SOCIAL WORK Education-qualification degree: MASTER Proffessional qualification: Master of Social work Duration: year Mode of study: full-time The Department of Social-medical Sciences

More information

Rio Political Declaration on Social Determinants of Health

Rio Political Declaration on Social Determinants of Health Rio Political Declaration on Social Determinants of Health Rio de Janeiro, Brazil, 21 October 2011 1. Invited by the World Health Organization, we, Heads of Government, Ministers and government representatives

More information

European Policy Brief

European Policy Brief European Policy Brief August 2015 Project number: 2014-1-UK01-KA200-001848 Aligning Vocational Education and Training Policy to Economic Development Strategy Implications for Regional and Local Policymakers

More information

REGULATIONS AND CURRICULUM FOR THE MASTER S PROGRAMME IN INFORMATION ARCHITECTURE FACULTY OF HUMANITIES AALBORG UNIVERSITY

REGULATIONS AND CURRICULUM FOR THE MASTER S PROGRAMME IN INFORMATION ARCHITECTURE FACULTY OF HUMANITIES AALBORG UNIVERSITY REGULATIONS AND CURRICULUM FOR THE MASTER S PROGRAMME IN INFORMATION ARCHITECTURE FACULTY OF HUMANITIES AALBORG UNIVERSITY SEPTEMBER 2015 Indhold PART 1... 4 PRELIMINARY REGULATIONS... 4 Section 1 Legal

More information

The Product Manager s Toolkit

The Product Manager s Toolkit The Product Manager s Toolkit Gabriel Steinhardt The Product Manager s Toolkit Methodologies, Processes and Tasks in High-Tech Product Management ISBN 978-3-642-04507-3 e-isbn 978-3-642-04508-0 DOI 10.1007/978-3-642-04508-0

More information

Healthcare, transportation,

Healthcare, transportation, Smart IT Argus456 Dreamstime.com From Data to Decisions: A Value Chain for Big Data H. Gilbert Miller and Peter Mork, Noblis Healthcare, transportation, finance, energy and resource conservation, environmental

More information

The Committee of Ministers, under the terms of Article 15.b of the Statute of the Council of Europe,

The Committee of Ministers, under the terms of Article 15.b of the Statute of the Council of Europe, Recommendation CM/Rec(2014)1 of the Committee of Ministers to member States on the Council of Europe Charter on shared social responsibilities 1 (Adopted by the Committee of Ministers on 22 January 2014

More information

EXECUTIVE SUMMARY 30 FINDINGS, 10 IMMEDIATE ACTIONS AND 10 LONG-TERM BUILDING BLOCKS

EXECUTIVE SUMMARY 30 FINDINGS, 10 IMMEDIATE ACTIONS AND 10 LONG-TERM BUILDING BLOCKS EXECUTIVE SUMMARY 30 FINDINGS, 10 IMMEDIATE ACTIONS AND 10 LONG-TERM BUILDING BLOCKS Extract from: Sami Andoura and Jean-Arnold Vinois, From the European Energy Community to the Energy Union. A policy

More information

The NSW Health Leadership Framework

The NSW Health Leadership Framework The NSW Health Leadership Framework July 2013 Foreword It is with great pleasure that I recommend to you the first NSW Health Leadership Framework. This framework has been developed by the Health Education

More information

College/University _University of Detroit Mercy Code: CD

College/University _University of Detroit Mercy Code: CD College/University _University of Detroit Mercy Code: CD Source of Guidelines/Standards: Michigan State Board of Education, Jan 2002 Program/Subject Area: Political Science Note: Michigan Test for Teacher

More information

SOCIETAL CHALLENGE 6 EUROPE IN A CHANGING WORLD: INCLUSIVE, INNOVATIVE AND REFLECTIVE SOCIETIES

SOCIETAL CHALLENGE 6 EUROPE IN A CHANGING WORLD: INCLUSIVE, INNOVATIVE AND REFLECTIVE SOCIETIES Jornadas virtuales de difusión sobre Horizonte 2020 15 December 2014 HORIZON 2020 SOCIETAL CHALLENGE 6 EUROPE IN A CHANGING WORLD: INCLUSIVE, INNOVATIVE AND REFLECTIVE SOCIETIES Cristina Marcuzzo DG Research

More information

Chapter 2 Conceptualizing Scientific Inquiry

Chapter 2 Conceptualizing Scientific Inquiry Chapter 2 Conceptualizing Scientific Inquiry 2.1 Introduction In order to develop a strategy for the assessment of scientific inquiry in a laboratory setting, a theoretical construct of the components

More information

Školská sociálna práca 191

Školská sociálna práca 191 190 SUMMARY I n the context of current social changes, social work is faced with various challenges related to the consequences of modernization for the socialization of children. The emergence of new

More information

EU economic. governance. Strong economic rules to manage the euro and economic and monetary union. istockphoto/jon Schulte.

EU economic. governance. Strong economic rules to manage the euro and economic and monetary union. istockphoto/jon Schulte. EU economic governance Strong economic rules to manage the euro and economic and monetary union Economic and istockphoto/jon Schulte Responding to the sovereign debt crisis important reforms of EU economic

More information

BOSTON UNIVERSITY SCHOOL OF PUBLIC HEALTH PUBLIC HEALTH COMPETENCIES

BOSTON UNIVERSITY SCHOOL OF PUBLIC HEALTH PUBLIC HEALTH COMPETENCIES BOSTON UNIVERSITY SCHOOL OF PUBLIC HEALTH PUBLIC HEALTH COMPETENCIES Competency-based education focuses on what students need to know and be able to do in varying and complex situations. These competencies

More information

Joint conclusions of the Spanish Presidency EU Youth Conference youth employment and social inclusion, Jerez, Spain 13-15 April 2010

Joint conclusions of the Spanish Presidency EU Youth Conference youth employment and social inclusion, Jerez, Spain 13-15 April 2010 Joint conclusions of the Spanish Presidency EU Youth Conference youth employment and social inclusion, Jerez, Spain 13-15 April 2010 Youth Employment is the common theme of the three EU Youth Conferences

More information

Energy Systems Integration

Energy Systems Integration Energy Systems Integration A Convergence of Ideas Ben Kroposki, Bobi Garrett, Stuart Macmillan, Brent Rice, and Connie Komomua National Renewable Energy Laboratory Mark O Malley University College Dublin

More information

Replacement Migration

Replacement Migration Population Division Department of Economic and Social Affairs United Nations Secretariat Replacement Migration United Nations ST/ESA/SER.A/206 Population Division Department of Economic and Social Affairs

More information

The role of ICT in the new urban agenda

The role of ICT in the new urban agenda The role of ICT in the new urban agenda September 2014 Introduction The new urban agenda For the first time in human history more people live in cities than in rural areas. By 2050 it is expected that

More information

How To Study Political Science At Pcj.Edu

How To Study Political Science At Pcj.Edu Political Science Courses-1 American Politics POL 110/American Government Examines the strengths and weaknesses, problems and promise of representative democracy in the United States. Surveys the relationships

More information

Living Labs in Architecture: Open innovation and co-creation towards a more sustainable architecture and lifestyle

Living Labs in Architecture: Open innovation and co-creation towards a more sustainable architecture and lifestyle Living Labs in Architecture: Open innovation and co-creation towards a more sustainable architecture and lifestyle Speakers: Masseck, T., Universitat Politècnica de Catalunya (UPC), BarcelonaTech, Spain,

More information

Council of the European Union Brussels, 13 February 2015 (OR. en)

Council of the European Union Brussels, 13 February 2015 (OR. en) Council of the European Union Brussels, 13 February 2015 (OR. en) 6022/15 NOTE From: To: Presidency RECH 19 TELECOM 29 COMPET 30 IND 16 Permanent Representatives Committee/Council No. Cion doc.: 11603/14

More information

The internet and digital technologies play an integral part

The internet and digital technologies play an integral part The Cyber challenge Adjacent Digital Politics Ltd gives an overview of the EU Commission s Cyber Security Strategy and Commissioner Ashton s priorities to increase cyber security in Europe The internet

More information

FACULTY OF SOCIAL ADMINISTRATION DEPARTMENT OF SOCIAL WORK

FACULTY OF SOCIAL ADMINISTRATION DEPARTMENT OF SOCIAL WORK FACULTY OF SOCIAL ADMINISTRATION DEPARTMENT OF SOCIAL WORK 1. NAME OF CURRICULUM Master of Social Work Program 2. NAME OF DEGREE Master of Social Work M.S.W. 3. OBJECTIVES 3.1 To produce graduates of social

More information

Center for Complex Engineering Systems at KACST and MIT

Center for Complex Engineering Systems at KACST and MIT Center for Complex Engineering Systems - KACST King Abdulaziz City for Science and Technology P.O Box 6086, Riyadh 11442 Kingdom of Saudi Arabia Center for Complex Engineering Systems - MIT Massachusetts

More information

Standards for Certification in Early Childhood Education [26.110-26.270]

Standards for Certification in Early Childhood Education [26.110-26.270] I.B. SPECIFIC TEACHING FIELDS Standards for Certification in Early Childhood Education [26.110-26.270] STANDARD 1 Curriculum The competent early childhood teacher understands and demonstrates the central

More information

Course Book. Data for ELCC School Registration 2015/16

Course Book. Data for ELCC School Registration 2015/16 Course Book Data for ELCC School Registration 2015/16 Dec 1, 2014 1 Appleby College, Balmoral Hall, The Bishop Strachan School, Elmwood School, Havergal College, Hawthorne School, Hillfield Strathallan

More information

Master of Public Affairs Course Descriptions

Master of Public Affairs Course Descriptions Master of Public Affairs Course Descriptions PA 5302 (POEC 5302 and PSCI 5302) Law and The Policy Process (3 semester hours) Provides the legal perspective on public policy and emphasizes the judicial

More information

Honourable members of the National Parliaments of the EU member states and candidate countries,

Honourable members of the National Parliaments of the EU member states and candidate countries, Speech by Mr Rudolf Peter ROY, Head of division for Security Policy and Sanctions of the European External Action Service, at the L COSAC Meeting 29 October 2013, Vilnius Honourable members of the National

More information

Westminster Campus Nursing Program Curriculum Organizing Framework

Westminster Campus Nursing Program Curriculum Organizing Framework Westminster Campus Nursing Program Curriculum Organizing Framework The curriculum organizing framework describes the concepts, beliefs and philosophy upon which the nursing curriculum is organized and

More information

DRAFT REPORT. EN United in diversity EN 2011/2068(INI) 10.2.2012. on a resource-efficient Europe (2011/2068(INI))

DRAFT REPORT. EN United in diversity EN 2011/2068(INI) 10.2.2012. on a resource-efficient Europe (2011/2068(INI)) EUROPEAN PARLIAMT 2009-2014 Committee on the Environment, Public Health and Food Safety 10.2.2012 2011/2068(INI) DRAFT REPORT on a resource-efficient Europe (2011/2068(INI)) Committee on the Environment,

More information

Thomas Risse. 2 nd International Alexandria Workshop 2015

Thomas Risse. 2 nd International Alexandria Workshop 2015 Thomas Risse 2 nd International Alexandria Workshop 2015 We inhabit a measurable global society nowadays The increasing wealth of data is a chance to disentangle the social complexity Thomas Risse 2 Big

More information

POLICYBRIEF EUROPEAN. - EUROPEANPOLICYBRIEF - P a g e 1

POLICYBRIEF EUROPEAN. - EUROPEANPOLICYBRIEF - P a g e 1 EUROPEAN POLICYBRIEF G. Hammerschmid, S. Van de Walle, A. Oprisor and V. Štimac Coordinating for cohesion in the public sector of the future (COCOPS) This policy brief summarizes the findings from a large-scale

More information

RESEARCH PROCESS AND THEORY

RESEARCH PROCESS AND THEORY INTERDISCIPLINARY RESEARCH PROCESS AND THEORY ALLEN F. REPKO The University of Texas at Arlington SAGE Los Angeles London New Delhi Singapore Washington DC Detailed Contents Preface Acknowledgments About

More information

Solving for the Future: Addressing Major Societal Challenges Through Innovative Technology and Cloud Computing

Solving for the Future: Addressing Major Societal Challenges Through Innovative Technology and Cloud Computing Solving for the Future: Addressing Major Societal Challenges Through Innovative Technology and Cloud Computing As economic challenges persist in communities, nations, and regions around the world, the

More information

Future and Emerging Technologies (FET) in H2020. Ales Fiala Future and Emerging Technologies DG CONNECT European Commission

Future and Emerging Technologies (FET) in H2020. Ales Fiala Future and Emerging Technologies DG CONNECT European Commission Future and Emerging Technologies (FET) in H2020 51214 Ales Fiala Future and Emerging Technologies DG CONNECT European Commission H2020, three pillars Societal challenges Excellent science FET Industrial

More information

EXECUTIVE MASTER IN. Increasing corporate value in today s complex digital world through reputation management and communication with stakeholders.

EXECUTIVE MASTER IN. Increasing corporate value in today s complex digital world through reputation management and communication with stakeholders. EXECUTIVE MASTER IN CORPORATE COMMUNICATION Increasing corporate value in today s complex digital world through reputation management and communication with stakeholders. COURSE DESCRIPTION At a Glance

More information

Scoping Paper for. Horizon 2020 Societal Challenge 'Europe in a changing world inclusive, innovative and reflective societies'

Scoping Paper for. Horizon 2020 Societal Challenge 'Europe in a changing world inclusive, innovative and reflective societies' Scoping Paper for Horizon 2020 Societal Challenge 'Europe in a changing world inclusive, innovative and reflective societies' 1. Context Important Notice: Working Document This paper is a working document.

More information

PARIS AGENDA OR 12 RECOMMENDATIONS FOR MEDIA EDUCATION

PARIS AGENDA OR 12 RECOMMENDATIONS FOR MEDIA EDUCATION PARIS AGENDA OR 12 RECOMMENDATIONS FOR MEDIA EDUCATION 25 years after the adoption of the Grünwald Declaration that paved the way for media education at the international level, experts, education policy-makers,

More information

Animation. Intelligence. Business. Computer. Areas of Focus. Master of Science Degree Program

Animation. Intelligence. Business. Computer. Areas of Focus. Master of Science Degree Program Business Intelligence Computer Animation Master of Science Degree Program The Bachelor explosive of growth Science of Degree from the Program Internet, social networks, business networks, as well as the

More information

Course Book. Data for ELCC School Registration 2016/17

Course Book. Data for ELCC School Registration 2016/17 Course Book Data for ELCC School Registration 2016/17 December 6 2015 1 Appleby College, Balmoral Hall, The Bishop Strachan School, Elmwood School, Havergal College, Hillfield Strathallan College, Northmount

More information

NETH-ER AND THE EU KNOWLEDGE AND INNOVATION AGENDA TO 2020

NETH-ER AND THE EU KNOWLEDGE AND INNOVATION AGENDA TO 2020 POSITION PAPER NETH-ER AND THE EU KNOWLEDGE AND INNOVATION AGENDA TO 2020 CONTINUE TO INVEST IN KNOWLEDGE AND SCIENCE KNOWLEDGE AND INNOVATION ESSENTIAL FOR RENEWED GROWTH IN EUROPE Through constant innovation,

More information

GOVERNANCE AND CIVIL SOCIETY

GOVERNANCE AND CIVIL SOCIETY PARTNERS FOR CHANGE GOVERNANCE AND CIVIL SOCIETY SUB-SAHARAN AFRICA PARTNERS FOR CHANGE GOVERNANCE AND CIVIL SOCIETY PARTNERS FOR CHANGE The British Council is committed to building engagement and trust

More information

E-GOVERNMENT: PROVIDING VALUE TO CITIZENS

E-GOVERNMENT: PROVIDING VALUE TO CITIZENS 6 th Global Forum on Reinventing Government Towards Participatory and Transparent Governance 24 27 May 2005, Seoul, Republic of Korea E-GOVERNMENT: PROVIDING VALUE TO CITIZENS Jerzy Szeremeta and Richard

More information

- CHECK AGAINST DELIVERY -

- CHECK AGAINST DELIVERY - Opening statement by Frans Timmermans, First Vice-President designate, in charge of Better Regulation, Inter-Institutional Relations, the Rule of Law and the Charter of Fundamental Rights 7 October 2014

More information

The MPH. ability to. areas. program. planning, the following. Competencies: research. 4. Distinguish. among the for selection

The MPH. ability to. areas. program. planning, the following. Competencies: research. 4. Distinguish. among the for selection MPH COMPETENCIES The MPH competencies are based on those approved by the Association of Schools of Public Health (ASPH) in 2006. By graduation, all MPH students must demonstrate the ability to apply public

More information

Indiana University East Faculty Senate

Indiana University East Faculty Senate Indiana University East Faculty Senate General Education Curriculum for Baccalaureate Degree Programs at Indiana University East The purpose of the General Education Curriculum is to ensure that every

More information

Development of Public Administration in China: Since 1978 Mao Shoulong (Draft)

Development of Public Administration in China: Since 1978 Mao Shoulong (Draft) Development of Public Administration in China: Since 1978 Mao Shoulong (Draft) Since the end of 1978, China s economy has developed very quickly because of the introducing of reform and opening up policy.

More information

Master s degree programme in Architecture

Master s degree programme in Architecture Study plan Master s degree programme in Architecture (Master of Science in Architecture MSc Arch) 2014 16. May 2014 Curriculum Master of Science in Architecture 2014 1 The Study concept was developed by

More information

Data Center Infrastructure Management. optimize. your data center with our. DCIM weather station. Your business technologists.

Data Center Infrastructure Management. optimize. your data center with our. DCIM weather station. Your business technologists. Data Center Infrastructure Management optimize your data center with our DCIM weather station Your business technologists. Powering progress Are you feeling the heat of your data center operations? Data

More information

Fairfield Public Schools Social Studies Curriculum Civics: International Relations Grades 11-12

Fairfield Public Schools Social Studies Curriculum Civics: International Relations Grades 11-12 Fairfield Public Schools Social Studies Curriculum Civics: International Relations Grades 11-12 12/14/2015 1 Civics and International Relations: Description This course is designed to explore the important

More information

Harnessing vital data to inform an optimal market access strategy in the UK

Harnessing vital data to inform an optimal market access strategy in the UK White paper Harnessing vital data to inform an optimal market access strategy in the UK The power of the outcomes audit Access to >61M patient lives via EHRs since 2004 Paul Sutton, BA Hons, MA (Oxon),

More information

Springer-Verlag Berlin Heidelberg GmbH

Springer-Verlag Berlin Heidelberg GmbH Information Systems Outsourcing Springer-Verlag Berlin Heidelberg GmbH Rudy Hirschheim Armin Heinzl. Jens Dibbern Editors Information Systems Outsourcing Enduring Themes, Emergent Patterns and Future Directions

More information

Core Ideas of Engineering and Technology

Core Ideas of Engineering and Technology Core Ideas of Engineering and Technology Understanding A Framework for K 12 Science Education By Cary Sneider Last month, Rodger Bybee s article, Scientific and Engineering Practices in K 12 Classrooms,

More information