The ODD protocol: a standard format for describing individualbased and agent-based models. Volker Grimm

Similar documents
Simulation in a Nutshell

Information visualization examples

ArcGIS Data Models Practical Templates for Implementing GIS Projects

Review. Bayesianism and Reliability. Today s Class

Appendix A: Science Practices for AP Physics 1 and 2

Graphic Notations for ABM/S in OR/MS

Visualization. Program visualization

Copyright. Network and Protocol Simulation. What is simulation? What is simulation? What is simulation? What is simulation?

Appendix B Data Quality Dimensions

Requirements Traceability. Mirka Palo

High-Mix Low-Volume Flow Shop Manufacturing System Scheduling

1: B asic S imu lati on Modeling

Nursing Journal Toolkit: Critiquing a Quantitative Research Article

Indiana University East Faculty Senate

ABSTRACT FOR THE 1ST INTERNATIONAL WORKSHOP ON HIGH ORDER CFD METHODS

Indiana Statewide Transfer General Education Core

Optimization applications in finance, securities, banking and insurance

Big Data: Exploring Possibilities to Improve Predictive Exposure Capabilities

Summary of Survey Cost White Paper. Alan F. Karr National Institute of Statistical Sciences

Introduction to Engineering System Dynamics

.OR.AT.ATTORNEY.AUCTION.BARGAINS.BAYERN.BERLIN.BLACKFRIDAY.BOUTIQUE.BRUSSELS.BUILDERS

Agent-based Simulation Platforms: Review and Development Recommendations

IAI : Expert Systems

Approaches to Ethical Decision Making Association of Professional Engineers and Geoscientists of British Columbia (APEGBC)

Gouvernement du Québec Ministère de l Éducation, ISBN

VDI 2206 Prof. Dr. Magdy M. Abdelhameed

THE RISKS OF OUTSOURCING TRANSPORT FUNCTIONS IN RELATIONS BETWEEN THE COOPERATION FIRMS

Future Landscapes. Research report CONTENTS. June 2005

Organizational Learning and Knowledge Spillover in Innovation Networks: Agent-Based Approach (Extending SKIN Framework)

Criteria for Selection of. Environmental Decision Support Software. Technology Demonstration Participants

Relevant Arizona State Standards

Appendix C: Software Papers and Case Studies

ORACLE OLAP. Oracle OLAP is embedded in the Oracle Database kernel and runs in the same database process

Directions: Complete assessment with team. Determine current level of implementation and priority. Level of Implementation. Priority.

Edward Odenkirchen, Ph.D. Office of Pesticide Programs US Environmental Protection Agency

Busting 7 Myths about Master Data Management

Projections, Predictions, or Trends?

Sexuality Education Curriculum Audit Tool

Available online at ScienceDirect. Procedia Computer Science 52 (2015 )

What is Wrong with EMR?

Driving Economic Development: The Role of the Public Research University

Big Data for smart infrastructure: London Bridge Station Redevelopment. Sinan Ackigoz & Krishna Kumar Cambridge, UK

Agent-based dam monitoring

CDC UNIFIED PROCESS PRACTICES GUIDE

Software Requirements Metrics

LIFE FINANCIAL REPORTING SUB COMMITTEE. Information Note: Target Surplus

International Master's Programme in Computer Engineering, 120 higher education credits

IS INTERNATIONAL STANDARD. Environmental management - Life cycle assessment - Principles and framework

The aims: Chapter 14: Usability testing and field studies. Usability testing. Experimental study. Example. Example

Computer Information Systems (CIS)

Diversity and Equality Policy

Obtaining Knowledge. Lecture 7 Methods of Scientific Observation and Analysis in Behavioral Psychology and Neuropsychology.

Periodical meeting CO2Monitor. Leakage characterization at the Sleipner injection site

The Creative Curriculum for Preschool: Objectives for Development & Learning

Complexity Based Business Decision Support Tools for Telecommunications Applications. David Collings, Nicola Baxter, Michael Lyons

1 in 30 year 1 in 75 year 1 in 100 year 1 in 100 year plus climate change (+30%) 1 in 200 year

Introduction to Longitudinal Data Analysis

MIDLAND ISD ADVANCED PLACEMENT CURRICULUM STANDARDS AP ENVIRONMENTAL SCIENCE

How can we predict the performance of small firms online advertising? An agent-based modelling & simulation approach

CHAPTER 1 INTRODUCTION

Department of Engineering Technology Assessment Progress Report Calendar Year 2011 (prepared March 2012)

Limitations of Equilibrium Or: What if τ LS τ adj?

Mastering increasing product complexity with Collaborative Systems Engineering and PLM

Prescription of qualifications: ARB Criteria at Parts 1, 2 and 3

What is Modeling and Simulation and Software Engineering?

BS Environmental Science ( )

I. Thinking and Thinking About Thinking A. Every human being thinks and thinks continually, but we do little thinking about our thinking.

Cross-Company System Simulation using the GUSMA-Standard for Co-Simulation

FOREIGN AFFAIRS PROGRAM EVALUATION GLOSSARY CORE TERMS

Ontology and automatic code generation on modeling and simulation

STAGE 1 COMPETENCY STANDARD FOR PROFESSIONAL ENGINEER

Continuous vs. Discontinuous Nature vs. Nurture

DEPARTMENT OF TRANSPORTATION MANAGEMENT

Understanding of Enterprise Architecture - Essences and Framework

User research for information architecture projects

GEOGRAPHIC INFORMATION GATEWAY New York Department of State (NYDOS) data acceptance & metadata standards

TRANSPORTATION MODELLING IN CALGARY

NATIONAL COMPETENCY-BASED TEACHER STANDARDS (NCBTS) A PROFESSIONAL DEVELOPMENT GUIDE FOR FILIPINO TEACHERS

Model Policy on Eyewitness Identification

Evaluating Programmer and Graphic Designer Interaction Using the Model 1 and Model 2 Web Development Architectures

Trading and Price Diffusion: Stock Market Modeling Using the Approach of Statistical Physics Ph.D. thesis statements. Supervisors: Dr.

Pitt Public Health Competency and Assessment Project Final Report

An Online Resource for the Design of Instructional Videos and Animations

ADVANCE Model Diagnostics Exercise Study Protocol

Analytic Modeling in Python

System Development and Life-Cycle Management (SDLCM) Methodology. Approval CISSCO Program Director

Interdisciplinary Understanding: What Counts as Quality Work?

2011, The McGraw-Hill Companies, Inc. Chapter 3

Describe the process of parallelization as it relates to problem solving.

Standards of Professional Performance for the Acute Care Clinical Nurse Specialist. Introduction

Fourth generation techniques (4GT)

Motivation and Contents Overview

HR Data Retrieval in a LDAP- Enabled Directory Service

1. FORMULATING A RESEARCH QUESTION

REGIONAL CLIMATE AND DOWNSCALING

5 day Training on Climate Change and Adaptation

Data Structures and Algorithms

CLIMATE CHANGE AND NATURE,

**************************************** What is the difference between an invasive species and an introduced species?

cognitive work analysis.

Transcription:

The ODD protocol: a standard format for describing individualbased and agent-based models Volker Grimm

Lack of standards The only complete representation of most ABMs is their implementation Programs are usually not available, too specific (language, platform, operation system), and won t run on any computer after a few years No standard format for documenting and communicating ABMs Limited replicability is the major limitation of ABM as scientific tool SEITE 2 / 56

Requirements for a standard format Support written formulation Easy to use, simple structure, simple logics Direct benefits to those using the standard (never count on altruism in science) Make writing and reading model descriptions easier Support complete descriptions and replicability Cover simple and complex models from different domains SEITE 3 / 56

ODD protocol in 2006 2005 SEITE 4 / 56

SEITE 5

The ODD protocol SEITE 6 / 56

1. Purpose Question: What is the purpose of the model? SEITE 7 / 56

2. Entities, state variables, and scales Questions: What kinds of entities are in the model? Agents, collectives, spatial units, global environment By what state variables, or behavioural attributes, are these entities characterized? Age, sex, wealth, opinion, strategy; soil type, land costs; rainfall, market price, disturbance frequency What are the temporal and spatial resolutions and extents of the model? SEITE 8 / 56

3. Process overview and scheduling Questions: Who (i.e., what entity) does what, and in what order? When are state variables updated? How is time modeled, as discrete steps or as a continuum over which both continuous processes and discrete events can occur? Except for very simple schedules, one should use pseudo-code to describe the schedule in every detail, so that the model can be re-implemented from this code. Ideally, the pseudo-code corresponds fully to the actual code used in the program implementing the ABM. SEITE 9 / 56

4. Design concepts Questions: There are 10 design concepts. Most of these were discussed extensively by Railsback (2001), Grimm and Railsback (2005; Ch. 5), and in Railsback and Grimm (2012) and are summarized in the following questions: SEITE 10 / 56

SEITE 11 / 56 Emergence What emerges from the model (rather than being imposed)? Adaptation How do the agents adapt to improve their fitness? (Directly and indirectly) Fitness What are the goals of the agents? What determines their survival? Prediction How do agents predict the consequences of their decisions? Use of learning, memory, environmental cues, embedded assumptions Sensing What are agents assumed to know or perceive when making decisions? Is the sensing process itself explicitly modelled? Interaction What forms of interaction among agents are there? Stochasticity Justification for any stochasticity in the model Collectives Grouping of individuals Observation How are data collected from the model for analysis?

5. Initialization Question: What is the initial state of the model world, i.e., at time t = 0 of a simulation run? In detail, how many entities of what type are there initially, and what are the exact values of their state variables (or how were they set stochastically)? Is initialization always the same, or is it allowed to vary among simulations? Are the initial values chosen arbitrarily or based on data? References to those data should be provided. SEITE 12 / 56

6. Input data Question: Does the model use input from external sources such as data files or other models to represent processes that change over time? SEITE 13 / 56

7. Submodels Questions: What, in detail, are the submodels that represent the processes listed in Process overview and scheduling? What are the model parameters, their dimensions, and reference values? How were submodels designed or chosen, and how were they parameterized and then tested? SEITE 14 / 56

Example Gusset et al. 2009 SEITE 15 / 56

Example Gusset et al. 2009 SEITE 16 / 56

Example SEITE 17 / 56

Example SEITE 18 / 56

Example SEITE 19 / 56

Summary ODD is a standard format for describing (and formulating) IBMs/ABMs: 1. Overview first, details later 2. Design concepts 3. Easy to write, easy to read 4. Facilitate replication 5. Independent from discipline, complexity, operation system, programming language SEITE 20