Lluis Belanche + Alfredo Vellido. Intelligent Data Analysis and Data Mining. Data Analysis and Knowledge Discovery



Similar documents
Process Mining. ^J Springer. Discovery, Conformance and Enhancement of Business Processes. Wil M.R van der Aalst Q UNIVERS1TAT.

Using Process Mining to Bridge the Gap between BI and BPM

Process Mining: Making Knowledge Discovery Process Centric

Special Session on Process Mining for the 2015 IEEE Symposium on Computational Intelligence and Data Mining

Process Modelling from Insurance Event Log

Data Science. Research Theme: Process Mining

Chapter 4 Getting the Data

Model Discovery from Motor Claim Process Using Process Mining Technique

Mercy Health System. St. Louis, MO. Process Mining of Clinical Workflows for Quality and Process Improvement

Business Intelligence and Process Modelling

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Business Process Modeling

The BPM to UML activity diagram transformation using XSLT

SecSy: A Security-oriented Tool for Synthesizing Process Event Logs

Process Mining Manifesto

Curriculum Overview. Department of Systems Analysis and IT. Berlin Institute of Technology Prof. Dr. Krallmann. Olga Levina

Nr.: Fakultät für Informatik Otto-von-Guericke-Universität Magdeburg

Business Process Modeling Information Systems in Industry ( )

Business Process Discovery

An Automated Workflow System Geared Towards Consumer Goods and Services Companies

Business Activity Monitoring

Relational XES: Data Management for Process Mining

BPM Methodologies: Turning the Land of Confusion into Solutions for your BPM Initiatives. Alan Ramias Partner PERFORMANCE DESIGN LAB

What Business and Process Analysts Need to Know About BPM Suites

Business Intelligence and Process Modelling

From Business Process Models to Use Case Models

Combination of Process Mining and Simulation Techniques for Business Process Redesign: A Methodological Approach

Process Mining. Data science in action

WebSphere Business Modeler

Process Mining and Monitoring Processes and Services: Workshop Report

Analysis of Service Level Agreements using Process Mining techniques

Process Mining Tools: A Comparative Analysis

Six Sigma aims to maximise customer satisfaction and minimise defects.

Introduction to Workflow

Chapter 12 Analyzing Spaghetti Processes

Rules and Business Rules

Master Thesis September 2010 ALGORITHMS FOR PROCESS CONFORMANCE AND PROCESS REFINEMENT

Process Mining: Using CPN Tools to Create Test Logs for Mining Algorithms

Lluis Belanche + Alfredo Vellido. Intelligent Data Analysis and Data Mining

Introduction. A. Bellaachia Page: 1

Supporting the BPM lifecycle with FileNet

A Knowledge Management Framework Using Business Intelligence Solutions

PROPHIX and Corporate Performance Management. A white paper prepared by PROPHIX Software June 2010

Business Process Management

TEXT ANALYTICS INTEGRATION

A Time Efficient Algorithm for Web Log Analysis

Magic Quadrant for Intelligent Business Process Management Suites

Introduction to Data Mining and Business Intelligence Lecture 1/DMBI/IKI83403T/MTI/UI

LEADing Practice: Artifact Description: Business, Information & Data Object Modelling. Relating Objects

Kai Wähner. The Next-Generation BPM for a Big Data World: Intelligent Business Process Management Suites (ibpms)

An Event Processing Platform for Business Process Management

Life-Cycle Support for Staff Assignment Rules in Process-Aware Information Systems

Database Marketing, Business Intelligence and Knowledge Discovery

SOA Enabled Workflow Modernization

Business Process Modeling

Introduction to Data Mining and Machine Learning Techniques. Iza Moise, Evangelos Pournaras, Dirk Helbing

BPMN PATTERNS USED IN MANAGEMENT INFORMATION SYSTEMS

Converging Technologies: Real-Time Business Intelligence and Big Data

Business Process Measurement in small enterprises after the installation of an ERP software.

Business Process Management

PROJECT MANAGEMENT PLAN TEMPLATE < PROJECT NAME >

The OMG BPM Standards

Pentaho Data Mining Last Modified on January 22, 2007

PMP Examination Tasks Puzzle game

10g versions followed on separate paths due to different approaches, but mainly due to differences in technology that were known to be huge.

A UML 2 Profile for Business Process Modelling *

Fundamentals of Measurements

Go beyond 95: learn Business Process Management (BPM)! Razvan Radulian, MBA Independent Consultant/Coach Why-What-How Consulting, LLC

Business Process Quality Metrics: Log-based Complexity of Workflow Patterns

Feature. Applications of Business Process Analytics and Mining for Internal Control. World

Process Mining Using BPMN: Relating Event Logs and Process Models

Business-Driven Software Engineering Lecture 3 Foundations of Processes

Rabobank: Incident and change process analysis

Quality Process in Engineering ISO 9000 and Beyond. Presented by: Roxanne L. Pillar, P.E. October 2014

Budapest University of Technology and Economics Department of Measurement and Information Systems. Business Process Modeling

ProM Framework Tutorial

Dr. Jana Koehler IBM Zurich Research Laboratory

MEASURING SOFTWARE FUNCTIONAL SIZE FROM BUSINESS PROCESS MODELS

Principles of Managing Operations (PMO)

Building a Data Quality Scorecard for Operational Data Governance

Semantic Business Process Management Lectuer 1 - Introduction

Examination SUBJECT. Version:

Introduction to BPMN

Integration of SAP NetWeaver BPM and Signavio Process Editor. A White Paper

Total Quality Management (TQM) Quality, Success and Failure. Total Quality Management (TQM) vs. Process Reengineering (BPR)

Facilitating Business Process Discovery using Analysis

UML TUTORIALS THE USE CASE MODEL

Revealing the Big Picture Using Business Process Management

Diagram Models in Continuous Business Process Improvement

Analytics for Performance Optimization of BPMN2.0 Business Processes

Fundamentals of Business Process Management

Transcription:

Lluis Belanche + Alfredo Vellido Intelligent Data Analysis and Data Mining or Data Analysis and Knowledge Discovery a.k.a. Data Mining II

An insider s view

Geoff Holmes: WEKA founder

Process Mining

Process Mining (PM) PM sits between CI and DM on the one hand, and process modeling and analysis on the other. PM aims to discover, monitor and improve real processes by extracting knowledge from event logs. event logs Whyare PM? extracted an ever increasing from data sources number (e.g., databases, of events transaction are being logs, audit trails, recorded, etc.). Examples providing of detailed formats are information MXML (Mining about extensible the history Markup of Language) processes. and XES On (extensible the other Event hand, Stream). there XES is a was need selected to improve by the IEEE and Task Force on Process Mining as the standard format for logging events. support business processes in rapidly changing and aggressively There are several tools to extract MXML or XES logs from various data sources. competitive See for example: environments. XESame PM includes (automated) process discovery (extracting process ProMimport models from an event log), conformance checking (monitoring Nitro deviations of model from log), organizational mining (inc. social networks), automated construction of simulation models, model extension, model repair, case prediction, and history based recommendations.

Process Mining (PM) PM could be a bridge between DM and business process modeling and analysis, under the umbrella concept of Business Intelligence (BI). It can also be seen as the "missing link" between DM and traditional modeldriven BPM. Most DM techniques are not fit as such for process analysis. Co existing analytical concepts: Business Activity Monitoring (BAM): technologies enabling the real time monitoring of business processes. Complex Event Processing (CEP): technologies to process large amounts of Six Sigmaevents is a set for of strategies, optimizing techniques, the business and in tools real for time. process Corporate improvement. Performance It was developed by Motorola Management in 1981. [ and (CPM): became measuring famous when the it performance became a successful of a process business or strategy at General organization. Electric in 1995. Today, it is used in many industrial sectors. It seeks to Co existing improve the management quality of process concepts: outputs such by identifying as Continuous and removing Processthe causes of defects (errors) Improvement and minimizing (CPI), Business variability Process in business Improvement processes. It (BPI), uses a Total set of Quality quality management methods, including statistical methods Management (TQM), and Six Sigma. PM enables all these within a single Each Six Sigma project carried out within an organization follows a defined sequence of steps and has quantified framework. value targets, for example: reduce process cycle time, reduce pollution, reduce costs, increase customer satisfaction, or increase profits.

Process Mining (PM) Event logs: All PM techniques assume that it is possible to sequentially record events such that each event refers to an activity (a well defined step in some process) and is related to a particular case (a process instance). EL may store additional information about events: resource (person or device) executing the activity, timestamp of the event, or data elements recorded together with the event.

Process Mining (PM) Discovery: The first element of PM is discovery. A discovery technique takes an event log and produces a model without using any a priori information. Conformance: The second is conformance: an existing process model is compared with an event log of the same process. Conformance checking can be used to check if reality/process, as recorded in the EL, conforms to the model and vice versa. Conformance checking can be applied to procedural models, organizational models, declarative process models, etc. Enhancement : Extending or improving an existing PM using information about the actual process recorded in some EL. This third type of PM aims at changing or extending the a priori model.

Process Mining (PM): perspectives Control flow perspective: focuses on the ordering of activities. The goal of mining this perspective is to find a good characterization of all possible paths. The result is typically expressed in terms of a Petri net or some other process notation (EPCs, BPMN, or UML activity diagrams). Organizational perspective: focuses on information about resources hidden in the event log, i.e., which actors (people, systems, roles, or departments) are involved and how are they related. The goal is to either structure the organization by classifying people in terms of roles and organizational units or to map a social network. Case perspective: focuses on properties of cases. A case can be characterized by its path in the process or by the actors working on it. Business Process Model and Notation (BPMN) example. A graphical representation for specifying business processes in a business process model.

Process Mining (PM): BPM vs. PM Business Process Modeling: 7 phases :In the (re)design phase a new process model is created or an existing process model is adapted. In the analysis phase a candidate model and its alternatives are analyzed. Then, the model is implemented (implementation phase) or an existing system is (re)configured (reconfiguration phase). In the execution phase, the designed model is enacted. During the execution phase the process is monitored. Moreover, smaller adjustments may be made without redesigning the process (adjustment phase). In the diagnosis phase the enacted process is analyzed and the output of this phase may trigger a new process redesign phase.

Process Mining (PM): BPM vs. PM PMining: 5stages: Plan and Justify: Includes understanding the available data and process domain. Extract: event data, models, objectives, and questions need to be extracted from systems, domain experts, and management. Control flow modelling: control flow model is constructed and linked to the event log. Here automated process discovery techniques can be used. The event log may be filtered or adapted using the model (e.g., removing outlier cases and inserting missing events). Integrated process model: the control flow model may be extended with other perspectives (e.g., data, time, and resources). Operational support: Moreover, smaller adjustments may be made without redesigning the process (adjustment phase). In the diagnosis phase the enacted process is analyzed and the output of this phase may trigger a new process redesign phase.

Process Mining (PM): Guiding principles PMining: 5 stages : Plan and Justify: Includes understanding the available data and process domain. Extract: event data, models, objectives, and questions need to be extracted from systems, domain experts, and management. Control flow modelling: control flow model is constructed and linked to the event log. Here automated process discovery techniques can be used. The event log may be filtered or adapted using the model (e.g., removing outlier cases and inserting missing events). Integrated process model: the control flow model may be extended with other perspectives (e.g., data, time, and resources). Operational support: Moreover, smaller adjustments may be made without redesigning the process (adjustment phase). In the diagnosis phase the enacted process is analyzed and the output of this phase may trigger a new process redesign phase.

Process Mining (PM) PM as a building block of BI

Process Mining (PM) PM book

Process Mining (PM) PM IEEE Task Force