1 SDLC Methodologies and Validation Presented by: Pamela Campbell Lead Consultant, Compliance Services DataCeutics, Inc. Presented for: DIA Annual Meeting, June 2004 Session 330 VA Validation, EDM, IT June 16, :30am
2 Who We Are. The Leader in Information Technology Support and Services for the Clinical Research Environment Headquartered in Pottstown, PA Solutions include Services and Software Products Three Business Lines: Clinical Systems Services (CSS) Clinical Reporting Services (CRS) Computer Systems Compliance Services (CSCS) Expert Consultants
3 Our Computer Systems Compliance Philosophy... Computer Systems must be planned, designed, developed, tested, installed, operated, maintained, and archived according to regulations and acceptable industry and company standards
4 Agenda Validation The Phases of a Project Project Conception System Study Programming Acceptance Operational Maintenance Decommission Conclusions
5 Validation Validation The establishing of documented evidence through defined tests & challenges, that a system or process meets design criteria & that adequate provisions have been established to keep it in a state of control so it will produce a product that meets predetermined specifications and quality attributes. When done correctly validation creates sustainable, repeatable success! When done incorrectly validation becomes a burden that hinders business and results in audit findings and Form 483s.
6 Phases of a Project Project Management Conception Define Scope SDLC Validation Plan Validation System Study (Design) Programming Acceptance Operational Maintenance User / Function Requirements Design Code Unit Testing System and Integration Performance and User Acceptance Testing Installation Release User / Function Requirements Specification System Design Specification Vendor and Risk Assessments Code Reviews Unit Test Plan, Scripts, Matrix, Report System and Integration Plan, Scripts, Matrix, Report PQ/UAT Test Plan, Scripts, Matrix, Report IQ/OQ Plan, Execution, IQ/OQ Report, Validation Report Change Control, Backup Functioning under SOPs for change and Recovery, Archiving control, etc.
7 Project Conception Critical function definition of scope Both the project scope and the scope of the validation must be defined in this phase! Both should be defined in the validation plan. Scope creep will kill a project! Determine what is not covered by the project, examples: Network qualification Data Center qualification
8 System Study Chosen methodology for designing system should be spelled out in a SDLC SOP or the validation plan. Validation and project deliverables: User & Functional Requirement Specifications Remember requirements must be testable! Don t forget 21 CFR Part 11 & Predicate Rules! System Design Specification edms purchased system describe how the system is to be installed, configured, and programmed Matrix from UFRS to Design For Vendor systems Vendor Assessment! Risk Assessment
9 Development Methodologies (System Study) Waterfall Whirlpools Incremental / Spiral Prototyping Whichever is selected it must be documented in the validation plan and any matching SOPs!
10 Waterfall Conception Requirements Design Programming Code Review Unit Test SIT UAT Installation Operation Maintenance
11 Waterfall - issues Studies show waterfall method is 90% project management and 10% what is to be done and how to do it. Each phase feeds into the next and therefore there is no feedback creating a gap between end user and developers. No way to go back and fix mistakes. Very expensive to use. Takes a long time.
12 Whirlpool Conception Initial Iteration Conception Requirements Design Programming Code Review Unit Test SIT UAT Installation Operation Verification Loop Reconcile system to expectations Maintenance
13 Whirlpool Basics More interaction between initiators and staff implementing requirements. Verification Loop second iteration to remove bugs found in testing. Loop to reconcile system to user expectations was the correct system built? Steps move and shift to save time and money when answering this question.
14 Whirlpool Difficulties Very complex methodology. Difficult to manage due to number of iterations. Hand off to maintenance tends to be shaky. Still gaps between - What and How Developers present system instead of users presenting requirements.
15 Incremental / Spiral Conception Reconciliation Requirements Requirements Reconciliation Reconciliation Design Requirements Design Verification Reconciliation Programming Verification Design Code Review Programming Unit Test Verification Code Integration Review Unit Test Programming Integration SIT Code Review Unit Test UAT SIT Integration UAT Installation SIT Operations Installation& UAT Maintenance Operations & Reconciliation Maintenance Installation Reconciliation Operations & Maintenance Reconciliation
16 Incremental / Spiral Perform the waterfall in sections. Several mini projects are undertaken to implement the goal. Gap between what and how is narrowed. Requirements and Design are closely related. Clean Interfaces must be maintained between the modules.
17 Prototyping Conception Requirements Design Programming Code Review Prototyping Each phase feed into the next, But there is feedback among the first three phases Unit Test SIT UAT Installation Operation Maintenance
18 Prototyping Prototyping is a process that permits the developer to create a model or mock-up of the system to be built. It must be decided in advance if the prototype is a throwaway or to be kept as the initial version of the system. If the prototype is the initial version of the system the code must be placed under configuration management. The choice must be documented in the validation plan.
19 Prototyping Prototyping begins with some type of protosystem or model. Then an initial set of requirements is created. The model is then updated with modifications. A matching update of the requirements is made. This process is repeated until the requirements are finalized.
20 Prototyping Issues Keeping code under control. Customer does not realize the prototype is not a working supportable code model and does not understand additional time required to go from prototype to deliverable system. An inappropriate operating system or programming language may have been used to create the model and everything must be reworked. Rules must be defined before prototyping begins! Validation Plan Prototyping SOP
21 Programming Validation and Project Deliverables Code Code walk throughs Memos Responses Unit Testing Plan (Matrix from UFRS to Design to Scripts) Scripts Report of results (include resolutions to errors) System and Integration testing Plan (Matrix from UFRS to Design to Scripts) Scripts Report of results (include resolutions to errors)
22 Programming Code should be written in a controlled manner. Standards help promote the writing of maintainable code. Code / configuration management Permits the easy backing out of changes. Allows for repeatability. Metrics. Code walk throughs! Verify standards are being followed. Match code to what is being stored and tracked in Code Management tools.
23 Programming Unit Testing Test the individual modules. Do the requirements track to a module or will an SOP need to be written to meet a requirement? Users should be told as soon as possible. System and Integration Testing When modules interface with each other and the target Operating System do they continue to work? Again do requirements track?
24 Acceptance Validation and Project Deliverables IQ/OQ for testing Installation and Operation Qualification for Test System Execution Report of Results Performance Qualification / User Acceptance Testing Plan Scripts Execution of scripts Resolution of non-conformances Traceability Matrix Report of results
25 Acceptance Performance Testing This is only useful if performance requirements were defined so that they are measurable. Internet speed can not be meaningfully tested! No one company has end to end control of an Internet connection. Performance testing should be executed on manufacturing systems and laboratory systems that function in real-time! Other items such as scanners for edms may also require testing for data transfer tolerances.
26 Acceptance User Acceptance Testing Scripts should mimic actual plan use of the system. If instruments or devices will be connected and transferring data, check those interfaces! Remember to do all those security tests for 21 CFR Part 11! This is critical for edms that will use electronic signatures. If a SOP will be used for missing functionality make sure this is documented in the PQ/UAT Traceability Matrix and PQ/UAT Report.
27 Operational Validation and Project Deliverables Installation and Operation Qualification for Production System Test items such as backup and physical security if not tested in PQ/UAT Execution Report of Results Validation Report Deviations from the Validation Plan Any non-conformances from testing - include resolution
28 Maintenance The system is now in a controlled, successfully functioning state, how will you keep it there? SOPs Change Control Validation and Re-validation Security Anti-Virus Disaster Recovery Business Continuity User Management Auditing
29 Decommission When the system becomes obsolete, how will the data from it be stored to match the data retention policy? Migrate information to another system? Mothball the system? Retire the system but keep it running?
30 Other things to worry about... Security Do your backups really work? Test them! Disaster Recovery (did you test that plan?) Network Qualification Data Center Qualification Training in the new application On going training for new hires
31 Training Make sure your developers data center staff receives validation training! Also help your staff understand the end product that actually brings in the money that pays their salary. Give them a reason to take pride in the validation and compliance process.
32 Conclusions and Summary Validation need not be a burden. Incorporate it into daily operations! Results Functioning systems Supportable systems Repeatable performance Improved business processes Fewer audit findings!
33 References DeGrace, P. & Stahl, L. H. (1990). Wicked Problems, Righteous Solutions: A Catalogue of Modern Software Engineering Paradigms. Englewood Cliffs, NJ: Yourdon Press Computing Series. Pressman, R. S., (1993). A Manager s Guide to Software Engineering. New York: McGraw- Hill. The Validation Dictionary. Royal Palm Beach, FL: Institute of Validation Technology.
Prelims 13/3/06 9:11 pm Page iii CONTENTS List of Tables List of Figures ix xi 1 Introduction 1 1.1 The Need for Guidance on ERP System Validation 1 1.2 The Need to Validate ERP Systems 3 1.3 The ERP Implementation
Computer System Validation for Clinical Trials: Framework Standard Operating Procedure (F-SOP) Author: Tim Cross Version History: 0.1di DRAFT 24-April-2013 0.2 DRAFT 12-June-2013 Current Version: 1.0 17-June-2013
SLCM 2003.1 Artifacts in a Nutshell ( as of 01/21/2005) Project Development Phases Pension Benefit Guaranty Corporation s (PBGC) System Life Cycle Methodology (SLCM) is comprised of five project development
Page 1 of 7 Software Supplier Process Requirements 1.0 QUALITY SYSTEM FRAMEWORK 1.1 QUALITY POLICY The Seller shall document and implement a quality program in the form of Quality manual or detailed Quality
Table of Contents Validating Enterprise Systems: A Practical Guide Foreword 1 Introduction The Need for Guidance on Compliant Enterprise Systems What is an Enterprise System The Need to Validate Enterprise
Validating LIMS in a GMP Environment How To Page 1 Validating LIMS in a GMP Environment Support for sterile production of solutions & lyophilizates of peptide & protein hormones The Goal Improve Data Handling
Project Risk and Pre/Post Implementation Reviews Material Changes to the System of Internal Control VGFOA Conference (Virginia Beach, VA) May 20, 2015 Agenda/Objectives Understand why system implementations
IVTGXP_july06.qxd 6/28/06 1:09 PM Page 36 Computerized System Audits In A GCP Pharmaceutical Laboratory Environment By Maintaining data integrity for both clinical laboratory processes and patient data
Unit I Introduction Product Life Cycles Products also have life cycles The Systems Development Life Cycle (SDLC) is a framework for describing the phases involved in developing and maintaining information
Volume 2, Issue 12, December 2014 ISSN: 2321 7782 (Online) International Journal of Advance Research in Computer Science and Management Studies Research Article / Survey Paper / Case Study Available online
Best Practices for Validation of a Software as a Service (SaaS) Customer Relationship Management (CRM) Solution Presented By: Gregg Mauriello Validation Manager Elise Miner Associate Validation Manager
State of New Jersey DEPARTMENT OF THE TREASURY JON S. CORZINE DIVISION OF PURCHASE AND PROPERTY BRADLEY I. ABELOW Governor PURCHASE BUREAU State Treasurer P.O. BOX 230 TRENTON, NEW JERSEY 08625-0230 September
Overview of STS Consulting s IV&V Methodology STS uses a 5 Step Methodology for IV&V. Our risk-based methodology conforms to Best Practices, relevant international standards, and regulations/guidelines
SOP s for Managing Application Services Providers Ivan Soto Learning Objectives At the end of this session we will have covered: Types of Managed Services Outsourcing process Quality expectations for Managed
Project Name Equipment Process Line/Location Project Number Serial Number Model Number Protocol number WRITTEN BY: REVIEWED BY: Position APPROVAL TO EXECUTE: Position: PROTOCOL COMPLETION APPROVAL: Position:
Computer System Validation - It s More Than Just Testing Introduction Computer System Validation is the technical discipline that Life Science companies use to ensure that each Information Technology application
INL/EXT-09-17022 Rev. 2 Independent Verification and Validation of SAPHIRE 8 Software Project Plan March 2010 The INL is a U.S. Department of Energy National Laboratory operated by Battelle Energy Alliance
PHASE 6: DEVELOPMENT PHASE The Phase features a key step in the project: system construction. The previous phases lay the foundation for system development; the following phases ensure that the product
The SaaS LMS and Total Cost of Ownership in FDA-Regulated Companies The SaaS LMS and Total Cost of Ownership in FDA-Regulated Companies By Rob Sims, Director, Life Science, UL EduNeering When a Life Science
IT Product Life Cycle Management 43 Chapter 4 Configuration and Asset Management Configuration management is the process of monitoring and reviewing approved product configurations periodically while the
PHASE 9: OPERATIONS AND MAINTENANCE PHASE During the Operations and Maintenance Phase, the information system s availability and performance in executing the work for which it was designed is maintained.
CDC UNIFIED PROCESS JOB AID Independent Verification & Validation Activities Document Purpose This Job Aid is a brief document listing the items to be noted, checked, remembered, and delivered when completing
Curriculum Certified Software Tester (CST) Common Body of Knowledge Control Procedures Problem Resolution Reports Requirements Test Builds Test Cases Test Execution Test Plans Test Planning Testing Concepts
WHITE PAPER Analyst Software Validation Service Considerations When Validating Your Analyst Software Per GAMP 5 Blair C. James, Stacy D. Nelson Introduction The purpose of this white paper is to assist
Table of Contents Maintaining the Validated State in Computer Systems Orlando Lopez Use Automated Testing Tools? Janis V. Olson Considerations for Validation of Manufacturing Execution Systems Chris Wubbolt
PHASE 5: DESIGN PHASE During the Design Phase, the system is designed to satisfy the requirements identified in the previous phases. The requirements identified in the Requirements Analysis Phase are transformed
Attachment 7 Requirements Traceability Matrix (RTM) ATMS RFP New York State Department of Transportation Advanced Traffic Management System i 1. INTRODUCTION This Requirements Traceability Matrix (RTM)
STS Federal Government Consulting Practice IV&V Offering WBE Certified GSA Contract GS-35F-0108T For information Please contact: email@example.com 2007 by STS, Inc. Outline Background on STS What is IV&V?
Chapter j 38 Self Assessment 729 QUALITY MANAGEMENT SYSTEM REQUIREMENTS General Requirements 1. Establishing and implementing a documented quality management system 2. Implementing a documented quality
g GE Power & Water ISO 9001:2008 Audit Checklist Organization Auditor Date Page 1 Std. 4.1 General s a. Are processes identified b. Sequence & interaction of processes determined? c. Criteria for operation
September 2, 2003 Risk-Based Validation of Computer Systems Used In FDA-Regulated Activities Purpose This document provides a summary of the requirements relating to use of computer-based systems in activities
U. S. Department of Energy Consolidated Audit Program Checklist 5 Laboratory Information Management Systems Electronic Data Management Revision 4.0 February 2014 Use of this DOECAP checklist is authorized
Acquire or develop application systems software Controls provide reasonable assurance that application and system software is acquired or developed that effectively supports financial reporting requirements.
J * Edition Practical Guide to CLINICAL DATA MANAGEMENT Susanne Prokscha (g) CRC Press Taylor Francis Croup London York CRC Press is an imprint of the Taylor Francis Croup, an buslness Preface Introduction
Software Engineering Introduction & Background Department of Computer Science Kent State University Complaints Software production is often done by amateurs Software development is done by tinkering or
The software process Software Development Methods Bayu Adhi Tama, ST., MTI. firstname.lastname@example.org A structured set of activities required to develop a software system Specification; Design; Validation; Evolution.
Certified Information Systems Auditor (CISA ) Certification Course Description Our 5-day ISACA Certified Information Systems Auditor (CISA) training course equips information professionals with the knowledge
QM-1 SUPPLEMENT QUALITY MANAGEMENT SYSTEMS MANUAL Revision 6 Page: 1 of 6 APPROVED BY: TITLE DATE Electronic Signature on file Quality Director 10/3/15 D. Picciotti Page: 2 of 6 DOCUMENT REVISION HISTORY
A Systems Implementation Project Planning Guide Solutions & Project Management Services for Systems & Operations Projects Business Requirements Analysis Overview Project Plan High-Level Detailed Design
Montana Department of Transportation Information Services Division System Development Life Cycle (SDLC) Guide Version 2 August 2, 2007 \mdt_sdlc_process\mdt_sdlc_v02.doc Table of Contents 1 Business Analysis...3
Software Processes Objectives To introduce software process models To describe three generic process models and when they may be used To describe outline process models for requirements engineering, software
Pharma CloudAdoption and Qualification Trends OurCloudExperience Numerous implementations of EDMS systems with external hosting for smaller life science clients Development of qualification strategy for
TITOLO SLIDE Testo Slide Testo Slide Testo Slide Clinical database/ecrf validation: effective processes and procedures IV BIAS ANNUAL CONGRESS Padova September, 26 th 2012 PQE WORKSHOP: What's new in Computerized
Welcome Computer System Validation Training Delivered to FDA ISPE Boston Area Chapter February 20, 2014 1 Background Training Conducted on April 24, 2012 Food & Drug Administration Division of Manufacturing
University of Dublin Trinity College ST3006 - Software Engineering Anthony Harrington Department of Computer Science Trinity College Dublin Anthony.Harrington@cs.tcd.ie Lifecycles A software project goes
ISO 9001:2008 Page: 1 of 22 Central Technologies has developed a Quality Management System, and the associated procedures and work instructions, to be compliant to ISO 9001:2008. Utilizing this Quality
SDLC- Key Areas to Audit in IT Projects ISACA Geek Week 2013 8/21/2013 1 Introductions and Projects Overview Presenters Charlie Miller and Andrew Gerndt The Coca-Cola Company Principal IT Auditors Atlanta,
RTP s NUCLEAR QUALITY ASSURANCE PROGRAM RTP operates under one quality program, whether you purchase products that are commercial grade, nuclear safety-related or industrial safety compliant (IEC 61508).
L E C T U R E 9 Quality management systems LECTURE 9 - OVERVIEW Quality management system based on ISO 9000 WHAT IS QMS (QUALITY MANAGEMENT SYSTEM) Goal: Meet customer needs Quality management system includes
ISO 9001:2000 Gap Analysis Checklist Type: Assessor: ISO 9001 REQUIREMENTS STATUS ACTION/COMMENTS 4 Quality Management System 4.1 General Requirements Processes needed for the quality management system
Page 1 of 8 TITLE: Control of Software WARNING This document is the property of United Technologies Corporation (UTC). You may not possess, use, copy or disclose this document or any information in it,
How to Survive an FDA Computer Validation Audit The Myth Within the pharmaceutical, biotech, and medical device industry there is much fear and concern over approaching FDA audits. The FDA strikes fear
Corporate Quality Manual Preface The following Corporate Quality Manual is written within the framework of ISO 9001:2008 Quality System by the employees of CyberOptics. CyberOptics recognizes the importance
QUALITY MANUAL Revision D Gujll'y Manual Introduction The purpose of this manual is to describe the Quality Assurance Program implemented by Camar Aircraft Products Co. (hereafter referred to as C.A.P.C.)
Overview of how to test a Business Continuity Plan Prepared by: Thomas Bronack Phone: (718) 591-5553 Email: email@example.com BRP/DRP Test Plan Creation and Exercise Page: 1 Table of Contents BCP/DRP Test
Colorado Department of Health Care Policy and Financing Solicitation #: HCPFRFPCW14BIDM Business Intelligence and Data Management Services (BIDM) Appendix B BIDM Project Phases Tables The guidelines for
Software Processes Objectives To introduce software process models To describe three generic process models and when they may be used To describe outline process models for requirements engineering, software
DIVISION OF AUDIT SERVICES Internal Control Deliverables For System Development Projects Table of Contents Introduction... 3 Process Flow... 3 Controls Objectives... 4 Environmental and General IT Controls...
GxP Process Management Software : Software Automation Trends in the Medical Device Industry Introduction The development and manufacturing of a medical device is an increasingly difficult endeavor as competition
Validated SaaS LMS SuccessFactors Viability Executive Summary SuccessFactors has a long history of working with validated organizations and has brought this expertise to their validated SaaS LMS package.
AGENDA ITEM C3 DATE: April 7, 2014 TO: FROM: SUBJECT: Matt Jordan, General Manager Charles H. Carden, Chief Operating Officer Computerized Maintenance Management System Implementation Services Award Contract
What is a life cycle model? Framework under which a software product is going to be developed. Defines the phases that the product under development will go through. Identifies activities involved in each
Section 4 Bidder's Products, Methodology, and Approach to the Project 4.1 FACTS II Requirements Summary 4.11 Interfaces 4.2 Functional Requirements 4.12 System Development 4.3 Technical Requirements 4.13
The Infrastructure Audit Trail and Part 11 Pamela Campbell Senior Consultant, Validation DataCeutics, Inc. firstname.lastname@example.org February 28, 2003 DataCeutics, Inc. 2003 Why am I Qualified to Make this
Powerful information management services and software for the oil, gas, and chemical industries RELIEF SYSTEM SERVICES Provenance Consulting has relief system design experience in all aspects of the petrochemical
Preparing for an FDA Pre-Approval Inspection (PAI) Jorge Torres CMQ/OE, CQE, CQA July, 2007 1 Agenda Introduction Understanding the PAI Experience: What to Expect Inspection Management Plan Preparing for
Master Data Management Decisions Made by the Data Governance Organization A Whitepaper by First San Francisco Partners Master Data Management Decisions Made by the Data Governance Organization Master data
Kern Health System CORE RFP Responses to Questions/Request for Explanation Kern Health Systems (KHS) has prepared the following responses to questions received regarding the CORE Request for Proposal (RFP).
Pharma IT journall The dedicated publication for those working with Computerised Systems, Processes and Software in the Pharmaceutical, Biotechnology, Medical Device, Clinical Research and Supporting Industries
International GMP Requirements for Quality Control Laboratories and Recomendations for Implementation Ludwig Huber, Ph.D. email@example.com Overview GMP requirements for Quality Control laboratories
www.softwaretestinghelp.com Test Plan (a Real Sample) SoftwareTestingHelp.com Live Project Training - OrangeHRM 2/1/2014 SoftwareTestingHelp.com Name of the tester Note: This is a sample test plan created
Understand the business analyst's role and responsibilities in a successful project. In this introductory course, you'll delve into the role and responsibilities of the business analyst (BA)- the communication
The Software Life Cycle CSE 308: Software Engineering 1 Life Cycle Models A software life cycle model represents all of the activities and work products necessary to develop a software system Life cycle
Software Development Process Models Balasankar C S1 M.Tech CSE 1 / 24 Software Development Process Models Activities directly related production design, coding, testing Specifies major development & quality
SYSTEM DEVELOPMENT AND THE WATERFALL MODEL What is a System? (Ch. 18) A system is a set of integrated components interacting with each other to serve a common purpose. A computer-based system is a system
Appendix 2-A. Application and System Development Requirements Introduction AHRQ has set up a Distributed Systems Engineering Lab (DSEL) to support all internal development efforts and provide a facility
TL 9000 and TS16949 Comparison www.questforum.org Copyright QuEST Forum 2007 1 Purpose This summary is intended to give those familiar with TS16949 requirements a general sense of the additional requirements
BellHawk Compliance with CFR 21 Part 11 Introduction This document details the compliance of the BellHawk software with CFR 21 Part 11 (Part 11) dated March 20, 1997 and the document General Principles
PHASE 3: PLANNING PHASE The ning Phase focuses principally on required project planning work. Proper comprehensive project planning is essential to a successful IT project, and incomplete project planning
Using SharePoint 2013 for Managing Regulated Content in the Life Sciences Presented by Paul Fenton President and CEO, Montrium Overview Informative Webinar that aims to provide an overview of how SharePoint
PHASE 3: PLANNING PHASE The Planning Phase focuses principally on required project planning work. Proper comprehensive project planning is essential to a successful IT project, and incomplete project planning
Introduction to Software Project Management CITS3220 Software Requirements & Project Management "A project gets a year late one day at a time." "Anything that can be changed will be changed until there