Review & AI Lessons learned while using Artificial Intelligence April 2013

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence April 2013"

Transcription

1 Review & AI Lessons learned while using Artificial Intelligence

2 Why are non-users staying away from PC? source: edj Group s Q Predictive Coding Survey, February 2013, N = 66 Slide 2

3 Introduction Relative costs of producing electronic documents Collection 8% Internal 4% Processing 19% Vendors 26% Review 73% Outside counsel 70% Source: Where the money goes: understanding litigant expenditures for producing electronic discovery / Nicholas M. Pace, Laura Zakaras. Slide 3

4 Review methodologies Sophistication & efficiency of approach Boolean searching Pattern matching Clustering (un-supervised machine learning) Categorisation (supervised machine learning) Basic keyword search Data volumes Slide 4

5 Review methodologies Clustering Slide 5

6 Judicially approved Da Silva Moore v. Publicis Groupe, et al. (February 2012) Don t worry about being the guinea pig Computer-assisted review now can be considered judicially-approved for use in appropriate cases. Work smarter Computer-assisted review appears to be better than the available alternatives, and thus should be used in appropriate cases. Go Faster Computer-assisted review should be seriously considered for use in large-data-volume cases where it may save the producing party (or both parties) significant amounts of legal fees in document review. Slide 6

7 Judicially approved Da Silva Moore v. Publicis Groupe, et al. (February 2012) Don t focus on the black box The idea is not to make [computer-assisted review] perfect, it s not going to be perfect. I may be less interested in the science behind the black box of the vendor s software than in whether it produced responsive documents. Proof of a valid process, including quality control testing, also will be important. Slide 7

8 Computer assisted review Categorisation example Slide 8

9 Computer assisted review Categorisation example Slide 9

10 Computer assisted review Categorisation example Slide 10

11 Computer assisted review Categorisation example Slide 11

12 Computer assisted review Components of assisted review systems Domain expert Analytics engine Statistical validation Slide 12

13 Workflow Document universe Validate results Train the computer Manually review categorised documents Categorise document universe Slide 13

14 Workflow How do we address the following concerns : How are the results? Training of the computer Do we need to continue training? Is the expert training the system well? Are the training docs representative? How many documents will we need for training? Review of documents Which documents should be submitted for review? How do we verify the results? Slide 14

15 Computer assisted review Categorisation example False Negative True Positive False Positive True Negative Slide 15

16 Workflow How are the results? Accuracy Recall Precision F-measure Slide 16

17 Workflow How are the results? Accuracy Recall Precision F-measure Review result The truth Relevant Not Relevant Total Categorisation result Relevant Not Relevant Total Slide 17

18 Workflow How are the results? Accuracy = 99% Recall = 0% Precision F-measure Review result The truth Relevant Not Relevant Total Categorisation result Relevant Not Relevant Total Slide 18

19 Workflow How are the results? Accuracy Recall Precision F-measure Review result The truth Relevant Not Relevant Total Categorisation result Relevant Not Relevant Total Slide 19

20 Workflow How are the results? Accuracy = 93% Recall = 20% Precision = 25% F-measure Review result The truth Relevant Not Relevant Total Categorisation result Relevant Not Relevant Total Slide 20

21 Workflow How are the results? Accuracy Recall Precision F-measure: Calculated as the harmonic mean of recall and precision F = 2(P*R)/(P+R) Slide 21

22 Workflow Document universe Validate results Train the computer Manually review categorised documents Categorise document universe Slide 22

23 Workflow How do we address the following concerns : How are the results? Training of the computer Do we need to continue training? Is the expert training the system well? Are the training docs representative? How many documents will we need for training? Review of documents Which documents should be submitted for review? How do we verify the results? Slide 23

24 Workflow Train the computer Do we need to continue training? Intuition? Objective training optimisation criterion Slide 24

25 Workflow Manually review categorised documents Which docs should be reviewed? Slide 25

26 Workflow Manually review categorised documents Which docs should be reviewed? Slide 26

27 Workflow Manually review categorised documents How do we verify the results? Quality assurance provides transparent verification of the generated results and is a key component of the computer assisted review process. Quality assurance: A random sample of the not review docs Size of sample based on level of statistical confidence Review of sample set by attorney Calculation of recall and precision within not review docs Attorney can confirm or modify cut off point Slide 27

28 Workflow Document universe Validate results Train the computer Manually review categorised documents Categorise document universe Slide 28

29 Real life examples Large Second Request Chose not to review 1.3m docs based on 95% confidence level It took only 4 rounds of human review to stabilize at a 95% confidence level Stats were also used to evaluate human review; categorization was found to be 4x s as accurate as the human review team Bankruptcy Case 2m docs categorized after review of 1,500 docs Slide 29

30 Real life examples Civil Litigation 200k docs reviewed and produced in 2 days Corruption Investigation Used on a subset of ~53k docs 97% of the docs were coded after review of the first sample, which was ~3% of the population After the first sample, humans agreed with categorization 87% of the time 91% of the overturned documents were exact dupes or 90% similar Slide 30

31 Creating relationships that create value All rights reserved. Not for further distribution without the permission of. "" refers to the network of member firms of PricewaterhouseCoopers International Limited (IL), or, as the context requires, individual member firms of the network. Each member firm is a separate legal entity and does not act as agent of IL or any other member firm. IL does not provide any services to clients. IL is not responsible or liable for the acts or omissions of any of its member firms nor can it control the exercise of their professional judgment or bind them in any way. No member firm is responsible or liable for the acts or omissions of any other member firm nor can it control the exercise of another member firm's professional judgment or bind another member firm or IL in any way.

ESI and Predictive Coding

ESI and Predictive Coding Beijing Boston Brussels Chicago Frankfurt Hong Kong ESI and Predictive Coding Houston London Los Angeles Moscow Munich New York Palo Alto Paris São Paulo Charles W. Schwartz Chris Wycliff December 13,

More information

The Evolution, Uses, and Case Studies of Technology Assisted Review

The Evolution, Uses, and Case Studies of Technology Assisted Review FEBRUARY 4 6, 2014 / THE HILTON NEW YORK The Evolution, Uses, and Case Studies of Technology Assisted Review One Size Does Not Fit All #LTNY Meet Our Panelists The Honorable Dave Waxse U.S. Magistrate

More information

Predictive Coding Defensibility

Predictive Coding Defensibility Predictive Coding Defensibility Who should read this paper The Veritas ediscovery Platform facilitates a quality control workflow that incorporates statistically sound sampling practices developed in conjunction

More information

Judge Peck Provides a Primer on Computer-Assisted Review By John Tredennick

Judge Peck Provides a Primer on Computer-Assisted Review By John Tredennick By John Tredennick CEO Catalyst Repository Systems Magistrate Judge Andrew J. Peck issued a landmark decision in Da Silva Moore v. Publicis and MSL Group, filed on Feb. 24, 2012. This decision made headlines

More information

Three Methods for ediscovery Document Prioritization:

Three Methods for ediscovery Document Prioritization: Three Methods for ediscovery Document Prioritization: Comparing and Contrasting Keyword Search with Concept Based and Support Vector Based "Technology Assisted Review-Predictive Coding" Platforms Tom Groom,

More information

REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - PRIORITIZATION FOR 100% REVIEW. Bill Tolson Sr. Product Marketing Manager Recommind Inc.

REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - PRIORITIZATION FOR 100% REVIEW. Bill Tolson Sr. Product Marketing Manager Recommind Inc. REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - Bill Tolson Sr. Product Marketing Manager Recommind Inc. Introduction... 3 Traditional Linear Review... 3 Advanced Review Strategies: A Typical Predictive

More information

e.law Relativity Analytics Webinar "e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation.

e.law Relativity Analytics Webinar e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation. e.law Relativity Analytics Webinar "e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation. e.law Overview Founded in 1999, 15 year anniversary this year

More information

Recent Developments in the Law & Technology Relating to Predictive Coding

Recent Developments in the Law & Technology Relating to Predictive Coding Recent Developments in the Law & Technology Relating to Predictive Coding Presented by Paul Neale CEO Presented by Gene Klimov VP & Managing Director Presented by Gerard Britton Managing Director 2012

More information

The United States Law Week

The United States Law Week The United States Law Week Source: U.S. Law Week: News Archive > 2012 > 04/24/2012 > BNA Insights > Under Fire: A Closer Look at Technology- Assisted Document Review E-DISCOVERY Under Fire: A Closer Look

More information

Making The Most Of Document Analytics

Making The Most Of Document Analytics Portfolio Media. Inc. 860 Broadway, 6th Floor New York, NY 10003 www.law360.com Phone: +1 646 783 7100 Fax: +1 646 783 7161 customerservice@law360.com Making The Most Of Document Analytics Law360, New

More information

Predictive Coding, TAR, CAR NOT Just for Litigation

Predictive Coding, TAR, CAR NOT Just for Litigation Predictive Coding, TAR, CAR NOT Just for Litigation February 26, 2015 Olivia Gerroll VP Professional Services, D4 Agenda Drivers The Evolution of Discovery Technology Definitions & Benefits How Predictive

More information

MANAGING BIG DATA IN LITIGATION

MANAGING BIG DATA IN LITIGATION David Han 2015 MANAGING BIG DATA IN LITIGATION DAVID HAN Associate, Morgan Lewis & Bockius, edata Practice Group MANAGING BIG DATA Data volumes always increasing New data sources Mobile Internet of Things

More information

Mastering Predictive Coding: The Ultimate Guide

Mastering Predictive Coding: The Ultimate Guide Mastering Predictive Coding: The Ultimate Guide Key considerations and best practices to help you increase ediscovery efficiencies and save money with predictive coding 4.5 Validating the Results and Producing

More information

Technology Assisted Review of Documents

Technology Assisted Review of Documents Ashish Prasad, Esq. Noah Miller, Esq. Joshua C. Garbarino, Esq. October 27, 2014 Table of Contents Introduction... 3 What is TAR?... 3 TAR Workflows and Roles... 3 Predictive Coding Workflows... 4 Conclusion...

More information

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive coding is one of the most promising technologies to reduce the high cost of review by

More information

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow WHITE PAPER: PREDICTIVE CODING DEFENSIBILITY........................................ Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive

More information

Software-assisted document review: An ROI your GC can appreciate. kpmg.com

Software-assisted document review: An ROI your GC can appreciate. kpmg.com Software-assisted document review: An ROI your GC can appreciate kpmg.com b Section or Brochure name Contents Introduction 4 Approach 6 Metrics to compare quality and effectiveness 7 Results 8 Matter 1

More information

E-Discovery in Mass Torts:

E-Discovery in Mass Torts: E-Discovery in Mass Torts: Predictive Coding Friend or Foe? Sherry A. Knutson Sidley Austin One S Dearborn St 32nd Fl Chicago, IL 60603 (312) 853-4710 sknutson@sidley.com Sherry A. Knutson is a partner

More information

2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500

2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500 2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500 5218 South East Street, Suite E-3, Indianapolis, IN 46227 Tel 317.247.4400 Fax 317.247.0044 Presented by Providing

More information

Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process

Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process By Joe Utsler, BlueStar Case Solutions Technology Assisted Review (TAR) has become accepted widely in the world

More information

Pros And Cons Of Computer-Assisted Review

Pros And Cons Of Computer-Assisted Review Portfolio Media. Inc. 860 Broadway, 6th Floor New York, NY 10003 www.law360.com Phone: +1 646 783 7100 Fax: +1 646 783 7161 customerservice@law360.com Pros And Cons Of Computer-Assisted Review Law360,

More information

E-discovery Taking Predictive Coding Out of the Black Box

E-discovery Taking Predictive Coding Out of the Black Box E-discovery Taking Predictive Coding Out of the Black Box Joseph H. Looby Senior Managing Director FTI TECHNOLOGY IN CASES OF COMMERCIAL LITIGATION, the process of discovery can place a huge burden on

More information

Predictive Coding: Understanding the Wows & Weaknesses

Predictive Coding: Understanding the Wows & Weaknesses Predictive Coding: Understanding the Wows & Weaknesses Bryan Callahan, CPA, CFF, CFE, CVA Managing Consultant Forensics & Valuation Services bcallahan@bkd.com Lanny Morrow, EnCE Supervising Consultant

More information

Predictive Coding Helps Companies Reduce Discovery Costs

Predictive Coding Helps Companies Reduce Discovery Costs Predictive Coding Helps Companies Reduce Discovery Costs Recent Court Decisions Open Door to Wider Use by Businesses to Cut Costs in Document Discovery By John Tredennick As companies struggle to manage

More information

One Decision Document Review Accelerator. Orange Legal Technologies. OrangeLT.com Info@OrangeLT.com

One Decision Document Review Accelerator. Orange Legal Technologies. OrangeLT.com Info@OrangeLT.com One Decision Document Review Accelerator Orange Legal Technologies OrangeLT.com Info@OrangeLT.com By the Numbers: The Need for Technology in Attorney Review Seventy. Integrated near- duplicate detection

More information

The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review

The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review ediscovery & Information Management White Paper The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review Scott M. Cohen Elizabeth T. Timkovich John J. Rosenthal February 2014 2014 Winston

More information

The Case for Technology Assisted Review and Statistical Sampling in Discovery

The Case for Technology Assisted Review and Statistical Sampling in Discovery The Case for Technology Assisted Review and Statistical Sampling in Discovery Position Paper for DESI VI Workshop, June 8, 2015, ICAIL Conference, San Diego, CA Christopher H Paskach The Claro Group, LLC

More information

Social Media Mining. Data Mining Essentials

Social Media Mining. Data Mining Essentials Introduction Data production rate has been increased dramatically (Big Data) and we are able store much more data than before E.g., purchase data, social media data, mobile phone data Businesses and customers

More information

Predictive Coding: A Primer

Predictive Coding: A Primer MEALEY S TM LITIGATION REPORT Discovery Predictive Coding: A Primer by Amy Jane Longo, Esq. and Usama Kahf, Esq. O Melveny & Myers LLP Los Angeles, California A commentary article reprinted from the March

More information

Comprehending the Challenges of Technology Assisted Document Review

Comprehending the Challenges of Technology Assisted Document Review Comprehending the Challenges of Technology Assisted Document Review Predictive Coding in Multi-Language E-Discovery 3 Lagoon Dr., Ste.180, Redwood UBIC North City, America, CA 94065 Inc. +1-650-654-7664

More information

Predictive Coding in Multi-Language E-Discovery

Predictive Coding in Multi-Language E-Discovery Comprehending the Challenges of Technology Assisted Document Review Predictive Coding in Multi-Language E-Discovery UBIC North America, Inc. 3 Lagoon Dr., Ste. 180, Redwood City, CA 94065 877-321-8242

More information

Litigation Solutions insightful interactive culling distributed ediscovery processing powering digital review

Litigation Solutions insightful interactive culling distributed ediscovery processing powering digital review Litigation Solutions i n s i g h t f u l i n t e r a c t i ve c u l l i n g d i s t r i b u t e d e d i s cove r y p ro ce s s i n g p owe r i n g d i g i t a l re v i e w Advanced Analytical Review Data

More information

How Good is Your Predictive Coding Poker Face?

How Good is Your Predictive Coding Poker Face? How Good is Your Predictive Coding Poker Face? SESSION ID: LAW-W03 Moderator: Panelists: Matthew Nelson ediscovery Counsel Symantec Corporation Hon. Andrew J. Peck US Magistrate Judge Southern District

More information

Navigating E-Discovery, And The

Navigating E-Discovery, And The Navigating E-Discovery, And The l f C S Role of ACEDS 1 IDF Conference December 2012 Overview Introduction to US E-Discovery Important E-Discovery Trends Role of ACEDS Mission of ACEDS in Japan 2 E-Discovery

More information

A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012

A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012 A Practitioner s Guide to Statistical Sampling in E-Discovery October 16, 2012 1 Meet the Panelists Maura R. Grossman, Counsel at Wachtell, Lipton, Rosen & Katz Gordon V. Cormack, Professor at the David

More information

Quality Control for predictive coding in ediscovery. kpmg.com

Quality Control for predictive coding in ediscovery. kpmg.com Quality Control for predictive coding in ediscovery kpmg.com Advances in technology are changing the way organizations perform ediscovery. Most notably, predictive coding, or technology assisted review,

More information

Document Review Costs

Document Review Costs Predictive Coding Gain Earlier Insight and Reduce Document Review Costs Tom Groom Vice President, Discovery Engineering tgroom@d4discovery.com 303.840.3601 D4 LLC Litigation support service provider since

More information

Background. The team. National Institute for Standards and Technology (NIST)

Background. The team. National Institute for Standards and Technology (NIST) This paper presents the results of the collaborative entry of Backstop LLP and Cleary Gottlieb Steen & Hamilton LLP in the Legal Track of the 2009 Text Retrieval Conference (TREC) sponsored by the National

More information

Christina Wojcik, VP Legal Services, Seal Software Steven Toole, VP Marketing, Content Analyst Company Jason Voss, Senior Product Manager, TCDi

Christina Wojcik, VP Legal Services, Seal Software Steven Toole, VP Marketing, Content Analyst Company Jason Voss, Senior Product Manager, TCDi FEBRUARY 3 5, 2015 / THE HILTON NEW YORK ML1: Machine Learning Powered Rapid Insight into Big Content: Discovery from Contracts to Patents to Litigation Panelists Christina Wojcik, VP Legal Services, Seal

More information

The Truth About Predictive Coding: Getting Beyond The Hype

The Truth About Predictive Coding: Getting Beyond The Hype www.encase.com/ceic The Truth About Predictive Coding: Getting Beyond The Hype David R. Cohen Reed Smith LLP Records & E-Discovery Practice Group Leader David leads a group of more than 100 lawyers in

More information

ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING

ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING Predictive Coding SUBMITTED IN SUPPORT OF THE PANEL DISCUSSION INTRODUCTION Technology has created a problem.

More information

Viewpoint ediscovery Services

Viewpoint ediscovery Services Xerox Legal Services Viewpoint ediscovery Platform Technical Brief Viewpoint ediscovery Services Viewpoint by Xerox delivers a flexible approach to ediscovery designed to help you manage your litigation,

More information

Far From the Black Box: Explaining Equivio Relevance to Lawyers. White Paper by Chris Dale of the e-disclosure Information Project

Far From the Black Box: Explaining Equivio Relevance to Lawyers. White Paper by Chris Dale of the e-disclosure Information Project Far From the Black Box: Explaining Equivio Relevance to Lawyers White Paper by Chris Dale of the e-disclosure Information Project This paper is written by Chris Dale of the UK-based edisclosure Information

More information

Using Artificial Intelligence to Manage Big Data for Litigation

Using Artificial Intelligence to Manage Big Data for Litigation FEBRUARY 3 5, 2015 / THE HILTON NEW YORK Using Artificial Intelligence to Manage Big Data for Litigation Understanding Artificial Intelligence to Make better decisions Improve the process Allay the fear

More information

PICTERA. What Is Intell1gent One? Created by the clients, for the clients SOLUTIONS

PICTERA. What Is Intell1gent One? Created by the clients, for the clients SOLUTIONS PICTERA SOLUTIONS An What Is Intell1gent One? Created by the clients, for the clients This white paper discusses: Understanding How Intell1gent One Saves Time and Money Using Intell1gent One to Save Money

More information

Predictive Coding and The Return on Investment (ROI) of Advanced Review Strategies in ediscovery

Predictive Coding and The Return on Investment (ROI) of Advanced Review Strategies in ediscovery Predictive Coding and The Return on Investment (ROI) of Advanced Review Strategies in ediscovery Drew Lewis ediscovery Counsel AGENDA A Predictive Coding Primer Predictive Coding and Market Trends Predictive

More information

In this presentation, you will be introduced to data mining and the relationship with meaningful use.

In this presentation, you will be introduced to data mining and the relationship with meaningful use. In this presentation, you will be introduced to data mining and the relationship with meaningful use. Data mining refers to the art and science of intelligent data analysis. It is the application of machine

More information

Using Visual Analytics in E-Discovery and E-Disclosure Cases

Using Visual Analytics in E-Discovery and E-Disclosure Cases Using Visual Analytics in E-Discovery and E-Disclosure Cases VASS 2012: Second UKVAC International Visual Analytics Summer School Middlesex University London, U.K. September 3, 2012 Jason R. Baron Director

More information

Top 10 Best Practices in Predictive Coding

Top 10 Best Practices in Predictive Coding Top 10 Best Practices in Predictive Coding Emerging Best Practice Guidelines for the Conduct of a Predictive Coding Project Equivio internal document " design an appropriate process, including use of available

More information

ACEDS Membership Benefits Training, Resources and Networking for the E-Discovery Community

ACEDS Membership Benefits Training, Resources and Networking for the E-Discovery Community ACEDS Membership Benefits Training, Resources and Networking for the E-Discovery Community! Exclusive News and Analysis! Weekly Web Seminars! Podcasts! On- Demand Training! Networking! Resources! Jobs

More information

Cost of Poor Quality:

Cost of Poor Quality: Cost of Poor Quality: Analysis for IT Service Management Software Software Concurrent Session: ISE 09 Wed. May 23, 8:00 AM 9:00 AM Presenter: Daniel Zrymiak Key Points: Use the Cost of Poor Quality: Failure

More information

Making reviews more consistent and efficient.

Making reviews more consistent and efficient. Making reviews more consistent and efficient. PREDICTIVE CODING AND ADVANCED ANALYTICS Predictive coding although yet to take hold with the enthusiasm initially anticipated is still considered by many

More information

Technology- Assisted Review 2.0

Technology- Assisted Review 2.0 LITIGATION AND PRACTICE SUPPORT Technology- Assisted Review 2.0 by Ignatius Grande of Hughes Hubbard & Reed LLP and Andrew Paredes of Epiq Systems Legal teams and their outside counsel must deal with an

More information

Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc.

Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc. Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc. Is there general agreement about what predictive coding is? No. Is there general agreement

More information

E-Discovery Tip Sheet

E-Discovery Tip Sheet E-Discovery Tip Sheet LegalTech 2015 Some Panels and Briefings Last month I took you on a select tour of the vendor exhibits and products from LegalTech 2015. This month I want to provide a small brief

More information

Simplifying Cost Savings in E-Discovery PROVEN, EFFECTIVE STRATEGIES FOR RESOURCE ALLOCATION IN DOCUMENT REVIEW

Simplifying Cost Savings in E-Discovery PROVEN, EFFECTIVE STRATEGIES FOR RESOURCE ALLOCATION IN DOCUMENT REVIEW Simplifying Cost Savings in E-Discovery PROVEN, EFFECTIVE STRATEGIES FOR RESOURCE ALLOCATION IN DOCUMENT REVIEW Simplifying Cost Savings in E-Discovery PROVEN, EFFECTIVE STRATEGIES FOR RESOURCE ALLOCATION

More information

USING SECURITY METRICS TO ASSESS RISK MANAGEMENT CAPABILITIES

USING SECURITY METRICS TO ASSESS RISK MANAGEMENT CAPABILITIES Christina Kormos National Agency Phone: (410)854-6094 Fax: (410)854-4661 ckormos@radium.ncsc.mil Lisa A. Gallagher (POC) Arca Systems, Inc. Phone: (410)309-1780 Fax: (410)309-1781 gallagher@arca.com USING

More information

For Your ediscovery... Software

For Your ediscovery... Software For Your ediscovery... Software is not enough Leading Provider of Investigatory and Litigation Support Services for Corporations, Government Agencies and Am Law Firms Worldwide Our People Make the Difference

More information

CASE STUDY: Top 5 Communications Company Evaluates Leading ediscovery Solutions

CASE STUDY: Top 5 Communications Company Evaluates Leading ediscovery Solutions AccessData Group CASE STUDY: Top 5 Communications Company Evaluates Leading ediscovery Solutions White Paper "#$%&'()'*+&*+, Overview... 1 Top 5 Communications Company: Background and Its ediscovery Requirements...

More information

Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division. Tracy Greer 1 Senior Litigation Counsel E-Discovery

Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division. Tracy Greer 1 Senior Litigation Counsel E-Discovery Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division Tracy Greer 1 Senior Litigation Counsel E-Discovery The Division has moved to implement several discovery initiatives

More information

EXECUTIVE BRIEF SPON. Third-Party Archiving Solutions Are Still Needed in Exchange 2010 Environments. Published March 2012

EXECUTIVE BRIEF SPON. Third-Party Archiving Solutions Are Still Needed in Exchange 2010 Environments. Published March 2012 EXECUTIVE BRIEF Third-Party Archiving Solutions Are Still Needed in Exchange 2010 Environments An Osterman Research Executive Brief sponsored by Published March 2012 SPON sponsored by Osterman Research,

More information

Detection. Perspective. Network Anomaly. Bhattacharyya. Jugal. A Machine Learning »C) Dhruba Kumar. Kumar KaKta. CRC Press J Taylor & Francis Croup

Detection. Perspective. Network Anomaly. Bhattacharyya. Jugal. A Machine Learning »C) Dhruba Kumar. Kumar KaKta. CRC Press J Taylor & Francis Croup Network Anomaly Detection A Machine Learning Perspective Dhruba Kumar Bhattacharyya Jugal Kumar KaKta»C) CRC Press J Taylor & Francis Croup Boca Raton London New York CRC Press is an imprint of the Taylor

More information

Litigation Solutions. insightful interactive culling. distributed ediscovery processing. powering digital review

Litigation Solutions. insightful interactive culling. distributed ediscovery processing. powering digital review Litigation Solutions insightful interactive culling distributed ediscovery processing powering digital review TECHNOLOGY ASSISTED REVIEW Eclipse combines advanced analytic technology with machine learning

More information

How a District should respond to Bank and Mechanics Lien Foreclosures and Bankruptcy Filings

How a District should respond to Bank and Mechanics Lien Foreclosures and Bankruptcy Filings DISCLAIMER This presentation is intended to provide information about the law and is designed to help Board members of Colorado Special Districts gain a general understanding of relevant legal issues.

More information

DMDSS: Data Mining Based Decision Support System to Integrate Data Mining and Decision Support

DMDSS: Data Mining Based Decision Support System to Integrate Data Mining and Decision Support DMDSS: Data Mining Based Decision Support System to Integrate Data Mining and Decision Support Rok Rupnik, Matjaž Kukar, Marko Bajec, Marjan Krisper University of Ljubljana, Faculty of Computer and Information

More information

www.njppsa.org Response to Expansion of Legal Service MDE New Jersey Professional Process Servers Association (NJPPSA) October 29, 2015

www.njppsa.org Response to Expansion of Legal Service MDE New Jersey Professional Process Servers Association (NJPPSA) October 29, 2015 Response to Expansion of Legal Service MDE New Jersey Professional Process Servers Association (NJPPSA) October 29, 2015 The New Jersey Professional Process Servers Association (NJPPSA), established in

More information

Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review

Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review ACEDS Webinar April 23, 2014 Sponsored by Robert Half Legal 1 2014 Robert Half Legal. An Equal Opportunity

More information

THE PREDICTIVE CODING CASES A CASE LAW REVIEW

THE PREDICTIVE CODING CASES A CASE LAW REVIEW THE PREDICTIVE CODING CASES A CASE LAW REVIEW WELCOME Thank you for joining Numerous diverse attendees Please feel free to submit questions Slides, recording and survey coming tomorrow SPEAKERS Matthew

More information

E-Discovery Roundtable: Buyers Perspectives on the Impact of Technology Innovation

E-Discovery Roundtable: Buyers Perspectives on the Impact of Technology Innovation E-Discovery Roundtable: Buyers Perspectives on the Impact of Technology Innovation TABLE OF CONTENTS Introduction... 3 IMPACT OF CLOUD COMPUTING... 3 Enforcing data management policies... 3 Protecting

More information

Portable. Harvester 4.0 has Arrived!! POWERFUL E-DISCOVERY COLLECTION SOFTWARE SEARCH AND COLLECT DISCOVERABLE DOCUMENTS AND EMAIL HARVESTER FEATURES

Portable. Harvester 4.0 has Arrived!! POWERFUL E-DISCOVERY COLLECTION SOFTWARE SEARCH AND COLLECT DISCOVERABLE DOCUMENTS AND EMAIL HARVESTER FEATURES Portable Defensible Automated E-Discovery Collection Harvester 4.0 has Arrived!! SEARCH AND COLLECT DISCOVERABLE DOCUMENTS AND EMAIL Incomplete and undocumented electronic discovery collections occur every

More information

Electronic data interchange and proactive services for customers using revenue cycle management solutions from the Centricity portfolio

Electronic data interchange and proactive services for customers using revenue cycle management solutions from the Centricity portfolio GE Healthcare Electronic data interchange and proactive services for customers using revenue cycle management solutions from the Centricity portfolio imagination at work Accelerate revenue cycle performance

More information

Cost-Effective and Defensible Technology Assisted Review

Cost-Effective and Defensible Technology Assisted Review WHITE PAPER: SYMANTEC TRANSPARENT PREDICTIVE CODING Symantec Transparent Predictive Coding Cost-Effective and Defensible Technology Assisted Review Who should read this paper Predictive coding is one of

More information

Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e

Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e Ba k e Offs, De m o s & Kicking t h e Ti r e s: A Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e Assessment So f t wa r e & Search & Review Tools Ronni D. Solomon, King

More information

forensics matters Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding

forensics matters Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding forensics Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding Publication No. 12-03 1Introduction Predictive Coding is the emerging tool

More information

The Cyber Threat Profiler

The Cyber Threat Profiler Whitepaper The Cyber Threat Profiler Good Intelligence is essential to efficient system protection INTRODUCTION As the world becomes more dependent on cyber connectivity, the volume of cyber attacks are

More information

PRESENTED BY: Sponsored by:

PRESENTED BY: Sponsored by: PRESENTED BY: Sponsored by: Practical Uses of Analytics in E-Discovery - A PRIMER Jenny Le, Esq. Vice President of Discovery Services jle@evolvediscovery.com E-Discovery & Ethics Structured, Conceptual,

More information

Machine Learning: Overview

Machine Learning: Overview Machine Learning: Overview Why Learning? Learning is a core of property of being intelligent. Hence Machine learning is a core subarea of Artificial Intelligence. There is a need for programs to behave

More information

Traditionally, the gold standard for identifying potentially

Traditionally, the gold standard for identifying potentially istockphoto.com/alexandercreative Predictive Coding: It s Here to Stay Predictive coding programs are poised to become a standard practice in e-discovery in the near future. As more courts weigh in on

More information

Measure Your Data and Achieve Information Governance Excellence

Measure Your Data and Achieve Information Governance Excellence SAP Brief SAP s for Enterprise Information Management SAP Information Steward Objectives Measure Your Data and Achieve Information Governance Excellence A single solution for managing enterprise data quality

More information

Driving Transformation with Less Budget The Value of SAP Enterprise Support

Driving Transformation with Less Budget The Value of SAP Enterprise Support SAP Active Global Support Driving Transformation with Less Budget The Value of SAP Enterprise Support For IT organizations everywhere, just keeping the lights on is no longer enough. IT needs to deliver

More information

Detect, Prevent, and Deter Fraud in Big Data Environments

Detect, Prevent, and Deter Fraud in Big Data Environments SAP Brief SAP s for Governance, Risk, and Compliance SAP Fraud Management Objectives Detect, Prevent, and Deter Fraud in Big Data Environments Detect and prevent fraud to reduce financial loss Detect and

More information

PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX?

PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? Vol. 46 No. 3 February 6, 2013 PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? The high costs of e-discovery have led to the development of computerized review technology by which the user may search

More information

Reducing Total Cost and Risk in Multilingual Litigation A VIA Legal Brief

Reducing Total Cost and Risk in Multilingual Litigation A VIA Legal Brief Reducing Total Cost and Risk in Multilingual Litigation A VIA Legal Brief Most ediscovery exercises are based on the assumption that the documents of interest are in English. However, in today s globalized

More information

Point of View. Competition and choice in the audit market

Point of View. Competition and choice in the audit market Point of View Competition and choice in the audit market Key messages Large global accounting networks have emerged in response to the demands of multinational companies which require their auditors to

More information

CI6227: Data Mining. Lesson 11b: Ensemble Learning. Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore.

CI6227: Data Mining. Lesson 11b: Ensemble Learning. Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore. CI6227: Data Mining Lesson 11b: Ensemble Learning Sinno Jialin PAN Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore Acknowledgements: slides are adapted from the lecture notes

More information

SMARTER. Jason R. Baron. Revolutionizing how the world handles information

SMARTER. Jason R. Baron. Revolutionizing how the world handles information COVER STORY ] THINKING SMARTER Jason R. Baron Revolutionizing how the world handles information It is common knowledge that we are living in what has been termed The Information Age. With the advent of

More information

The Next Phase of Electronic Discovery Process Automation

The Next Phase of Electronic Discovery Process Automation White Paper Predictive Coding The Next Phase of Electronic Discovery Process Automation By Katey Wood and Brian Babineau August, 2011 This ESG White Paper was commissioned by Recommind and is distributed

More information

EXECUTIVE BRIEF SPON. Third-Party Archiving Solutions Are Still Needed in Exchange 2013 Environments. Published April 2015

EXECUTIVE BRIEF SPON. Third-Party Archiving Solutions Are Still Needed in Exchange 2013 Environments. Published April 2015 EXECUTIVE BRIEF Third-Party Archiving Solutions Are Still Needed in Exchange Environments An Osterman Research Executive Brief sponsored by Published April 2015 SPON sponsored by Osterman Research, Inc.

More information

5 Barriers to EHR Replacement

5 Barriers to EHR Replacement Ease EHR replacement worries and succeed 5 Barriers to EHR Replacement Introduction 1 2 3 4 5 Haven t you spent enough money already? Training again Turn a burden into an opportunity! Am I going to lose

More information

Stu Van Dusen Marketing Manager, Lexbe LC. September 18, 2014

Stu Van Dusen Marketing Manager, Lexbe LC. September 18, 2014 Best Practices: Litigation Document Management Applying The Latest Lexbe ediscovery Platform Features and Functionality for Fast and Collaborative Reviews and Productions September 18, 2014 Stu Van Dusen

More information

Case 04-35261 Document 388 Filed in TXSB on 10/05/06 Page 1 of 6

Case 04-35261 Document 388 Filed in TXSB on 10/05/06 Page 1 of 6 Case 04-35261 Document 388 Filed in TXSB on 10/05/06 Page 1 of 6 IN THE UNITED STATES BANKRUPTCY COURT FOR THE SOUTHERN DISTRICT OF TEXAS HOUSTON DIVISION IN RE: KPMA PARTNERSHIP, LTD CASE NO: 04-35261

More information

This Method will show you exactly how you can profit from this specific online casino and beat them at their own game.

This Method will show you exactly how you can profit from this specific online casino and beat them at their own game. This Method will show you exactly how you can profit from this specific online casino and beat them at their own game. It s NOT complicated, and you DON T need a degree in mathematics or statistics to

More information

Due Diligence. Fingertips. at Your. Discover how easy it is to integrate credit reports and other data and services with CINcompass.

Due Diligence. Fingertips. at Your. Discover how easy it is to integrate credit reports and other data and services with CINcompass. Due Diligence at Your Fingertips Discover how easy it is to integrate credit reports and other data and services with CINcompass. Learn how to: Activate and configure the credit report option Order credit

More information

M INISTRY H EALTH CARE

M INISTRY H EALTH CARE M INISTRY H EALTH CARE CORPORATE POSITION STATEMENT TITLE: FRAUD AND ABUSE LAWS AND PROTECTIONS Origination Date: December, 2006 DRAFT/REV: December 7, 2007 Effective Date: January, 2007 Scope: Ministry

More information

Comparison of National Level Paralegal Certification Exams

Comparison of National Level Paralegal Certification Exams Comparison of National Level Paralegal Certification Exams PLEASE NOTE: The content of the chart below is verified only as to the information about the NFPA Paralegal Advanced Competency Exam (PACE ) exam

More information

Whitepaper: Enterprise Vault Discovery Accelerator and Clearwell A Comparison August 2012

Whitepaper: Enterprise Vault Discovery Accelerator and Clearwell A Comparison August 2012 888.427.5505 Whitepaper: Enterprise Vault Discovery Accelerator and Clearwell A Comparison August 2012 Prepared by Dan Levine, Principal Engineer & Miguel Ortiz, Esq., ediscovery Specialist Globanet 15233

More information

Table of Contents. 1. Configuration 2. Ordering 3. Integration 4. Tracking 5. Paying your Due Diligence Bill Quick Tip: Import an Existing Order

Table of Contents. 1. Configuration 2. Ordering 3. Integration 4. Tracking 5. Paying your Due Diligence Bill Quick Tip: Import an Existing Order Table of Contents 1. Configuration 2. Ordering 3. Integration 4. Tracking 5. Paying your Due Diligence Bill Quick Tip: Import an Existing Order Save time and increase accuracy Experience an easier, more

More information

Knowledge Discovery from patents using KMX Text Analytics

Knowledge Discovery from patents using KMX Text Analytics Knowledge Discovery from patents using KMX Text Analytics Dr. Anton Heijs anton.heijs@treparel.com Treparel Abstract In this white paper we discuss how the KMX technology of Treparel can help searchers

More information

Data and Analytics: A New Toolkit for Asset Managers

Data and Analytics: A New Toolkit for Asset Managers Data and Analytics: A New Toolkit for Asset Managers Featuring highlights of the State Street 2013 Data and Analytics Survey conducted by the Economist Intelligence Unit About the Research A global survey

More information

Selecting & implementing AML system that meets regulatory & business requirements

Selecting & implementing AML system that meets regulatory & business requirements Selecting & implementing AML system that meets regulatory & business requirements Camille Barkho Chief Compliance Officer Lebanon and Gulf Bank SAL Lebanon Mohamad Mansour Sr. AGM Chief Compliance Officer

More information