Judge Peck Provides a Primer on Computer-Assisted Review By John Tredennick

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Judge Peck Provides a Primer on Computer-Assisted Review By John Tredennick"

Transcription

1 By John Tredennick CEO Catalyst Repository Systems

2

3 Magistrate Judge Andrew J. Peck issued a landmark decision in Da Silva Moore v. Publicis and MSL Group, filed on Feb. 24, This decision made headlines as being the first judicial opinion to approve the process of predictive coding, which is one of the many terms people use to describe computer-assisted coding. Well, Judge Peck did just that. As he hinted during his presentations at LegalTech 2012, this was the first time a court had the opportunity to consider the propriety of computer-assisted coding. Without hesitation, Judge Peck ushered us into the next generation of e-discovery review people assisted by a friendly robot. I recommend reading the decision (and its accompanying predictive-coding protocol) not for its result but for its reasoning. This is one of the best sources I have seen on the reasons for and processes underlying predictive coding. Indeed, Judge Peck provided a primer on how to conduct predictive coding that is must reading for anyone wanting to get up to speed on this process. What is? Judge Peck started by quoting from his earlier article in Law Technology News: By computer-assisted coding, I mean tools (different vendors use different names) that use sophisticated algorithms to enable the computer to determine relevance, based on interaction with (i.e. training by) a human reviewer. As Judge Peck concluded: This judicial opinion now recognizes that computer-assisted review is an acceptable way to search for relevant ESI in appropriate cases

4 Why Do We Need? The answer for Judge Peck was simple: Other methods of finding relevant documents are expensive and less effective. As he explained: The objective of e-discovery is to identify as many relevant documents as possible while reviewing as few non-relevant documents as possible. Linear review is often too expensive. Despite being seen as the gold standard, studies show that computerized searches underlying predictive coding are at least as accurate as human review, if not more accurate. Studies also show a high rate of disagreement among human reviewers as to whether a document is relevant. In most cases, the difference is attributable to human error or fatigue. Key word searches to reduce data sets also miss a large percentage of relevant documents. The typical practice of opposing parties choosing keywords resembles a game of Go Fish, as Ralph Losey once pointed out. Key word searches are often over-inclusive, finding large numbers of irrelevant documents that increase review costs. They can also be under-inclusive, missing relevant documents. In one key study the recall rate was just 20%. Ultimately, Judge Peck reminded us of the goals underlying the Federal Rules of Civil Procedure. Perfection is not required. The goal is the just, speedy, and inexpensive determination of lawsuits. Judge Peck concluded that the use of predictive coding was appropriate in this case for the following reasons: The parties agreement. The vast amount of ESI (over 3 million documents). The superiority of computer-assisted review over manual review or keyword searches. The need for cost effectiveness and proportionality. The transparent process proposed by the parties. The last point was perhaps the most important factor leading to the decision: MSL s transparency in its proposed ESI search protocol made it easier for the Court to approve the use of predictive coding

5 How Does the Process Work? The court attached the parties proposed protocol to the opinion. While it does not represent the only way to do computer-assisted review, it provides a helpful look into how the process works. 1. The process in this case began with attorneys developing an understanding of the files and identifying a small number that will function as an initial seed set representative of the categories to be reviewed and coded. There are a number of ways to develop the seed set, including the use of search tools and other filters, interviews, key custodian review, etc. 2. Opposing counsel should be advised of the hit counts and keyword searches used to develop the seed set and invited to submit their own keywords. They should also be provided with the resulting seed documents and allowed to review and comment on the coding done on the seed documents. 3. The seed sets are then used to begin the predictive coding process. Each seed set (one per issue being reviewed) is used to begin training the software. 4. The software uses each seed set to identify and prioritize all similar documents over the complete corpus under review. Essentially, they review at least 500 of the computer-selected documents to confirm that the computer is properly categorizing the documents. This is a calibration process. 5. Transparency requires that opposing counsel be given a chance to review all non-privileged documents used in the calibration process. If the parties disagree on tagging, they meet and confer to resolve the dispute. 6. At the conclusion of the training process, the system then identifies relevant documents from the larger set. These documents are reviewed manually for production. In this case, the producing party reserved the right to seek relief should too many documents be identified. 7. Accuracy during the process should be tested and quality controlled by both judgmental and statistical sampling. 8. Statistical sampling involves a small set of documents randomly selected from the total files to be tested. That allows the parties to project error rates from the sample. 9. Here, the parties agreed on a series of issues that will, of necessity, vary on other cases. The key point is that the parties agree on the issues and test the coding during the process

6 Random Samples It is important to create an initial random sample from the entire document set. The parties used a 95% confidence level with an error margin of 2%. They determined that the sample size should be 2,399 documents. You can figure this out using one of the publicly available sample-size calculators such as Raosoft, which we often use. Seed Sets The protocol goes on to describe a number of ways to generate seed sets including: Agreed-upon search terms. Judgmental analysis. Concept search. The parties frequently sampled the results from searches to evaluate their effectiveness. Some computer-assisted coding systems like the one used for this case start their process with seed sets. The notion is that attorneys understand the cases, know what is and is not relevant and can train the system to recognize more relevant documents more effectively than starting with no seed documents. Others think this is a mistake. They believe that however well meaning, the attorneys will bias the system to find what they think is relevant and get self-reinforcing results. In this regard, they are suggesting that the attorneys will make the same mistakes found in key word searches thinking that you know which words will be most effective at finding your documents. Systems following this logic urge the user to start from scratch, telling the system what is and is not relevant based on reviewing documents. As you do that, the system begins developing its own profile of relevant documents and builds out the searches. The belief is that the system may create a better search through this process than it might if you bias it with your seed documents. There is a middle ground here as well. Many of the latter systems (no seed) will allow you to submit a limited number of seed documents as part of the training process. That may represent the best of both worlds or it may not, depending on your beliefs. The important point is that there are different approaches to computer-assisted processing. This protocol shows you one approach only

7 Training Iterations The process involves a number of computer runs to find responsive documents. The parties started with a first set of potentially relevant documents based on analysis of the seed set. After that review, the computer was asked to consider the new tagging and find a second set for testing. Then a third and a fourth. The protocol suggested that the parties run through this process seven times. The key is to watch the change in the number of relevant documents predicted by the system after each round of testing. Once that number dropped below a delta of 5%, the parties had the option to stop. The notion is that the system has become stable by that time, with further review unlikely to uncover many more relevant documents. Finishing the Process Once the training has completed and the system is stable, we move from computerassisted to human-powered review. At that point, the producing party reviews all of the potentially responsive documents and produces accordingly. Final QC Protocol As a final stage, the parties need to focus on the potentially non-responsive documents the ones the system says to ignore. The parties select a random sample (2,399 documents again) to see how many were, in fact, responsive. These same documents (non-privileged ones) must be produced to the opposing party for review. If that party finds too many responsive documents in the sample or otherwise objects, it is time for a meet-and-confer to resolve the dispute. Failing that, you can always go to the court and fight it out. Is This the Bible on Predictive Coding? Certainly not. There are a lot of ways to approach this process. However, first opinions on any topic carry a lot of weight. We chose a profession that is guided by precedent, and these are first tracks on this new and exciting subject. The suggested procedures make sense to me and provide a starting point for your predictive coding efforts. This opinion and its accompanying protocol are important reading whether you are proposing or opposing the process for your next case

8 About John Tredennick A nationally known trial lawyer and longtime litigation partner at Holland & Hart, John founded Catalyst in 2000 and is responsible for its overall direction, voice and vision. Well before founding Catalyst, John was a pioneer in the field of legal technology. He was editor-in-chief of the multi-author, two-book series, Winning With Computers: Trial Practice in the Twenty-First Century (ABA Press 1990, 1991). Both were ABA best sellers focusing on using computers in litigation technology. At the same time, he wrote, How to Prepare for Take and Use a Deposition at Trial (James Publishing 1990), which he and his co-author continued to supplement for several years. He also wrote, Lawyer s Guide to Spreadsheets (Glasser Publishing 2000), and, Lawyer s Guide to Microsoft Excel 2007 (ABA Press 2009). John is the former chair of the ABA s Law Practice Management Section. For many years, he was editor-in-chief of the ABA s Law Practice Management magazine, a monthly publication focusing on legal technology and law office management. More recently, he founded and edited Law Practice Today, a monthly ABA webzine that focuses on legal technology and management. Over two decades, John has written scores of articles on legal technology and spoken on legal technology to audiences on four of the five continents. You can contact John Tredennick at About Catalyst Catalyst is a pioneer in providing secure, scalable multi-lingual document repositories for electronic discovery, litigation support, and other complex regulatory matters. For over a decade, corporations and their counsel have relied on Catalyst to control litigation costs and make review teams more effective. Our systems and supporting services cover the heart of the litigation lifecycle--from processing and search, to analytics, review, production and trial. For more information about Catalyst, visit:

Predictive Coding Helps Companies Reduce Discovery Costs

Predictive Coding Helps Companies Reduce Discovery Costs Predictive Coding Helps Companies Reduce Discovery Costs Recent Court Decisions Open Door to Wider Use by Businesses to Cut Costs in Document Discovery By John Tredennick As companies struggle to manage

More information

How It Works and Why It Matters for E-Discovery

How It Works and Why It Matters for E-Discovery Continuous Active Learning for Technology Assisted Review How It Works and Why It Matters for E-Discovery John Tredennick, Esq. Founder and CEO, Catalyst Repository Systems Peer-Reviewed Study Compares

More information

ESI and Predictive Coding

ESI and Predictive Coding Beijing Boston Brussels Chicago Frankfurt Hong Kong ESI and Predictive Coding Houston London Los Angeles Moscow Munich New York Palo Alto Paris São Paulo Charles W. Schwartz Chris Wycliff December 13,

More information

E-Discovery in Mass Torts:

E-Discovery in Mass Torts: E-Discovery in Mass Torts: Predictive Coding Friend or Foe? Sherry A. Knutson Sidley Austin One S Dearborn St 32nd Fl Chicago, IL 60603 (312) 853-4710 sknutson@sidley.com Sherry A. Knutson is a partner

More information

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive coding is one of the most promising technologies to reduce the high cost of review by

More information

Recent Developments in the Law & Technology Relating to Predictive Coding

Recent Developments in the Law & Technology Relating to Predictive Coding Recent Developments in the Law & Technology Relating to Predictive Coding Presented by Paul Neale CEO Presented by Gene Klimov VP & Managing Director Presented by Gerard Britton Managing Director 2012

More information

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow

Predictive Coding Defensibility and the Transparent Predictive Coding Workflow WHITE PAPER: PREDICTIVE CODING DEFENSIBILITY........................................ Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive

More information

REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - PRIORITIZATION FOR 100% REVIEW. Bill Tolson Sr. Product Marketing Manager Recommind Inc.

REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - PRIORITIZATION FOR 100% REVIEW. Bill Tolson Sr. Product Marketing Manager Recommind Inc. REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - Bill Tolson Sr. Product Marketing Manager Recommind Inc. Introduction... 3 Traditional Linear Review... 3 Advanced Review Strategies: A Typical Predictive

More information

The Benefits of. in E-Discovery. How Smart Sampling Can Help Attorneys Reduce Document Review Costs. A white paper from

The Benefits of. in E-Discovery. How Smart Sampling Can Help Attorneys Reduce Document Review Costs. A white paper from The Benefits of Sampling in E-Discovery How Smart Sampling Can Help Attorneys Reduce Document Review Costs A white paper from 615.255.5343 dsi.co 414 Union Street, Suite 1210 Nashville, TN 37219-1771 Table

More information

Predictive Coding Defensibility

Predictive Coding Defensibility Predictive Coding Defensibility Who should read this paper The Veritas ediscovery Platform facilitates a quality control workflow that incorporates statistically sound sampling practices developed in conjunction

More information

SMARTER. Jason R. Baron. Revolutionizing how the world handles information

SMARTER. Jason R. Baron. Revolutionizing how the world handles information COVER STORY ] THINKING SMARTER Jason R. Baron Revolutionizing how the world handles information It is common knowledge that we are living in what has been termed The Information Age. With the advent of

More information

Technology Assisted Review of Documents

Technology Assisted Review of Documents Ashish Prasad, Esq. Noah Miller, Esq. Joshua C. Garbarino, Esq. October 27, 2014 Table of Contents Introduction... 3 What is TAR?... 3 TAR Workflows and Roles... 3 Predictive Coding Workflows... 4 Conclusion...

More information

Making The Most Of Document Analytics

Making The Most Of Document Analytics Portfolio Media. Inc. 860 Broadway, 6th Floor New York, NY 10003 www.law360.com Phone: +1 646 783 7100 Fax: +1 646 783 7161 customerservice@law360.com Making The Most Of Document Analytics Law360, New

More information

The Truth About Predictive Coding: Getting Beyond The Hype

The Truth About Predictive Coding: Getting Beyond The Hype www.encase.com/ceic The Truth About Predictive Coding: Getting Beyond The Hype David R. Cohen Reed Smith LLP Records & E-Discovery Practice Group Leader David leads a group of more than 100 lawyers in

More information

www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence April 2013

www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence April 2013 www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence Why are non-users staying away from PC? source: edj Group s Q1 2013 Predictive Coding Survey, February 2013, N = 66 Slide 2 Introduction

More information

Top 10 Best Practices in Predictive Coding

Top 10 Best Practices in Predictive Coding Top 10 Best Practices in Predictive Coding Emerging Best Practice Guidelines for the Conduct of a Predictive Coding Project Equivio internal document " design an appropriate process, including use of available

More information

New York Law Journal (Online) May 25, 2012 Friday

New York Law Journal (Online) May 25, 2012 Friday 1 of 6 10/16/2014 2:36 PM New York Law Journal (Online) May 25, 2012 Friday Copyright 2012 ALM Media Properties, LLC All Rights Reserved Further duplication without permission is prohibited Length: 2327

More information

Predictive Coding: A Primer

Predictive Coding: A Primer MEALEY S TM LITIGATION REPORT Discovery Predictive Coding: A Primer by Amy Jane Longo, Esq. and Usama Kahf, Esq. O Melveny & Myers LLP Los Angeles, California A commentary article reprinted from the March

More information

Three Methods for ediscovery Document Prioritization:

Three Methods for ediscovery Document Prioritization: Three Methods for ediscovery Document Prioritization: Comparing and Contrasting Keyword Search with Concept Based and Support Vector Based "Technology Assisted Review-Predictive Coding" Platforms Tom Groom,

More information

MANAGING BIG DATA IN LITIGATION

MANAGING BIG DATA IN LITIGATION David Han 2015 MANAGING BIG DATA IN LITIGATION DAVID HAN Associate, Morgan Lewis & Bockius, edata Practice Group MANAGING BIG DATA Data volumes always increasing New data sources Mobile Internet of Things

More information

Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc.

Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc. Predictive Coding: A Rose by any Other Name by Sharon D. Nelson, Esq. and John W. Simek 2012 Sensei Enterprises, Inc. Is there general agreement about what predictive coding is? No. Is there general agreement

More information

e.law Relativity Analytics Webinar "e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation.

e.law Relativity Analytics Webinar e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation. e.law Relativity Analytics Webinar "e.law is the first partner in Australia to have achieved kcura's Relativity Best in Service designation. e.law Overview Founded in 1999, 15 year anniversary this year

More information

PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX?

PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? Vol. 46 No. 3 February 6, 2013 PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? The high costs of e-discovery have led to the development of computerized review technology by which the user may search

More information

Mastering Predictive Coding: The Ultimate Guide

Mastering Predictive Coding: The Ultimate Guide Mastering Predictive Coding: The Ultimate Guide Key considerations and best practices to help you increase ediscovery efficiencies and save money with predictive coding 4.5 Validating the Results and Producing

More information

ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING

ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING ABA SECTION OF LITIGATION 2012 SECTION ANNUAL CONFERENCE APRIL 18-20, 2012: PREDICTIVE CODING Predictive Coding SUBMITTED IN SUPPORT OF THE PANEL DISCUSSION INTRODUCTION Technology has created a problem.

More information

How Good is Your Predictive Coding Poker Face?

How Good is Your Predictive Coding Poker Face? How Good is Your Predictive Coding Poker Face? SESSION ID: LAW-W03 Moderator: Panelists: Matthew Nelson ediscovery Counsel Symantec Corporation Hon. Andrew J. Peck US Magistrate Judge Southern District

More information

Case 2:11-cv-00678-LRH-PAL Document 174 Filed 07/18/14 Page 1 of 18 UNITED STATES DISTRICT COURT DISTRICT OF NEVADA * * * Plaintiff, Defendants.

Case 2:11-cv-00678-LRH-PAL Document 174 Filed 07/18/14 Page 1 of 18 UNITED STATES DISTRICT COURT DISTRICT OF NEVADA * * * Plaintiff, Defendants. Case :-cv-00-lrh-pal Document Filed 0// Page of 0 PROGRESSIVE CASUALTY INSURANCE COMPANY, v. JACKIE K. DELANEY, et al., UNITED STATES DISTRICT COURT DISTRICT OF NEVADA Plaintiff, Defendants. * * * Case

More information

The case for statistical sampling in e-discovery

The case for statistical sampling in e-discovery Forensic The case for statistical sampling in e-discovery January 2012 kpmg.com 2 The case for statistical sampling in e-discovery The sheer volume and unrelenting production deadlines of today s electronic

More information

Challenges in Legal Electronic Discovery CISML 2011

Challenges in Legal Electronic Discovery CISML 2011 Challenges in Legal Electronic Discovery CISML 2011 this presentation is available: http://tinyurl.com/cat-cisml2011 Dr Jeremy Pickens Sr Applied Research Scientist Likes: Information Retrieval, collaborative

More information

E-Discovery Tip Sheet

E-Discovery Tip Sheet E-Discovery Tip Sheet LegalTech 2015 Some Panels and Briefings Last month I took you on a select tour of the vendor exhibits and products from LegalTech 2015. This month I want to provide a small brief

More information

Pros And Cons Of Computer-Assisted Review

Pros And Cons Of Computer-Assisted Review Portfolio Media. Inc. 860 Broadway, 6th Floor New York, NY 10003 www.law360.com Phone: +1 646 783 7100 Fax: +1 646 783 7161 customerservice@law360.com Pros And Cons Of Computer-Assisted Review Law360,

More information

Case 1:11-cv-01279-ALC-AJP Document 96 Filed 02/24/12 Page 1 of 49

Case 1:11-cv-01279-ALC-AJP Document 96 Filed 02/24/12 Page 1 of 49 Case 1:11-cv-01279-ALC-AJP Document 96 Filed 02/24/12 Page 1 of 49 UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF NEW YORK - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

More information

Technology- Assisted Review 2.0

Technology- Assisted Review 2.0 LITIGATION AND PRACTICE SUPPORT Technology- Assisted Review 2.0 by Ignatius Grande of Hughes Hubbard & Reed LLP and Andrew Paredes of Epiq Systems Legal teams and their outside counsel must deal with an

More information

The United States Law Week

The United States Law Week The United States Law Week Source: U.S. Law Week: News Archive > 2012 > 04/24/2012 > BNA Insights > Under Fire: A Closer Look at Technology- Assisted Document Review E-DISCOVERY Under Fire: A Closer Look

More information

An Open Look at Keyword Search vs. Predictive Analytics

An Open Look at Keyword Search vs. Predictive Analytics 877.557.4273 catalystsecure.com ARTICLE An Open Look at Keyword Search vs. Can Keyword Search Be As Effective as TAR? John Tredennick, Esq. Founder and CEO, Catalyst Repository Systems 2015 Catalyst Repository

More information

Cost-Effective and Defensible Technology Assisted Review

Cost-Effective and Defensible Technology Assisted Review WHITE PAPER: SYMANTEC TRANSPARENT PREDICTIVE CODING Symantec Transparent Predictive Coding Cost-Effective and Defensible Technology Assisted Review Who should read this paper Predictive coding is one of

More information

Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e

Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e Ba k e Offs, De m o s & Kicking t h e Ti r e s: A Pr a c t i c a l Litigator s Br i e f Gu i d e t o Eva l u at i n g Ea r ly Ca s e Assessment So f t wa r e & Search & Review Tools Ronni D. Solomon, King

More information

Traditionally, the gold standard for identifying potentially

Traditionally, the gold standard for identifying potentially istockphoto.com/alexandercreative Predictive Coding: It s Here to Stay Predictive coding programs are poised to become a standard practice in e-discovery in the near future. As more courts weigh in on

More information

Quality Control for predictive coding in ediscovery. kpmg.com

Quality Control for predictive coding in ediscovery. kpmg.com Quality Control for predictive coding in ediscovery kpmg.com Advances in technology are changing the way organizations perform ediscovery. Most notably, predictive coding, or technology assisted review,

More information

The Evolution, Uses, and Case Studies of Technology Assisted Review

The Evolution, Uses, and Case Studies of Technology Assisted Review FEBRUARY 4 6, 2014 / THE HILTON NEW YORK The Evolution, Uses, and Case Studies of Technology Assisted Review One Size Does Not Fit All #LTNY Meet Our Panelists The Honorable Dave Waxse U.S. Magistrate

More information

A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012

A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012 A Practitioner s Guide to Statistical Sampling in E-Discovery October 16, 2012 1 Meet the Panelists Maura R. Grossman, Counsel at Wachtell, Lipton, Rosen & Katz Gordon V. Cormack, Professor at the David

More information

E-discovery Taking Predictive Coding Out of the Black Box

E-discovery Taking Predictive Coding Out of the Black Box E-discovery Taking Predictive Coding Out of the Black Box Joseph H. Looby Senior Managing Director FTI TECHNOLOGY IN CASES OF COMMERCIAL LITIGATION, the process of discovery can place a huge burden on

More information

THE PREDICTIVE CODING CASES A CASE LAW REVIEW

THE PREDICTIVE CODING CASES A CASE LAW REVIEW THE PREDICTIVE CODING CASES A CASE LAW REVIEW WELCOME Thank you for joining Numerous diverse attendees Please feel free to submit questions Slides, recording and survey coming tomorrow SPEAKERS Matthew

More information

DSi Pilot Program: Comparing Catalyst Insight Predict with Linear Review

DSi Pilot Program: Comparing Catalyst Insight Predict with Linear Review case study DSi Pilot Program: Comparing Catalyst Insight Predict with Linear Review www.dsicovery.com 877-797-4771 414 Union St., Suite 1210 Nashville, TN 37219 (615) 255-5343 Catalyst Insight Predict

More information

2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500

2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500 2972 NW 60 th Street, Fort Lauderdale, Florida 33309 Tel 954.462.5400 Fax 954.463.7500 5218 South East Street, Suite E-3, Indianapolis, IN 46227 Tel 317.247.4400 Fax 317.247.0044 Presented by Providing

More information

Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review

Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review Predictive Coding: How to Cut Through the Hype and Determine Whether It s Right for Your Review ACEDS Webinar April 23, 2014 Sponsored by Robert Half Legal 1 2014 Robert Half Legal. An Equal Opportunity

More information

Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division. Tracy Greer 1 Senior Litigation Counsel E-Discovery

Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division. Tracy Greer 1 Senior Litigation Counsel E-Discovery Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division Tracy Greer 1 Senior Litigation Counsel E-Discovery The Division has moved to implement several discovery initiatives

More information

In my article Search, Forward: Will manual document review and keyword searches

In my article Search, Forward: Will manual document review and keyword searches UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF NEW YORK - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - x MONIQUE DA SILVA MOORE, et al., Plaintiffs, -against- PUBLICIS GROUPE

More information

The State Of Predictive Coding

The State Of Predictive Coding MEALEY S TM LITIGATION REPORT Discovery The State Of Predictive Coding by Royce F. Cohen and Derek I.A. Silverman Stroock & Stroock & Lavan LLP New York A commentary article reprinted from the September

More information

Litigation Solutions insightful interactive culling distributed ediscovery processing powering digital review

Litigation Solutions insightful interactive culling distributed ediscovery processing powering digital review Litigation Solutions i n s i g h t f u l i n t e r a c t i ve c u l l i n g d i s t r i b u t e d e d i s cove r y p ro ce s s i n g p owe r i n g d i g i t a l re v i e w Advanced Analytical Review Data

More information

Making reviews more consistent and efficient.

Making reviews more consistent and efficient. Making reviews more consistent and efficient. PREDICTIVE CODING AND ADVANCED ANALYTICS Predictive coding although yet to take hold with the enthusiasm initially anticipated is still considered by many

More information

Software-assisted document review: An ROI your GC can appreciate. kpmg.com

Software-assisted document review: An ROI your GC can appreciate. kpmg.com Software-assisted document review: An ROI your GC can appreciate kpmg.com b Section or Brochure name Contents Introduction 4 Approach 6 Metrics to compare quality and effectiveness 7 Results 8 Matter 1

More information

Predictive Coding as a Means to Prioritize Review and Reduce Discovery Costs. White Paper

Predictive Coding as a Means to Prioritize Review and Reduce Discovery Costs. White Paper Predictive Coding as a Means to Prioritize Review and Reduce Discovery Costs White Paper INTRODUCTION Computers and the popularity of digital information have changed the way that the world communicates

More information

Predictive Coding: Understanding the Wows & Weaknesses

Predictive Coding: Understanding the Wows & Weaknesses Predictive Coding: Understanding the Wows & Weaknesses Bryan Callahan, CPA, CFF, CFE, CVA Managing Consultant Forensics & Valuation Services bcallahan@bkd.com Lanny Morrow, EnCE Supervising Consultant

More information

SAMPLING: MAKING ELECTRONIC DISCOVERY MORE COST EFFECTIVE

SAMPLING: MAKING ELECTRONIC DISCOVERY MORE COST EFFECTIVE SAMPLING: MAKING ELECTRONIC DISCOVERY MORE COST EFFECTIVE Milton Luoma Metropolitan State University 700 East Seventh Street St. Paul, Minnesota 55337 651 793-1246 (fax) 651 793-1481 Milt.Luoma@metrostate.edu

More information

The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review

The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review ediscovery & Information Management White Paper The Tested Effectiveness of Equivio>Relevance in Technology Assisted Review Scott M. Cohen Elizabeth T. Timkovich John J. Rosenthal February 2014 2014 Winston

More information

E-Discovery Getting a Handle on Predictive Coding

E-Discovery Getting a Handle on Predictive Coding E-Discovery Getting a Handle on Predictive Coding John J. Jablonski Goldberg Segalla LLP 665 Main St Ste 400 Buffalo, NY 14203-1425 (716) 566-5400 jjablonski@goldbergsegalla.com Drew Lewis Recommind 7028

More information

E-Discovery: A Common Sense Approach. In order to know how to handle and address ESI issues, the preliminary and

E-Discovery: A Common Sense Approach. In order to know how to handle and address ESI issues, the preliminary and Jay E. Heidrick Polsinelli jheidrick@polsinelli.com (913) 234-7506 E-Discovery: A Common Sense Approach In order to know how to handle and address ESI issues, the preliminary and obvious question must

More information

E-Discovery Tip Sheet

E-Discovery Tip Sheet E-Discovery Tip Sheet A Painful Discovery Toward the end of last year, I populated the Tip Sheet with a series on collections (see ediscovery Tip Sheet: Taking Up Collections Part 1, Part 2, Part 3, Part

More information

Introduction to Predictive Coding

Introduction to Predictive Coding Introduction to Predictive Coding Herbert L. Roitblat, Ph.D. CTO, Chief Scientist, OrcaTec Predictive coding uses computers and machine learning to reduce the number of documents in large document sets

More information

How to Manage Costs and Expectations for Successful E-Discovery: Best Practices

How to Manage Costs and Expectations for Successful E-Discovery: Best Practices How to Manage Costs and Expectations for Successful E-Discovery: Best Practices Mukesh Advani, Esq., Advisory Board Member, UBIC North America, Inc. UBIC North America, Inc. 3 Lagoon Dr., Ste. 180, Redwood

More information

Comprehending the Challenges of Technology Assisted Document Review

Comprehending the Challenges of Technology Assisted Document Review Comprehending the Challenges of Technology Assisted Document Review Predictive Coding in Multi-Language E-Discovery 3 Lagoon Dr., Ste.180, Redwood UBIC North City, America, CA 94065 Inc. +1-650-654-7664

More information

Predictive Coding: E-Discovery Game Changer?

Predictive Coding: E-Discovery Game Changer? PAGE 11 Predictive Coding: E-Discovery Game Changer? By Melissa Whittingham, Edward H. Rippey and Skye L. Perryman Predictive coding promises more efficient e- discovery reviews, with significant cost

More information

AN E-DISCOVERY MODEL ORDER

AN E-DISCOVERY MODEL ORDER AN E-DISCOVERY MODEL ORDER INTRODUCTION Since becoming a staple of American civil litigation, e-discovery has been the subject of extensive review, study, and commentary. See The Sedona Principles: Best

More information

White Paper Technology Assisted Review. Allison Stanfield and Jeff Jarrett 25 February 2015. 1300 136 993 www.elaw.com.au

White Paper Technology Assisted Review. Allison Stanfield and Jeff Jarrett 25 February 2015. 1300 136 993 www.elaw.com.au White Paper Technology Assisted Review Allison Stanfield and Jeff Jarrett 25 February 2015 1300 136 993 www.elaw.com.au Table of Contents 1. INTRODUCTION 3 2. KEYWORD SEARCHING 3 3. KEYWORD SEARCHES: THE

More information

Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process

Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process Technology Assisted Review: Don t Worry About the Software, Keep Your Eye on the Process By Joe Utsler, BlueStar Case Solutions Technology Assisted Review (TAR) has become accepted widely in the world

More information

E-DISCOVERY AND KEYWORDS: NOT SO KEY AFTER ALL FACE 2 FACE A CONFERENCE FOR LITIGATION SUPPORT CBA - NS FRIDAY, DECEMBER 7, 2012 HALIFAX, NOVA SCOTIA

E-DISCOVERY AND KEYWORDS: NOT SO KEY AFTER ALL FACE 2 FACE A CONFERENCE FOR LITIGATION SUPPORT CBA - NS FRIDAY, DECEMBER 7, 2012 HALIFAX, NOVA SCOTIA E-DISCOVERY AND KEYWORDS: NOT SO KEY AFTER ALL FACE 2 FACE A CONFERENCE FOR LITIGATION SUPPORT CBA - NS FRIDAY, DECEMBER 7, 2012 HALIFAX, NOVA SCOTIA HALIFAX MARRIOTT HARBOURFRONT PRESENTATION BY: DANIELA

More information

RISE OF THE MACHINES: Technology-Assisted Coding in the ESI Age. Robert J. Burns Benjamin R. Wilson

RISE OF THE MACHINES: Technology-Assisted Coding in the ESI Age. Robert J. Burns Benjamin R. Wilson RISE OF THE MACHINES: Technology-Assisted Coding in the ESI Age Robert J. Burns Benjamin R. Wilson It was not long ago that business and with it, litigation involving business was conducted far differently.

More information

Hamilton County Law Library News. A Monthly Newsletter from the Hamilton County Law Library April 2012

Hamilton County Law Library News. A Monthly Newsletter from the Hamilton County Law Library April 2012 Hamilton County Law Library News NEWS A Monthly Newsletter from the Hamilton County Law Library April 2012 Court OKs Use of Computer-Assisted Review of Electronically Stored Information By Barry M. Kazan,

More information

READY FOR THE MATRIX? MAN VERSUS MACHINE

READY FOR THE MATRIX? MAN VERSUS MACHINE READY FOR THE MATRIX? MAN VERSUS MACHINE by Laura Ewing Pearle, CEDS Assistant Director, Client Services Cobra Legal Solutions In a 2014 order, Judge Denise Cote presented a Valentine s Day present to

More information

Predictive Coding in Multi-Language E-Discovery

Predictive Coding in Multi-Language E-Discovery Comprehending the Challenges of Technology Assisted Document Review Predictive Coding in Multi-Language E-Discovery UBIC North America, Inc. 3 Lagoon Dr., Ste. 180, Redwood City, CA 94065 877-321-8242

More information

case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION

case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION IN RE: BIOMET M2a MAGNUM HIP IMPLANT PRODUCTS LIABILITY

More information

DOCSVAULT WhitePaper. Concise Guide to E-discovery. Contents

DOCSVAULT WhitePaper. Concise Guide to E-discovery. Contents WhitePaper Concise Guide to E-discovery Contents i. Overview ii. Importance of e-discovery iii. How to prepare for e-discovery? iv. Key processes & issues v. The next step vi. Conclusion Overview E-discovery

More information

Intermountain ediscovery Conference 2012

Intermountain ediscovery Conference 2012 Intermountain ediscovery Conference 2012 From Technology Assisted Review to Twi6er: What Clients, Law Firms, and Vendors Need to Know David Horrigan, 451 Research 451 Research Global research analyst firm

More information

The Case for Technology Assisted Review and Statistical Sampling in Discovery

The Case for Technology Assisted Review and Statistical Sampling in Discovery The Case for Technology Assisted Review and Statistical Sampling in Discovery Position Paper for DESI VI Workshop, June 8, 2015, ICAIL Conference, San Diego, CA Christopher H Paskach The Claro Group, LLC

More information

UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION MEMORANDUM CONCERNING APPOINTMENT OF SPECIAL MASTER AND SCHEDULING

UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION MEMORANDUM CONCERNING APPOINTMENT OF SPECIAL MASTER AND SCHEDULING UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION IN RE: BIOMET M2a MAGNUM HIP ) IMPLANT PRODUCTS LIABILITY ) LITIGATION (MDL 2391) ) CAUSE NO. 3:12-MD-2391 ) ) ) This Document

More information

Navigating E-Discovery, And The

Navigating E-Discovery, And The Navigating E-Discovery, And The l f C S Role of ACEDS 1 IDF Conference December 2012 Overview Introduction to US E-Discovery Important E-Discovery Trends Role of ACEDS Mission of ACEDS in Japan 2 E-Discovery

More information

THE NEW WORLD OF E-DISCOVERY

THE NEW WORLD OF E-DISCOVERY THE NEW WORLD OF E-DISCOVERY Ralph Losey: partner and National e-discovery Counsel of Jackson Lewis LLP, a labor & employment firm with 700 lawyers and 46 offices nationwide. JacksonLewis.com author of

More information

THE 2015 FEDERAL E-DISCOVERY RULES AMENDMENTS

THE 2015 FEDERAL E-DISCOVERY RULES AMENDMENTS THE 2015 FEDERAL E-DISCOVERY RULES AMENDMENTS 1 Today s Panel Gary R. Jones, U.S. Magistrate Judge Ralph Artigliere, Florida Circuit Court Judge (Retired) William F. Hamilton, UF Law E-Discovery Project

More information

Turning the Tide The Need for E-Discovery Education

Turning the Tide The Need for E-Discovery Education Turning the Tide The Need for E-Discovery Education Hon. David J. Waxse, U.S. Magistrate Judge, District of Kansas Ralph C. Losey, Esq., Partner and National e-discovery Counsel, Jackson Lewis LLP Rhea

More information

Making Sense of E-Discovery: 10 Plain Steps for Producing ESI

Making Sense of E-Discovery: 10 Plain Steps for Producing ESI Making Sense of E-Discovery: 10 Plain Steps for Producing ESI The following article provides a practical guide to producing electronically stored information (ESI) that lawyers can apply immediately in

More information

Navigating Information Governance and ediscovery

Navigating Information Governance and ediscovery Navigating Information Governance and ediscovery Implementing Processes & Technology to Reduce Downstream ediscovery Cost and Risk Shannon Smith General Counsel, Globanet March 11 12, 2013 Agenda 1 Overview

More information

Five Reasons the Cloud Beats an Appliance for Big Data E-Discovery

Five Reasons the Cloud Beats an Appliance for Big Data E-Discovery 877.557.4273 catalystsecure.com ARTICLE Five Reasons the Cloud Beats an Appliance for Big Data E-Discovery John Tredennick, Esq. Founder and CEO, Catalyst Repository Systems Big data can mean big headaches

More information

E-Discovery Tip Sheet

E-Discovery Tip Sheet E-Discovery Tip Sheet Random Sampling In days past, one could look at a body of discovery and pretty well calculate how many pairs of eyeballs would be required to examine and code every document within

More information

Discussion of Electronic Discovery at Rule 26(f) Conferences: A Guide for Practitioners

Discussion of Electronic Discovery at Rule 26(f) Conferences: A Guide for Practitioners Discussion of Electronic Discovery at Rule 26(f) Conferences: A Guide for Practitioners INTRODUCTION Virtually all modern discovery involves electronically stored information (ESI). The production and

More information

Take an Enterprise Approach to E-Discovery. Streamline Discovery and Control Review Cost Using a Central, Secure E-Discovery Cloud Platform

Take an Enterprise Approach to E-Discovery. Streamline Discovery and Control Review Cost Using a Central, Secure E-Discovery Cloud Platform Take an Enterprise Approach to E-Discovery Streamline Discovery and Control Review Cost Using a Central, Secure E-Discovery Cloud Platform A Smarter Approach Catalyst s e-discovery cloud platform provides

More information

ZL UNIFIED ARCHIVE A Project Manager s Guide to E-Discovery. ZL TECHNOLOGIES White Paper

ZL UNIFIED ARCHIVE A Project Manager s Guide to E-Discovery. ZL TECHNOLOGIES White Paper ZL UNIFIED ARCHIVE A Project Manager s Guide to E-Discovery ZL TECHNOLOGIES White Paper PAGE 1 A project manager s guide to e-discovery In civil litigation, the parties in a dispute are required to provide

More information

IMPROVING SETTLEMENT SAVVY. Kathy Perkins Kathy Perkins LLC, Workplace Law & Mediation www.kathy-perkins.com

IMPROVING SETTLEMENT SAVVY. Kathy Perkins Kathy Perkins LLC, Workplace Law & Mediation www.kathy-perkins.com IMPROVING SETTLEMENT SAVVY Kathy Perkins Kathy Perkins LLC, Workplace Law & Mediation www.kathy-perkins.com In these difficult economic times, parties may be looking to reduce litigation costs and risk

More information

E-Discovery Basics For the RIM Professional. Learning Objectives 5/18/2015. What is Electronic Discovery?

E-Discovery Basics For the RIM Professional. Learning Objectives 5/18/2015. What is Electronic Discovery? E-Discovery Basics For the RIM Professional By: Andy Sokol, CEDS, CSDS Adding A New Service Offering For Your Legal & Corporate Clients Learning Objectives What is Electronic Discovery? How Does E-Discovery

More information

ACADEMIC AFFAIRS COUNCIL ******************************************************************************

ACADEMIC AFFAIRS COUNCIL ****************************************************************************** ACADEMIC AFFAIRS COUNCIL AGENDA ITEM: 8.D DATE: March 15, 2007 ****************************************************************************** SUBJECT: Electronic Records Discovery Electronic records management

More information

Minimizing ediscovery risks. What organizations need to know in today s litigious and digital world.

Minimizing ediscovery risks. What organizations need to know in today s litigious and digital world. What organizations need to know in today s litigious and digital world. The main objective for a corporation s law department is to mitigate risk throughout the company, while keeping costs under control.

More information

forensics matters Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding

forensics matters Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding forensics Is Predictive Coding the electronic discovery Magic Bullet? An overview of judicial acceptance of predictive coding Publication No. 12-03 1Introduction Predictive Coding is the emerging tool

More information

Industry Leading Solutions: Innovative Technology. Quality Results.

Industry Leading Solutions: Innovative Technology. Quality Results. Industry Leading Solutions: Innovative Technology. Quality Results. April 10, 2013 emagsolutions.com Agenda Speaker Introduction A Quick Word about emag Importance of Technology Assisted Review (TAR) Key

More information

Cross-Border EDiscovery

Cross-Border EDiscovery Cross-Border EDiscovery Machine translation use cases Given the increasing rate of globalization and risk of regulatory action, the likelihood that organizations will have to contend with cross-border

More information

ZEROING IN DATA TARGETING IN EDISCOVERY TO REDUCE VOLUMES AND COSTS

ZEROING IN DATA TARGETING IN EDISCOVERY TO REDUCE VOLUMES AND COSTS ZEROING IN DATA TARGETING IN EDISCOVERY TO REDUCE VOLUMES AND COSTS WELCOME Thank you for joining Numerous diverse attendees Today s topic and presenters This is an interactive presentation You will receive

More information

The Next Phase of Electronic Discovery Process Automation

The Next Phase of Electronic Discovery Process Automation White Paper Predictive Coding The Next Phase of Electronic Discovery Process Automation By Katey Wood and Brian Babineau August, 2011 This ESG White Paper was commissioned by Recommind and is distributed

More information

April Edition of Notable Cases and Events in E-Discovery

April Edition of Notable Cases and Events in E-Discovery APRIL 16, 2015 E-DISCOVERY UPDATE April Edition of Notable Cases and Events in E-Discovery This update addresses the following recent developments and court decisions involving e-discovery issues: 1. A

More information

A Model Order Regarding E-Discovery in Patent (and Other?) Cases

A Model Order Regarding E-Discovery in Patent (and Other?) Cases ARTICLES A Model Order Regarding E-Discovery in Patent (and Other?) Cases By Steven R. Trybus and Sara Tonnies Horton In the electronic age, discovery procedures designed for the 19th and 20th centuries

More information

Electronically Stored Information: Focus on Review and Strategies

Electronically Stored Information: Focus on Review and Strategies Procrastinators Programs SM Electronically Stored Information: Focus on Review and Strategies Gavin Manes, Ph.D., Avansic Course Number: 0200121220 1 Hour of CLE December 20, 2012 11:20 12:20 p.m. Gavin

More information

Document Review Costs

Document Review Costs Predictive Coding Gain Earlier Insight and Reduce Document Review Costs Tom Groom Vice President, Discovery Engineering tgroom@d4discovery.com 303.840.3601 D4 LLC Litigation support service provider since

More information