The Predictive Coding Soundtrack: Rewind, Play, Fast-Forward
|
|
|
- Winifred Walton
- 10 years ago
- Views:
Transcription
1 The Predictive Coding Soundtrack: Rewind, Play, Fast-Forward LEGALTECH NEW YORK February 3, 2015 Moderator: Amy Hinzmann Senior Vice President, DiscoverReady DiscoverReady 2014
2 THE PANELISTS* Marla Bergman Vice President, Associate General Counsel Goldman Sachs Elizabeth Jaworski Director, Legal Operations Motorola Daniel Pariser Partner Arnold & Porter Moderator: Amy Hinzmann Senior Vice President, DiscoverReady *The views expressed by the panelists are exclusively their own and do not reflect the positions of their employers or clients.
3 AGENDA Defining Predictive Coding/TAR Rewind: The History of Predictive Coding Play: How are we using (and not using) PC today? How to Make PC Cost-Effective Alternatives to Predictive Coding Fast Forward: How will we use PC in 2015?
4 Defining Predictive Coding/TAR
5 Defining Predictive Coding/TAR A combination of human and automated processes in which humans review a subset of documents, the computer analyzes those documents and decisions, and then the computer analyzes the remaining set of documents and recommends decisions for them. Maura Grossman and Gordon Cormack use the following: A technology-assisted review process involves the interplay of humans and computers to identify the documents in a collection that are responsive to a production request, or to identify those documents that should be withheld on the basis of privilege. 4
6 Rewind: The History of Predictive Coding
7 Rewind: The History of Predictive Coding Perceived to be a costsavings tool Use by defense vs. plaintiffs bars evolves Courts take a permissive, not prescriptive view The disputes have been outcome-prompted: parties contest its use when the production population is not what was anticipated 6
8 Play: What are we doing with PC today?
9 Play: What are we doing with PC today? When is PC being used and when not? Vendor and law-firm driven or client driven? If you are training a system, who are your experts? Are judgmental or random samples more defensible? Improves efficiency Prioritization of data Tier review sets Learn from prior productions 8
10 How to actually make PC Cost-Effective Does it actually save costs? Check with your vendor on the type of agreement you have Ensure that you have a process that integrates well with the technology Don t recreate the wheel every time 9
11 Alternatives to Pure PC Mixing PC with traditional methods Pure PC Using statistics to improve your PC results Using statistics to improve classic approach such as the application of keyword terms
12 Fast Forward: How will we use PC in 2015?
13 Fast Forward: How will we use PC in 2015? Detecting personally Identifying Information, or PII, such as: Name Telephone number Social Security Number address Address Driver s license number Birthdate Any other unique identifying Medical record numbers information Health plan beneficiary number Learning about prior data loads Privilege Redactions 12
14 Conclusion and Practice Points Consider whether and how PC might fit your case Assess the risks, costs, and potential savings Compare with alternatives to PC Don t be afraid to use PC in combination with tried-and-true approaches 13
15 Appendix Predictive Coding Case Law Review
16 The Failure to Cooperate and Do-Over Case Progressive Casualty v. Delaney, No. 2:11-cv-00678, 2014 WL (D. Nev. May 20, 2014) The parties agreed on an ESI protocol, which the court entered. After starting review, Plaintiff decided that the agreed-upon methodology (manual review of 565,000 docs that hit on agreed search terms) would be too time consuming and expensive. It decided unilaterally that it would instead apply predictive coding to the search term hit docs. The requesting party objected, citing the lack of transparency around the methodology and the failure to follow recommended best practices for the software program. Although it expressed support for the use of predictive coding generally, the court ordered Plaintiff to produce all of the search term hit documents, subject to a clawback order.
17 The Failure to Cooperate and Do-Over Case (cont) Progressive Casualty v. Delaney, No. 2:11-cv LRH-PAL, 2014 WL (D. Nev. May 20, 2014) Progressive proposes a "do-over" of its own invention that lacks transparency and cooperation regarding the search methodologies applied. Progressive is unwilling to engage in the type of cooperation and transparency that its own e-discovery consultant has so comprehensibly and persuasively explained is needed. Had the parties worked with their e-discovery consultants and agreed at the onset of this case to a predictive coding based ESI protocol, the court would not hesitate to approve a transparent mutually agreed upon ESI protocol. However, this is not what happened.
18 The Stop Whining and Use PC Cases Chevron v. Donziger, No. 11 Civ. 0691, 2013 U.S. Dist. LEXIS (S.D.N.Y. Mar. 15, 2013) (third party subpoena) Harris v. Subcontracting Concepts, No. 1:12-MC-82, 2013 U.S. Dist. LEXIS (S.D.N.Y. Mar. 11, 2013) (third party subpoena) In re Domestic Drywall Antitrust Litig., MDL No. 2437, 2014 U.S. Dist. LEXIS (E.D. Pa. May 12, 2014) (motion to compel answers to contention interrogatories)
19 Discover Better. DiscoverReady Thank You
The Truth About Predictive Coding: Getting Beyond The Hype
www.encase.com/ceic The Truth About Predictive Coding: Getting Beyond The Hype David R. Cohen Reed Smith LLP Records & E-Discovery Practice Group Leader David leads a group of more than 100 lawyers in
Technology Assisted Review: The Disclosure of Training Sets and Related Transparency Issues Whitney Street, Esq. 1
Technology Assisted Review: The Disclosure of Training Sets and Related Transparency Issues Whitney Street, Esq. 1 The potential cost savings and increase in accuracy afforded by technology assisted review
THE PREDICTIVE CODING CASES A CASE LAW REVIEW
THE PREDICTIVE CODING CASES A CASE LAW REVIEW WELCOME Thank you for joining Numerous diverse attendees Please feel free to submit questions Slides, recording and survey coming tomorrow SPEAKERS Matthew
A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012
A Practitioner s Guide to Statistical Sampling in E-Discovery October 16, 2012 1 Meet the Panelists Maura R. Grossman, Counsel at Wachtell, Lipton, Rosen & Katz Gordon V. Cormack, Professor at the David
Power-Up Your Privilege Review: Protecting Privileged Materials in Ediscovery
Power-Up Your Privilege Review: Protecting Privileged Materials in Ediscovery Jeff Schomig, WilmerHale Stuart Altman, Hogan Lovells Joe White, Kroll Ontrack Sheldon Noel, Kroll Ontrack (moderator) April
Acknowledgments Introduction: Welcome to the Labyrinth. CHAPTER 1 Gathering the Evidence 1. CHAPTER 2 Third-Party Experts 25
Acknowledgments Introduction: Welcome to the Labyrinth xi xiii CHAPTER 1 Gathering the Evidence 1 Form 1.1: General Preliminary Electronic Evidence Questions for Your Client 3 Form 1.2: Checklist to Define
MANAGING BIG DATA IN LITIGATION
David Han 2015 MANAGING BIG DATA IN LITIGATION DAVID HAN Associate, Morgan Lewis & Bockius, edata Practice Group MANAGING BIG DATA Data volumes always increasing New data sources Mobile Internet of Things
E-Discovery Best Practices
José Ramón González-Magaz [email protected] E-Discovery Best Practices www.steptoe.com November 10, 2010 Importance of E-Discovery 92% of all data is ESI. Source: Berkeley Study. 97 billion e-mails
Quality Control for predictive coding in ediscovery. kpmg.com
Quality Control for predictive coding in ediscovery kpmg.com Advances in technology are changing the way organizations perform ediscovery. Most notably, predictive coding, or technology assisted review,
E-Discovery in Michigan. Presented by Angela Boufford
E-Discovery in Michigan ESI Presented by Angela Boufford DISCLAIMER: This is by no means a comprehensive examination of E-Discovery issues. You will not be an E-Discovery expert after this presentation.
Electronic Discovery and the New Amendments to the Federal Rules of Civil Procedure: A Guide For In-House Counsel and Attorneys
Electronic Discovery and the New Amendments to the Federal Rules of Civil Procedure: A Guide For In-House Counsel and Attorneys By Ronald S. Allen, Esq. As technology has evolved, the federal courts have
How Good is Your Predictive Coding Poker Face?
How Good is Your Predictive Coding Poker Face? SESSION ID: LAW-W03 Moderator: Panelists: Matthew Nelson ediscovery Counsel Symantec Corporation Hon. Andrew J. Peck US Magistrate Judge Southern District
UNITED STATES DISTRICT COURT MIDDLE DISTRICT OF FLORIDA FORT MYERS DIVISION. Case No. 2:11-cv-162-FtM-36SPC ORDER
GAVIN'S ACE HARDWARE, INC., UNITED STATES DISTRICT COURT MIDDLE DISTRICT OF FLORIDA FORT MYERS DIVISION Plaintiff, -vs- Case No. 2:11-cv-162-FtM-36SPC FEDERATED MUTUAL INSURANCE COMPANY, Defendant. ORDER
Any and all documents Meets Electronically Stored Information: Discovery in the Electronic Age
Any and all documents Meets Electronically Stored Information: Discovery in the Electronic Age Panel Members Judge Ronald L. Buch, Moderator Panelists The Honorable Paul W. Grimm U.S. District Court for
Procedure: Electronic Discovery
Management System: Office of Chief Counsel Subject Area: Support and Information Access Procedure: Electronic Discovery Issue Date and Revision Number: 1/6/15 0 Lead Subject Matter Expert: Jay Jalovec
2011 Winston & Strawn LLP
Today s elunch Presenters John Rosenthal Litigation Washington, D.C. [email protected] Scott Cohen Director of E Discovery Support Services New York [email protected] 2 What Was Advertised Effective
ediscovery: Trends & Challenges
ediscovery: Trends & Challenges Joseph P. Grasser Carrie E. Jantsch January 28, 2014 Overview Trends & Challenges Mobile Device Electronic Discovery and BYOD Policies How BYOD Policies Complicate E-Discovery
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive coding is one of the most promising technologies to reduce the high cost of review by
Case 3:11-cv-01234-MMH-MCR Document 25 Filed 08/24/12 Page 1 of 6 PageID 145
Case 3:11-cv-01234-MMH-MCR Document 25 Filed 08/24/12 Page 1 of 6 PageID 145 NORTH AMERICAN COMPANY FOR LIFE AND HEALTH INSURANCE, UNITED STATES DISTRICT COURT MIDDLE DISTRICT OF FLORIDA JACKSONVILLE DIVISION
E-DISCOVERY: BURDENSOME, EXPENSIVE, AND FRAUGHT WITH RISK
E-DISCOVERY: BURDENSOME, EXPENSIVE, AND FRAUGHT WITH RISK If your company is involved in civil litigation, the Federal Rules of Civil Procedure regarding preservation and production of electronic documents
The Top Ten List (and one) of Changes to the Federal Rules
The Top Ten List (and one) of Changes to the Federal Rules The List (1) The rules now refer to electronically stored information, which is on equal footing with paper. Rules 26(a)(1), 26(b)(2), 26(b)(5)(B),
How To Write A Hit Report On A Lawsuit Against A Company
Everything You Wanted to Know About ESI and E-Discovery but Were Afraid to Ask Jason M. Pistacchio Presented By: Gregory S. Johnson Attorney Attorney/Legal Technologist Cosgrave Vergeer Kester LLP Paine
Recent Developments in the Law & Technology Relating to Predictive Coding
Recent Developments in the Law & Technology Relating to Predictive Coding Presented by Paul Neale CEO Presented by Gene Klimov VP & Managing Director Presented by Gerard Britton Managing Director 2012
A PRIMER ON THE NEW ELECTRONIC DISCOVERY PROVISIONS IN THE ALABAMA RULES OF CIVIL PROCEDURE
A PRIMER ON THE NEW ELECTRONIC DISCOVERY PROVISIONS IN THE ALABAMA RULES OF CIVIL PROCEDURE Effective February 1, 2010, the Alabama Rules of Civil Procedure were amended to provide for and accommodate
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow
WHITE PAPER: PREDICTIVE CODING DEFENSIBILITY........................................ Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive
Electronically Stored Information in Litigation
Electronically Stored Information in Litigation Volume 69, November 2013 By Timothy J. Chorvat and Laura E. Pelanek* I. Introduction Recent developments in the use of electronically stored information
BEYOND THE HYPE: Understanding the Real Implications of the Amended Federal Rules of Civil Procedure. A Clearwell Systems White Paper
BEYOND THE HYPE: UNDERSTANDING THE REAL IMPLICATIONS OF THE AMENDED FRCP PA G E : 1 BEYOND THE HYPE: Understanding the Real Implications of the Amended Federal Rules of Civil Procedure A Clearwell Systems
Discussion of Electronic Discovery at Rule 26(f) Conferences: A Guide for Practitioners
Discussion of Electronic Discovery at Rule 26(f) Conferences: A Guide for Practitioners INTRODUCTION Virtually all modern discovery involves electronically stored information (ESI). The production and
Case 2:08-cv-83111-ER Document 55 Filed 01/04/10 Page 1 of 6 IN THE UNITED STATES DISTRICT COURT FOR THE EASTERN DISTRICT OF PENNSYLVANIA
Case 2:08-cv-83111-ER Document 55 Filed 01/04/10 Page 1 of 6 IN THE UNITED STATES DISTRICT COURT FOR THE EASTERN DISTRICT OF PENNSYLVANIA REGINALD DENT : CONSOLIDATED : MDL 875 v. : : EDPA CIVIL ACTION
(Previously published in The Legal Intelligencer, November 8, 2011) New Cost Guidelines for E-Discovery by Peter Vaira
(Previously published in The Legal Intelligencer, November 8, 2011) New Cost Guidelines for E-Discovery by Peter Vaira In a recent case in the Eastern District, Judge Legrome Davis upheld court costs of
PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX?
Vol. 46 No. 3 February 6, 2013 PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? The high costs of e-discovery have led to the development of computerized review technology by which the user may search
Legal Arguments & Response Strategies for E-Discovery
Legal Arguments & Response Strategies for E-Discovery The tools to craft strategic discovery requests & mitigate the risks and burdens of production. Discussion Outline Part I Strategies for Requesting
E-Discovery Guidance for Federal Government Professionals Summer 2014
E-Discovery Guidance for Federal Government Professionals Summer 2014 Allison Stanton Director, E-Discovery, FOIA, & Records Civil Division, Department of Justice Adam Bain Senior Trial Counsel Civil Division,
Predictability in E-Discovery
Predictability in E-Discovery Presented by: John G. Roman, Jr. National Manager, Practice Group Technology Services Nixon Peabody LLP Tom Barce Assistant Director of Practice Support Fulbright & Jaworski
Case 5:11-cv-00360-OLG-JES-XR Document 1130 Filed 07/09/14 Page 1 of 5
Case 5:11-cv-00360-OLG-JES-XR Document 1130 Filed 07/09/14 Page 1 of 5 IN THE UNITED STATES DISTRICT COURT FOR THE WESTERN DISTRICT OF TEXAS SAN ANTONIO DIVISION SHANNON PEREZ, ET AL, Plaintiffs, v. RICK
Document Review Costs
Predictive Coding Gain Earlier Insight and Reduce Document Review Costs Tom Groom Vice President, Discovery Engineering [email protected] 303.840.3601 D4 LLC Litigation support service provider since
THE NEW WORLD OF E-DISCOVERY
THE NEW WORLD OF E-DISCOVERY Ralph Losey: partner and National e-discovery Counsel of Jackson Lewis LLP, a labor & employment firm with 700 lawyers and 46 offices nationwide. JacksonLewis.com author of
case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION
case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION IN RE: BIOMET M2a MAGNUM HIP IMPLANT PRODUCTS LIABILITY
AGENDA. Internet Law Update 2015 Evolving E-Discovery 2/16/2015. David Cohen April 16, 2015. 2014 in Review. E-Discovery Evolution: 2015 & Beyond
Internet Law Update 2015 Evolving E-Discovery David Cohen April 16, 2015 2014 in Review E-Discovery Cases Other E-Discovery Developments AGENDA E-Discovery Evolution: 2015 & Beyond Social Media The Internet
COURSE DESCRIPTION AND SYLLABUS LITIGATING IN THE DIGITAL AGE: ELECTRONIC CASE MANAGEMENT (994-001) Fall 2014
COURSE DESCRIPTION AND SYLLABUS LITIGATING IN THE DIGITAL AGE: ELECTRONIC CASE MANAGEMENT (994-001) Professors:Mark Austrian Christopher Racich Fall 2014 Introduction The ubiquitous use of computers, the
TECHNOLOGY-ASSISTED DOCUMENT REVIEW: IS IT DEFENSIBLE?
TECHNOLOGY-ASSISTED DOCUMENT REVIEW: IS IT DEFENSIBLE? By William W. Belt, Dennis R. Kiker and Daryl E. Shetterly* Cite as: William W. Belt, Dennis R. Kiker & Daryl E. Shetterly, Technology-Assisted Document
Case 1:04-cv-01639-RJL Document 1092-20 Filed 08/16/13 Page 1 of 6. EXHIBIT 1 s
Case 1:04-cv-01639-RJL Document 1092-20 Filed 08/16/13 Page 1 of 6 EXHIBIT 1 s Case 1:04-cv-01639-RJL Document 1092-20 Filed 08/16/13 Page 2 of 6 UNITED STATES DISTRICT COURT DISTRICT OF COLUMBIA In re
Digital Government Institute. Managing E-Discovery for Government: Integrating Teams and Technology
Digital Government Institute Managing E-Discovery for Government: Integrating Teams and Technology Larry Creech Program Manager Information Catalog Program Corporate Information Security Information Technology
In-House Solutions to the E-Discovery Conundrum
125 In-House Solutions to the E-Discovery Conundrum Retta A. Miller Carl C. Butzer Jackson Walker L.L.P. April 21, 2007 www.pointmm.com I. OVERVIEW OF THE RULES GOVERNING ELECTRONICALLY- STORED INFORMATION
Electronic Discovery: Litigation Holds, Data Preservation and Production
Electronic Discovery: Litigation Holds, Data Preservation and Production April 27, 2010 Daniel Munsch, Assistant General Counsel John Lerchey, Coordinator for Incident Response 0 E-Discovery Rules Federal
Case 5:14-cv-00093-RS-GRJ Document 21 Filed 05/28/14 Page 1 of 9
Case 5:14-cv-00093-RS-GRJ Document 21 Filed 05/28/14 Page 1 of 9 MARY SOWELL et al., Plaintiffs, IN THE UNITED STATES DISTRICT COURT FOR THE NORTHERN DISTRICT OF FLORIDA PANAMA CITY DIVISION Page 1 of
E-Discovery Under FRCP 45
E L E C T R O N I C D I S C O V E R Y Guidance from Sedona and Recent Case Law By Mark S. Sidoti, Mara E. Zazzali-Hogan and Stephen J. Finley Jr. The essential theme has been whether the attorneys and
ARIZONA SUPERIOR COURT, PIMA COUNTY HON. STEPHEN C. VILLARREAL JUDGE. DATE: May 17, 2011. PHOENIX NEWSPAPERS INC., Plaintiff, VS.
ARIZONA SUPERIOR COURT, PIMA COUNTY HON. STEPHEN C. VILLARREAL JUDGE CASE NO. C20111954 DATE: May 17, 2011 PHOENIX NEWSPAPERS INC., Plaintiff, VS. PIMA COMMUNITY COLLEGE, Defendant. R U L I N G IN CHAMBERS
Case: 2:04-cv-01110-JLG-NMK Doc #: 33 Filed: 06/13/05 Page: 1 of 7 PAGEID #: <pageid>
Case: 2:04-cv-01110-JLG-NMK Doc #: 33 Filed: 06/13/05 Page: 1 of 7 PAGEID #: IN THE UNITED STATES DISTRICT COURT FOR THE SOUTHERN DISTRICT OF OHIO EASTERN DIVISION ALVIN E. WISEMAN, Plaintiff,
E-discovery Taking Predictive Coding Out of the Black Box
E-discovery Taking Predictive Coding Out of the Black Box Joseph H. Looby Senior Managing Director FTI TECHNOLOGY IN CASES OF COMMERCIAL LITIGATION, the process of discovery can place a huge burden on
Book Review THE ELECTRONIC EVIDENCE AND DISCOVERY HANDBOOK: FORMS, CHECKLISTS, AND GUIDELINES
Book Review THE ELECTRONIC EVIDENCE AND DISCOVERY HANDBOOK: FORMS, CHECKLISTS, AND GUIDELINES by Sharon D. Nelson, Bruce A. Olson and John W. Simek American Bar Association 2006 745 pp. Reviewed by William
New Technologies Test the Limits of the Duty to Preserve, Collect and Produce Information in Civil Discovery
CHEAT SHEET In one case, a court issued sanctions for the deletion of a Facebook page during the course of litigation. In another, a judge said that once a plaintiff is tagged in photographs posted to
Technology Assisted Review of Documents
Ashish Prasad, Esq. Noah Miller, Esq. Joshua C. Garbarino, Esq. October 27, 2014 Table of Contents Introduction... 3 What is TAR?... 3 TAR Workflows and Roles... 3 Predictive Coding Workflows... 4 Conclusion...
THE CORPORATE COUNSELOR
THE CORPORATE COUNSELOR NOVEMBER 2013 Third-Party Litigation Investing and Attorney-Client Privilege By David A. Prange Civil litigation is potentially expensive, and achieving lucrative outcomes is not
E-Discovery Tip Sheet
E-Discovery Tip Sheet LegalTech 2015 Some Panels and Briefings Last month I took you on a select tour of the vendor exhibits and products from LegalTech 2015. This month I want to provide a small brief
Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division. Tracy Greer 1 Senior Litigation Counsel E-Discovery
Technology-Assisted Review and Other Discovery Initiatives at the Antitrust Division Tracy Greer 1 Senior Litigation Counsel E-Discovery The Division has moved to implement several discovery initiatives
Reducing Risks and Costs in Legal Governance & Compliance. 2012, TERIS, www.teris.com
E-Discovery & Business Intelligence Reducing Risks and Costs in Legal Governance & Compliance 2012, TERIS, www.teris.com 1 Speakers Adam Wells VP, E-Discovery Services, TERIS Provides clients with strategic
IN THE UNITED STATES DISTRICT COURT FOR THE EASTERN DISTRICT OF PENNSYLVANIA
IN THE UNITED STATES DISTRICT COURT FOR THE EASTERN DISTRICT OF PENNSYLVANIA ROSCOE FRANKLIN CIVIL ACTION NO. 02-3359 v. GENERAL ELECTRIC CAPITAL ASSURANCE COMPANY O Neill, J. November 9, 2004 MEMORANDUM
UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF CALIFORNIA
Franke v. Bridgepoint Education, Inc. et al Doc. 1 1 1 1 1 0 1 UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF CALIFORNIA In re BRIDGEPOINT EDUCATION, INC., SECURITIES LITIGATION Civil No. 1cv JM (JLB)
