MANAGING BIG DATA IN LITIGATION
|
|
|
- Corey Golden
- 10 years ago
- Views:
Transcription
1 David Han 2015 MANAGING BIG DATA IN LITIGATION DAVID HAN Associate, Morgan Lewis & Bockius, edata Practice Group MANAGING BIG DATA Data volumes always increasing New data sources Mobile Internet of Things Cloud New data types 1
2 EDRM MODEL MANAGING COST: MEET AND CONFER Cooperation Controlling Scope Custodians / Other Sources Time Frame Keywords / Technology MANAGING COST (CONT.) Form of Production Seek agreement up front Format may dictate process Ensure form of production is something you are comfortable receiving and creating Clawback / 502(d) orders 2
3 FEDERAL VS. STATE (PA) REQUIREMENTS PA ediscovery rules Order No. 564 (Pa. 2012) Discovery of ESI should be guided by proportionality and cooperation Similar in spirit to Federal Rules, but explicitly not identical to Federal Rules Amended PA Rule 4009, Limitations as to time and scope Make ESI requests as specific as possible Nature and scope of the litigation Relevance of the ESI Cost and time burdens Relative ease of producing the ESI FEDERAL VS. STATE (PA) (CONT.) No Rule 26(f) analog - meeting prior to discovery not required No Rule 37(e) analog no Safe Harbor provision, but commentary states good faith should protect against sanctions PREDICTIVE CODING AND OTHER ASSISTIVE TECHNOLOGIES Understanding best processes and tools What is reasonable? Reasonable inquiry and reasonable steps ABA Model Rules to maintain competence, keep up to date on relevant technology 3
4 DEFENSE OF PROCESS Surowiec v. Capital Title Agency, Inc. (No. CV PHX-DGC) (D. Ariz. May 4, 2011) Defendant used unreasonably narrow search terms Search terms must be quality control tested WHAT IS PREDICTIVE CODING? Predictive Coding machine learning Similar technologies: Spam filters Search engines Training a computer to categorize a set of data PREDICTIVE CODING CASES Da Silva Moore v. Publicis Groupe, No. 11 CIV 1279 (ALC) (AJP) (S.D.N.Y. Feb. 24, 2012) Predictive coding judicially approved, considerations: Agreement by parties to use PC Volume of ESI (3M documents) Efficacy of computer-assisted review (better than linear review or just keyword searches) Cost effectiveness and proportionality Proof of a valid process including quality control testing 4
5 Kleen Products LLC v. Packaging Corporation of America, No. 10 C 5711 (N.D. Ill. Aug 21, 2012) Parties disagreed as to what method to use (keyword searches vs. PC) Validating the results more important than process used Producing party is in better position to judge best method Global Aerospace Inc. v. Landow Aviation, No (Loudoun County, VA. Cir Ct. Apr. 23, 2012) Judge allowed PC over plaintiffs objection Defendants had provided keyword testing results, showing their lack of precision, inconsistencies PC plan would include validation, 75% recall (vs. average human review recall of 59%) Proportionality, reasonable production results In Re: Actos (Pioglitazone) Products Liability Litigation, No. 6:11-md-2299 (W.D. La. July 27, 2012) Parties cooperated on PC method Both sides would review seed set and validation sets jointly 5
6 In Re: Biomet, No. 3:12-MD-2391 (N.D. Ind. Aug. 21, 2013) Defendant used PC after keyword filtering their collection, Plaintiff wanted re-do, PC applied to entire collection Judge ruled no, production acceptable, cost of re-work outweighed benefits Rio Tinto PLC v. Vale, S.A., et al., No. 1:14-cv RMB-AJP (S.D.N.Y. Mar. 2, 2015) Use of TAR largely settled Transparency and cooperation still issues Validation of process can be done with statistical analysis, quality control sampling HOW TO USE PC? Technology Assisted Review Attorneys train the computer Smart prioritization of records More accurate, lower cost Potential cost shifting 6
7 PC WORKFLOW 1. Human Review of seed sets 2. Computer training on relevant documents 3. Iterative review of computer-scored documents 4. Statistical sampling, quality control, validation QUESTIONS? 7
Recent Developments in the Law & Technology Relating to Predictive Coding
Recent Developments in the Law & Technology Relating to Predictive Coding Presented by Paul Neale CEO Presented by Gene Klimov VP & Managing Director Presented by Gerard Britton Managing Director 2012
Intermountain ediscovery Conference 2012
Intermountain ediscovery Conference 2012 From Technology Assisted Review to Twi6er: What Clients, Law Firms, and Vendors Need to Know David Horrigan, 451 Research 451 Research Global research analyst firm
THE PREDICTIVE CODING CASES A CASE LAW REVIEW
THE PREDICTIVE CODING CASES A CASE LAW REVIEW WELCOME Thank you for joining Numerous diverse attendees Please feel free to submit questions Slides, recording and survey coming tomorrow SPEAKERS Matthew
The Truth About Predictive Coding: Getting Beyond The Hype
www.encase.com/ceic The Truth About Predictive Coding: Getting Beyond The Hype David R. Cohen Reed Smith LLP Records & E-Discovery Practice Group Leader David leads a group of more than 100 lawyers in
Technology- Assisted Review 2.0
LITIGATION AND PRACTICE SUPPORT Technology- Assisted Review 2.0 by Ignatius Grande of Hughes Hubbard & Reed LLP and Andrew Paredes of Epiq Systems Legal teams and their outside counsel must deal with an
Electronically Stored Information in Litigation
Electronically Stored Information in Litigation Volume 69, November 2013 By Timothy J. Chorvat and Laura E. Pelanek* I. Introduction Recent developments in the use of electronically stored information
case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION
case 3:12-md-02391-RLM-CAN document 396 filed 04/18/13 page 1 of 7 UNITED STATES DISTRICT COURT NORTHERN DISTRICT OF INDIANA SOUTH BEND DIVISION IN RE: BIOMET M2a MAGNUM HIP IMPLANT PRODUCTS LIABILITY
The United States Law Week
The United States Law Week Source: U.S. Law Week: News Archive > 2012 > 04/24/2012 > BNA Insights > Under Fire: A Closer Look at Technology- Assisted Document Review E-DISCOVERY Under Fire: A Closer Look
Navigating Information Governance and ediscovery
Navigating Information Governance and ediscovery Implementing Processes & Technology to Reduce Downstream ediscovery Cost and Risk Shannon Smith General Counsel, Globanet March 11 12, 2013 Agenda 1 Overview
Traditionally, the gold standard for identifying potentially
istockphoto.com/alexandercreative Predictive Coding: It s Here to Stay Predictive coding programs are poised to become a standard practice in e-discovery in the near future. As more courts weigh in on
The Case for Technology Assisted Review and Statistical Sampling in Discovery
The Case for Technology Assisted Review and Statistical Sampling in Discovery Position Paper for DESI VI Workshop, June 8, 2015, ICAIL Conference, San Diego, CA Christopher H Paskach The Claro Group, LLC
Technology Assisted Review: The Disclosure of Training Sets and Related Transparency Issues Whitney Street, Esq. 1
Technology Assisted Review: The Disclosure of Training Sets and Related Transparency Issues Whitney Street, Esq. 1 The potential cost savings and increase in accuracy afforded by technology assisted review
How Good is Your Predictive Coding Poker Face?
How Good is Your Predictive Coding Poker Face? SESSION ID: LAW-W03 Moderator: Panelists: Matthew Nelson ediscovery Counsel Symantec Corporation Hon. Andrew J. Peck US Magistrate Judge Southern District
PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX?
Vol. 46 No. 3 February 6, 2013 PREDICTIVE CODING: SILVER BULLET OR PANDORA S BOX? The high costs of e-discovery have led to the development of computerized review technology by which the user may search
Technology Assisted Review of Documents
Ashish Prasad, Esq. Noah Miller, Esq. Joshua C. Garbarino, Esq. October 27, 2014 Table of Contents Introduction... 3 What is TAR?... 3 TAR Workflows and Roles... 3 Predictive Coding Workflows... 4 Conclusion...
ediscovery: Trends & Challenges
ediscovery: Trends & Challenges Joseph P. Grasser Carrie E. Jantsch January 28, 2014 Overview Trends & Challenges Mobile Device Electronic Discovery and BYOD Policies How BYOD Policies Complicate E-Discovery
Predictive Coding, TAR, CAR NOT Just for Litigation
Predictive Coding, TAR, CAR NOT Just for Litigation February 26, 2015 Olivia Gerroll VP Professional Services, D4 Agenda Drivers The Evolution of Discovery Technology Definitions & Benefits How Predictive
COURSE DESCRIPTION AND SYLLABUS LITIGATING IN THE DIGITAL AGE: ELECTRONIC CASE MANAGEMENT (994-001) Fall 2014
COURSE DESCRIPTION AND SYLLABUS LITIGATING IN THE DIGITAL AGE: ELECTRONIC CASE MANAGEMENT (994-001) Professors:Mark Austrian Christopher Racich Fall 2014 Introduction The ubiquitous use of computers, the
A Practitioner s Guide to Statistical Sampling in E-Discovery. October 16, 2012
A Practitioner s Guide to Statistical Sampling in E-Discovery October 16, 2012 1 Meet the Panelists Maura R. Grossman, Counsel at Wachtell, Lipton, Rosen & Katz Gordon V. Cormack, Professor at the David
www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence April 2013
www.pwc.nl Review & AI Lessons learned while using Artificial Intelligence Why are non-users staying away from PC? source: edj Group s Q1 2013 Predictive Coding Survey, February 2013, N = 66 Slide 2 Introduction
2015 ANNUAL MEETING Vancouver, BC September 11, 2015. Recent Amendments to the Federal Rules of Civil Procedure: A New Scope of Discovery?
2015 ANNUAL MEETING Vancouver, BC September 11, 2015 Recent Amendments to the Federal Rules of Civil Procedure: A New Scope of Discovery? 2010 DUKE CONFERENCE May 10-11 Duke Law School 200 Participants
Power-Up Your Privilege Review: Protecting Privileged Materials in Ediscovery
Power-Up Your Privilege Review: Protecting Privileged Materials in Ediscovery Jeff Schomig, WilmerHale Stuart Altman, Hogan Lovells Joe White, Kroll Ontrack Sheldon Noel, Kroll Ontrack (moderator) April
Any and all documents Meets Electronically Stored Information: Discovery in the Electronic Age
Any and all documents Meets Electronically Stored Information: Discovery in the Electronic Age Panel Members Judge Ronald L. Buch, Moderator Panelists The Honorable Paul W. Grimm U.S. District Court for
Quality Control for predictive coding in ediscovery. kpmg.com
Quality Control for predictive coding in ediscovery kpmg.com Advances in technology are changing the way organizations perform ediscovery. Most notably, predictive coding, or technology assisted review,
Electronic Discovery How can I be prepared? September 2010
Electronic Discovery How can I be prepared? September 2010 Presented by Brian Wilkinson, Director of ediscovery & Computer Forensics [email protected] 410-659-3473 Table of Contents Page 1 Electronic
E-DISCOVERY AND KEYWORDS: NOT SO KEY AFTER ALL FACE 2 FACE A CONFERENCE FOR LITIGATION SUPPORT CBA - NS FRIDAY, DECEMBER 7, 2012 HALIFAX, NOVA SCOTIA
E-DISCOVERY AND KEYWORDS: NOT SO KEY AFTER ALL FACE 2 FACE A CONFERENCE FOR LITIGATION SUPPORT CBA - NS FRIDAY, DECEMBER 7, 2012 HALIFAX, NOVA SCOTIA HALIFAX MARRIOTT HARBOURFRONT PRESENTATION BY: DANIELA
E-discovery Taking Predictive Coding Out of the Black Box
E-discovery Taking Predictive Coding Out of the Black Box Joseph H. Looby Senior Managing Director FTI TECHNOLOGY IN CASES OF COMMERCIAL LITIGATION, the process of discovery can place a huge burden on
E-Discovery in Michigan. Presented by Angela Boufford
E-Discovery in Michigan ESI Presented by Angela Boufford DISCLAIMER: This is by no means a comprehensive examination of E-Discovery issues. You will not be an E-Discovery expert after this presentation.
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive coding is one of the most promising technologies to reduce the high cost of review by
Minimizing ediscovery risks. What organizations need to know in today s litigious and digital world.
What organizations need to know in today s litigious and digital world. The main objective for a corporation s law department is to mitigate risk throughout the company, while keeping costs under control.
Predictive Coding Helps Companies Reduce Discovery Costs
Predictive Coding Helps Companies Reduce Discovery Costs Recent Court Decisions Open Door to Wider Use by Businesses to Cut Costs in Document Discovery By John Tredennick As companies struggle to manage
Effective Protocols for Reducing Electronic Discovery Costs
Effective Protocols for Reducing Electronic Discovery Costs New Jersey Corporate Counsel Association September 21, 2012 Judge Patty Shwartz James Anelli Brian Halpin William Belt William Johnson Overview
Predictive Coding Defensibility and the Transparent Predictive Coding Workflow
WHITE PAPER: PREDICTIVE CODING DEFENSIBILITY........................................ Predictive Coding Defensibility and the Transparent Predictive Coding Workflow Who should read this paper Predictive
Predictive Coding in Multi-Language E-Discovery
Comprehending the Challenges of Technology Assisted Document Review Predictive Coding in Multi-Language E-Discovery UBIC North America, Inc. 3 Lagoon Dr., Ste. 180, Redwood City, CA 94065 877-321-8242
REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - PRIORITIZATION FOR 100% REVIEW. Bill Tolson Sr. Product Marketing Manager Recommind Inc.
REDUCING COSTS WITH ADVANCED REVIEW STRATEGIES - Bill Tolson Sr. Product Marketing Manager Recommind Inc. Introduction... 3 Traditional Linear Review... 3 Advanced Review Strategies: A Typical Predictive
White Paper Technology Assisted Review. Allison Stanfield and Jeff Jarrett 25 February 2015. 1300 136 993 www.elaw.com.au
White Paper Technology Assisted Review Allison Stanfield and Jeff Jarrett 25 February 2015 1300 136 993 www.elaw.com.au Table of Contents 1. INTRODUCTION 3 2. KEYWORD SEARCHING 3 3. KEYWORD SEARCHES: THE
Electronic Discovery: Litigation Holds, Data Preservation and Production
Electronic Discovery: Litigation Holds, Data Preservation and Production April 27, 2010 Daniel Munsch, Assistant General Counsel John Lerchey, Coordinator for Incident Response 0 E-Discovery Rules Federal
the e-discovery how-to Guide page : 1 The E-Discovery Practical Recommendations for Streamlining Corporate E-Discovery A Clearwell White Paper
the e-discovery how-to Guide page : 1 The E-Discovery How-To Guide: Practical Recommendations for Streamlining Corporate E-Discovery A Clearwell White Paper the e-discovery how-to Guide page : 2 Table
AN E-DISCOVERY MODEL ORDER
AN E-DISCOVERY MODEL ORDER INTRODUCTION Since becoming a staple of American civil litigation, e-discovery has been the subject of extensive review, study, and commentary. See The Sedona Principles: Best
The Predictive Coding Soundtrack: Rewind, Play, Fast-Forward
The Predictive Coding Soundtrack: Rewind, Play, Fast-Forward LEGALTECH NEW YORK February 3, 2015 Moderator: Amy Hinzmann Senior Vice President, DiscoverReady DiscoverReady 2014 THE PANELISTS* Marla Bergman
Information Retrieval for E-Discovery. Contents
Foundations and Trends R in Information Retrieval Vol. 7, Nos. 2 3 (2013) 99 237 c 2013 D. W. Oard and W. Webber DOI: 10.1561/1500000025 Information Retrieval for E-Discovery By Douglas W. Oard and William
Mastering Predictive Coding: The Ultimate Guide
Mastering Predictive Coding: The Ultimate Guide Key considerations and best practices to help you increase ediscovery efficiencies and save money with predictive coding 4.5 Validating the Results and Producing
IN THE UNITED STATES DISTRICT COURT FOR THE WESTERN DISTRICT OF TENNESSEE WESTERN DIVISION
IN THE UNITED STATES DISTRICT COURT FOR THE WESTERN DISTRICT OF TENNESSEE WESTERN DIVISION CANDICE MILLER COOK, Plaintiff, vs. No. 04-2139-Ml V DAVID E. CAYWOOD and DARRELL D. BLANTON Defendants. ORDER
SEVENTH CIRCUIT ELECTRONIC DISCOVERY PILOT PROGRAM FOR DISCOVERY OF ELECTRONICALLY STORED
SEVENTH CIRCUIT ELECTRONIC DISCOVERY PILOT PROGRAM PROPOSED PRINCIPLES FOR DISCOVERY OF ELECTRONICALLY STORED INFORMATION Sean M. Hendricks, J.D. Client Services Manager (312) 893-7321 / [email protected]
Xact Data Discovery. Xact Data Discovery. Xact Data Discovery. Xact Data Discovery. ediscovery for DUMMIES LAWYERS. MDLA TTS August 23, 2013
MDLA TTS August 23, 2013 ediscovery for DUMMIES LAWYERS Kate Burke Mortensen, Esq. [email protected] Scott Polus, Director of Forensic Services [email protected] 1 Where Do I Start??
---------------------------)
IN THE UNITED STATES DISTRICT COURT FOR THE DISTRICT OF SOUTH CAROLINA CHARLESTON DIVISION East Bridge Lofts Property Owners ) Civil Action No. 2: 14-cv-2567-RMG Association, Inc.; Creekstone Builders,
Integration of E-Discovery and FOIA
Integration of E-Discovery and FOIA April 4, 2013 Tom Kennedy Director, Symantec Archiving and E-Discovery Team Digital Government Institute s E-Discovery, Records & Information Management Conference,
Best Practices in Electronic Record Retention
A. Principles For Document Management Policies Arthur Anderson, LLD v. U.S., 544 U.S. 696 (2005) ( Document retention policies, which are created in part to keep certain information from getting into the
To Battle or Not to Battle the EEOC s Recent Tactics Time to Take a Stand!
To Battle or Not to Battle the EEOC s Recent Tactics Time to Take a Stand! Panelists Colleen P. Lewis DINSMORE & SHOHL, LLP Cincinnati, Ohio [email protected] Sharon Bauman MANATT, PHELPS & PHILLIPS,
2015 Ediscovery Case Law and Rules: Year in Review
2015 Ediscovery Case Law and Rules: Year in Review 1 Agenda Top 10 Ediscovery Cases of 2015 Rules Developments California Ethics Opinion Federal Rules of Civil Procedure 2 3 2015 Ediscovery Case Law Case
DSi Pilot Program: Comparing Catalyst Insight Predict with Linear Review
case study DSi Pilot Program: Comparing Catalyst Insight Predict with Linear Review www.dsicovery.com 877-797-4771 414 Union St., Suite 1210 Nashville, TN 37219 (615) 255-5343 Catalyst Insight Predict
