Nasir Memon Polytechnic Institute of NYU



Similar documents
Data Distribution Algorithms for Reliable. Reliable Parallel Storage on Flash Memories

High-Performance SSD-Based RAID Storage. Madhukar Gunjan Chakhaiyar Product Test Architect

Solid State Drive Architecture

NAND Flash FAQ. Eureka Technology. apn5_87. NAND Flash FAQ

Solid State Drive (SSD) FAQ

NAND Flash Architecture and Specification Trends

Technologies Supporting Evolution of SSDs

Indexing on Solid State Drives based on Flash Memory

Choosing the Right NAND Flash Memory Technology

Understanding endurance and performance characteristics of HP solid state drives

Sistemas Operativos: Input/Output Disks

NAND Flash & Storage Media

Embedded Operating Systems in a Point of Sale Environment. White Paper

Solid State Drive Technology

COS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University. (

SATA SSD Series. InnoDisk. Customer. Approver. Approver. Customer: Customer. InnoDisk. Part Number: InnoDisk. Model Name: Date:

File System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System

Flash for Databases. September 22, 2015 Peter Zaitsev Percona

SSDs tend to be more rugged than hard drives with respect to shock and vibration because SSDs have no moving parts.

Comparison of NAND Flash Technologies Used in Solid- State Storage

File System Management

SSD Performance Tips: Avoid The Write Cliff

SATA II 3Gb/s SSD. SSD630 Benefits. Enhanced Performance. Applications

File Systems for Flash Memories. Marcela Zuluaga Sebastian Isaza Dante Rodriguez

HP 80 GB, 128 GB, and 160 GB Solid State Drives for HP Business Desktop PCs Overview. HP 128 GB Solid State Drive (SSD)

Linux flash file systems JFFS2 vs UBIFS

How To Improve Write Speed On An Nand Flash Memory Flash Drive

DELL SOLID STATE DISK (SSD) DRIVES

Price/performance Modern Memory Hierarchy

This page is a hidden page. To keep from printing this page, uncheck the checkbox for printing invisible pages in the printing dialog box.

NAND Basics Understanding the Technology Behind Your SSD

HP 128 GB Solid State Drive (SSD) *Not available in all regions.

1 / 25. CS 137: File Systems. Persistent Solid-State Storage

Flash Memory. Jian-Jia Chen (Slides are based on Yuan-Hao Chang) TU Dortmund Informatik 12 Germany 2015 年 01 月 27 日. technische universität dortmund

The Technologies & Architectures. President, Demartek

SLC vs. MLC: An Analysis of Flash Memory

How To Write On A Flash Memory Flash Memory (Mlc) On A Solid State Drive (Samsung)

SOLID STATE DRIVES AND PARALLEL STORAGE

COS 318: Operating Systems. Storage Devices. Kai Li and Andy Bavier Computer Science Department Princeton University

Intel Solid-State Drive 320 Series

QuickSpecs. HP Solid State Drives (SSDs) for Workstations. Overview

Chapter Introduction. Storage and Other I/O Topics. p. 570( 頁 585) Fig I/O devices can be characterized by. I/O bus connections

SSDs tend to be more rugged than hard drives with respect to shock and vibration because SSDs have no moving parts.

SSDs tend to be more rugged than hard drives with respect to shock and vibration because SSDs have no moving parts.

Serial ATA Flash Drive

A New Chapter for System Designs Using NAND Flash Memory

Serial ATA Flash Drive

Memoright SSDs: The End of Hard Drives?

SSD Update Part Four. Jeff Hedlesky, Guidance Software Chris Bross, DriveSavers

Programming NAND devices

Serial ATA Flash Drive

Lecture 16: Storage Devices

HP Z Turbo Drive PCIe SSD

USB Flash Drive. RoHS Compliant. AH321 Specifications. June 4 th, Version 1.4. Apacer Technology Inc.

Building Embedded Systems

SSDs tend to be more rugged than hard drives with respect to shock and vibration because SSDs have no moving parts.

USB Flash Drive. RoHS Compliant. AH322 Specifications. July 2 nd, Version 1.2. Apacer Technology Inc.

Flash-optimized Data Progression

SSDs and RAID: What s the right strategy. Paul Goodwin VP Product Development Avant Technology

NAND Flash Architecture and Specification Trends

Addressing Fatal Flash Flaws That Plague All Flash Storage Arrays

RoHS Compliant SATA High Capacity Flash Drive Series Datasheet for SAFD 25NH-M

Trabajo Memorias flash

HP 80 GB, 128 GB, and 160 GB Solid State Drives for HP Business Desktop PCs Overview. HP 128 GB Solid State Drive (SSD)

An Overview of Flash Storage for Databases

UBIFS file system. Adrian Hunter (Адриан Хантер) Artem Bityutskiy (Битюцкий Артём)

Industrial Flash Storage Trends in Software and Security

Outline. CS 245: Database System Principles. Notes 02: Hardware. Hardware DBMS Data Storage

Introduction to I/O and Disk Management

Implementation and Challenging Issues of Flash-Memory Storage Systems

A NOR Emulation Strategy over NAND Flash Memory

Frequently Asked Questions March s620 SATA SSD Enterprise-Class Solid-State Device. Frequently Asked Questions

Industrial Grade Embedded Flash Storage Devices

NAND Flash Memories. Understanding NAND Flash Factory Pre-Programming. Schemes

With respect to the way of data access we can classify memories as:

AES 256-BIT HARDWARE ENCRYPTED USB FLASH DRIVES & SSD

Calsoft Webinar - Debunking QA myths for Flash- Based Arrays

Solid State Technology What s New?

enabling Ultra-High Bandwidth Scalable SSDs with HLnand

Flash 101. Violin Memory Switzerland. Violin Memory Inc. Proprietary 1

NAND 201: An Update on the Continued Evolution of NAND Flash

Industrial Flash Storage Module

Solid State Storage in Massive Data Environments Erik Eyberg

760 Veterans Circle, Warminster, PA Technical Proposal. Submitted by: ACT/Technico 760 Veterans Circle Warminster, PA

1 Gbit, 2 Gbit, 4 Gbit, 3 V SLC NAND Flash For Embedded

Disks and RAID. Profs. Bracy and Van Renesse. based on slides by Prof. Sirer

Flash In The Enterprise

Important Differences Between Consumer and Enterprise Flash Architectures

In-Block Level Redundancy Management for Flash Storage System

RAID Implementation for StorSimple Storage Management Appliance

Rugged & Reliable Data Storage Solid-State State Flash Disk overview

Data Storage and Backup. Sanjay Goel School of Business University at Albany, SUNY

Database!Fatal!Flash!Flaws!No!One! Talks!About!!!

Benefits of Solid-State Storage

Overview 2.5 & 1.8 Industrial SSD SATADOM mini PCIeDOM SATA Slim CF Card & EDC CF-SATA & CFast. Embedded Flash Storage

Transcription:

Nasir Memon Polytechnic Institute of NYU

SSD Drive Technology Overview SSD Drive Components NAND FLASH Microcontroller SSD Drive Forensics Challenges

Overview SSD s are fairly new to the market Whereas HDD s are well understood SSDs propose new challenges to forensics Purpose Understand how SSDs function and understand the challenges of performing a forensics investigation.

Will replace HDD Drives Faster reads Faster writes Are small Use less energy Create less heat Are more expensive The price has been decreasing

Source: http://www.samsung.com 2.5 SATA 3.8Gbps SSD 2.5 SATA 3.8Gbps HDD Solid NAND Flash based Mechanism type Magnetic rotating platters 64GB Density 80GB 73g Weight 365g Read: 100MB/s Write: 80 MB/s Performance Read: 59MB/s Write: 60MB/s 1W Active Power Consumption 3.86W 20G (10~2000Hz) Operating Vibration 0.5G (22~350Hz) 1500G for 0.5ms Shock Resistance 170G for 0.5ms 0 C 70 C Operating temperature 5 C 55 C None Acoustic Noise 0.3 db MTBF > 2M hours Endurance MTBF < 0.7M hours

This can be Operating system File System FAT NTFS Journaling File System Can be implemented in Hardware or Software SSDs do it in hardware (using Micro controller) xd Memory Cards (do it in the Driver) Interface to Hardware through SATA or IDE Source: https://www.ibm.com/developerworks/linux/library/l- flash- filesystems/

Flash Memory NOR Flash vs. NAND Flash MLC vs. SLC Limited Erase- write cycles Read accuracy decreases after a certain number of reads. Implement techniques to overcome technology differences COPYBACK (Read accuracy), ECC Wear leveling (Limited Erase- write cycles)

NAND GATE NOR GATE

SLC NAND Flash (x8) MLC NAND FLASH (x8) MLC NOR Flash (x16) Density 512Mb 4Gb 1Gbit to 16Gbit 16Mbit 1Gbit Read Speed 24 MB/s 18.6 MB/s 103MB/s Write Speed 8.0 MB/s 2.4 MB/s 0.47 MB/s Erase Time 2.0 msec.. 2.0 msec. 900 msec. Interface I/O indirect access I/O indirect access Random access Application Program/Data mass storage Program/Data mass storage exectue In Place (XIP) 1. http://www.toshiba.com/taec/components/generic/memory_resources/nandvsnor.pdf

High Density Lower Cost Per Bit Higher Endurance Greater Operating Temperature Range Lower Power Consumption Better Write/Erase Speeds Better Write/Erase Endurance SLC X X X X X MLC X X

Implementation Overview

TSOP 48 PINS LGA- 52 PAD BGA- 100 TSOP 48 is most common in most electronics, such as MP3 Players, USB sticks, Solid State Drives, Switches, Routers and the like.

Manufacturers can use any kind of interface that they want, but a group of companies created a consortium for NAND to standardize the industry. Open NAND Flash Interface Working Group http://onfi.org/ ONFI Specification 2.1 http://onfi.org/wp- content/uploads/2009/02/ onfi- 2_1- gold.pdf

Form Factor Memory Addressing Pin outs Timing Command Set This is good for Forensics Analysis

Pages are basic programmable units of flash 512 bytes, but likely 2048 bytes 16 bytes per 512 bytes for ECC and management 2048 => 64 bytes 2112 bytes per page, but only 2048 useable

Blocks are basic erasable blocks Generally 64x pages per block 2048/64 *64 bytes 131072/4096 bytes per block

512 Bytes 16 Bytes Data Information Can be addressed by the OS Management & ECC Not seen by OS 2048 Bytes 64 Bytes Block: 64 Pages Block: 64 Pages Block: 64 Pages Flash Chip

Reading Each read operation introduces a potential error After several reads to the same location, there is some chance of error for consecutive reads from that location. Writing Two types of operation to facilitate Writing Set all bits to 1 (Erase) Set bits from 1 to 0. (Program) Cannot set bits from 0 to 1, must reset all bits to one (Erase) To write a block, must erase (set all bits to 1), then program (set appropriate bits to 0). To rewrite, must always use the erase program cycle.

Basic Algorithms Source: Micron TN- 29-42: Wear- Leveling Techniques in NAND Flash Devices

Wear leveling helps reduce premature wear in NAND Flash devices. Each Erase operation reduces life of device and makes it more vulnerable to read decay. Generally: 10,000 or 100,000 erase cycles Two primary wear leveling techniques static dynamic

Spread the drive wear across the entire drive Ensure that all blocks fail at approximately the same time Don t allow some of the blocks to fail faster than others. Causes Severe Fragmentation Can dramatically reduce read and write speed of sequential reads.

LBA 0x00000000 0x00000001 0x00000002 0x00000003 0x00000004 0x0FFFFFFD 0x0FFFFFFE 0x0FFFFFFF PBA 0x00000000 0x00000001 0x20000002 0x00000003 0x20000004 0x2FFFFFFD 0x3FF000FE 0x4FF000FF Host Use Logical Block Addressing (LBA) Controller Has Look Up Table Translates between LBA and PBA NAND Flash Uses Physical Block Addressing (PBA)

Dynamic When allocating blocks, choose a least erased block from free list Static When allocating blocks, choose a least erased block from free list Occasionally Move static non- free blocks with low erase count (below a threshold) to a block with a high erase count Hybrid Allocate a portion of the drive for static wear leveling Allocate a portion of the drive for dynamic wear leveling

Method Advantages Disadvantages Static Dynamic Maximizes device life Most robust wear- leveling method Most efficient use of memory array Improves device life vs. no wear leveling Easier to implement than static wear leveling No impact on device performance Requires more controller overhead Can slow WRITE operations Higher power consumption More complicated to implement than dynamic wear leveling May not optimize device life

http://www.insidehw.com/reviews/storage/ Intel- X25- M- SSD.html Certified for 25 MB/s read speed and 70 MB/s write speed. MLS SSD standard. 10- channel memory controller. Each channel is responsible for two memory chips. This controller works like a RAID 0 system but with flash memory.

Solid State Drive SATA Data Interface Internal Architecture SATA Power Interface SPI Flash Cache Microcontroller NVRAM Permanent Storage Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip Flash Chip

IO Microcontroller Intel PC29AS21AA0 (Unknown Chip Specification) i0837 Description: Possibly the Intel 8051 architecture Possibly 8 bit architecture Possibly like the SST SPI Flash Cache Winbond 25X40AVNIG Description: 512KB SPI NAND Flash Serial data access 8x64KB blocks 128x4KB sectors 2048x256B pages 256 pages per block 16 sectors per block Serial ATA Flash Storage Intel 29F32G08CAMCI (Suspected Micron MT29F32G08) i0838i5 (8/4) [front/back] i0838i7 (2/6) [front/back] Description: Single Supply 32Gbx8 NAND Flash 2048 + 64 byte pages (2112) 64 pages per block 32 blocks per chip (4GB storage with 8- bit access) NV RAM Samsung 843 K4S281632K- UC60 16MB SDRAM Serial ATA Power

Quick Analysis Microcontroller Likely based on 8051 architecture by Intel Probably has Internal ROM SPI Flash most likely contains either ROM Tables for keeping track of Wear Leveling. Flash Storage More than likely Intel outsourced from Micron NVRAM Likely used for quick writes or writes to the same blocks. A similar setup is recommended by Micron in one of it s whitepapers.

IDE interface allows logical data reads, but hides the internal data structures. Internals not well understood - may contain hidden data useful in forensics. No accepted standards Every manufacturer does what it wants Manufacturers protect their implementation details to prevent data reads.

Wear leveling algorithms fragment data on the drive, but in an unpredictable way (non- standard) NAND flash technology in SSDs, doesn t allow for the same forensics tricks to be used as with HDDs Drive has spare blocks which cannot be read. X25-7% to 8%. Even more in enterprise version. Mostly no slack space as entire block erased before write Garbage collection clears blocks marked for deletion Turn the hard drive off to prevent garbage collection

As soon as you do a write, a block gets allocated and always stays allocated. When you delete a file, it is only "deleted" in the file system, but the hard drive block stays allocated. The trim command is proposed so that the hard drive microcontroller knows to also deallocate the block (free it.)

Once you DISCARD/UNMAP sector X, the device can return any state on the next read of that sector, but must continue to return that data until sector is rewritten Latest draft: If TPRZ bit set then the return for an unmapped block is always zero. If TPRZ isn't set, it's undefined but consistent.

Hard to read data off chips directly Even if you do, hard to make sense of it Requires some very sophisticated carving technology Needs to be content based SmartCarving?

Recovers multi- fragmented files Scales to millions of blocks Keys to success: Collation Matching metrics Linear time heuristics for reassembly For more www.digital- assembly.com