Side-Channels in the 21st Century: Information Leakage From Smartphones

Similar documents
Cbeyond Communicator for TotalCloud Phone System for Mobile (Android)

Speech Signal Processing: An Overview

SMARTPHONE AS NOISE LEVEL METER? Jacopo Fogola, Stefano Masera, Vincenzo Bevacqua Environmental Protection Agency - Piedmont Region, Turin, Italy

Sensor Fusion Mobile Platform Challenges and Future Directions Jim Steele VP of Engineering, Sensor Platforms, Inc.

WATTLE. Adobe Connect 9.4 Upgrade Key Differences. Author: Jo Jo Maung, Business Analyst, ITS Version: 1.3 Date: 16 September 2015.

Adobe Connect Support Guidelines

Evaluation of Smartphone Sound Measurement Apps

Introduction to Android Development. Ed Burnette

Understanding Dynamic Range in Acceleration Measurement Systems. February 2013 By: Bruce Lent

MICROPHONE SPECIFICATIONS EXPLAINED

Mobile Operating Systems & Security

PROFESSIONAL DIGITAL TWO-WAY RADIO MOTOTRBO ANYWHERE. for ios USER GUIDE

ADXL345-EP. 3-Axis, ±2 g/±4 g/±8 g/±16 g Digital Accelerometer. Enhanced Product FEATURES GENERAL DESCRIPTION ENHANCED PRODUCT FEATURES APPLICATIONS

Mobile App Development Using App Inventor

E0-245: ASP. Lecture 16+17: Physical Sensors. Dipanjan Gope

APP DEV. We build your ideas into web and mobile applications. steicho. Technological Solutions

You don t hear me but your phone s voice interface does. José LOPES ESTEVES & Chaouki KASMI

Sound Pressure Measurement

What Smartphones and Tablets are supported by Smart Measure PRO?

BUSINESS PROTECTION. PERSONAL PRIVACY. ONE DEVICE.

Spontania User Setup Guide

McAfee Multi Access from ø. Step-by-step guide to protecting your devices. Always.

User Guide FFFA

Investigating sensors support in a tablet

boundary free tv As part of our Boundary Free TV promise, Mediacom is proud to introduce HBO GO & MAX GO, the new streaming services from HBO.

AM-1. AM-1 Setup Guide for the Polycom Video Conferencing Systems QUICK SETUP GUIDE

SwannEye HD Plug & Play Wi-Fi Security Camera Quick Start Guide Welcome! Lets get started.

SENSORS ON ANDROID PHONES. Indian Institute of Technology Kanpur Commonwealth of Learning Vancouver

About Sectra Communications

Mobile Device Support Model

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Using Your Fitting Software This guide provides comprehensive, task-based information about all the fitting software features.

Business Protection. Personal Privacy. One Device. Enhanced Security for Your Network and Business Intelligence.

Eagle Mobility Mobile Banking Application

Setup Guide-Mobility ActiveSync Hosted Exchange Configuration

A Microphone Array for Hearing Aids

FAQ OLYMPUS DICTATION SMARTPHONE APPLICATION

Workshop Perceptual Effects of Filtering and Masking Introduction to Filtering and Masking

Supported Operating Systems and Browsers Phone Channel

Brainloop Secure Dataroom Version QR Code Scanner Apps for ios Version 1.1 and for Android

Here s your guide to easy installation. Get the most out of Verizon High Speed Internet.

Tonal Detection in Noise: An Auditory Neuroscience Insight

How to setup the UCW232C Serial WiFi adapter

Bluecoin - Voice and Music Over an Embedded BLE Platform. Central Labs AST Robotics

Data Security of Mobile Phones, from the Aspect of University Students

Technology Services Group Procedures. IH Anywhere guide. 0 P a g e

Comparison of the Response of a Simple Structure to Single Axis and Multiple Axis Random Vibration Inputs

Fiserv. Hardware Requirements Browser Support Channel Support. Maximum OS Version Support. Version Support

Leveraging Smartphone Hardware Capabilities for Alternative Authentication

Analog Representations of Sound

BIT COMMANDER. Serial RS232 / RS485 to Ethernet Converter

Mobile Fragmentation. FIA Aalborg, 10 May 2011 Philippe COUSIN WP2 Leader, ETSI Thanks to Cuihtlauac ALVARADO WP1 Leader, ORANGE

How To Track A Phone From A Cell Phone With Power Analysis

Username: Password: your password. Domain Name: EXCH026. Server Name: EAST.EXCH026.serverdata.net

"It's a Phone First! How to Test Your Five-star Mobile Apps"

How To Use The Elena Mobile App

DAKTON µ BOX MANUAL µbox User Manual 1

MOTIV. Digital Microphones and Recording Solutions PLUG AND PLAY RECORDING, AT HOME ANYWHERE.

Opalum FLOW series Opalum STREAM series Wireless setup guide. Wireless setup guide


Setup Guide-Mobility. ActiveSync Hosted Exchange Configuration

Introduction to Android

Pebble. E-Paper Watch for iphone and Android. 1 Button A. 4 Button B. 5 Button C. 2 Display. 6 Button D. 3 Charge Port

Compatibility Testing for Mobile Apps and Websites

How to Remotely Track Any Lost Smartphone, Tablet, or PC

01. Introduction of Android

Android Concepts and Programming TUTORIAL 1

PERCENTAGE ARTICULATION LOSS OF CONSONANTS IN THE ELEMENTARY SCHOOL CLASSROOMS

Troubleshooting Tools to Diagnose or Report a Problem February 23, 2012

Release Notes: Onsight Connect for Android Software Release Notes. Software Version Revision 1.0.0

Radio R 4.0 IntelliLink Frequently Asked Questions

Stream Boost: All About That Bass

...Some people / organizations will be a target REGARDLESS of what they do, but most will be a target / victim BECAUSE of what they do

BroadTouch Business Communicator

Securely Yours LLC We secure your information world. www. SecurelyYoursllc.com

Mobile web apps: The best option for business? A whitepaper from mrc

UB1 P R O F E S S I O N A L M I C R O P H O N E S

AIR RESONANCE IN A PLASTIC BOTTLE Darrell Megli, Emeritus Professor of Physics, University of Evansville, Evansville, IN dm37@evansville.

Getting Started with Adobe Connect. Div of IT Learning Technologies

The 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, / X

Guest Quick Guide PC and Mac Users Updated to version March 2015

類 比 與 MEMS 感 測 器 啟 動 智 慧 新 生 活 The Smart-World Started with ST (Analog, MEMS and Sensors)

Mobile Apps: What Consumers Really Need and Want. A Global Study of Consumers Expectations and Experiences of Mobile Applications

Dynamic Android Sensor HAL

Evaluating Real-World Hearing Aid Performance in a Laboratory

Module 1: Sensor Data Acquisition and Processing in Android

Tutorial on Smartphone Security

Mastering Mobile Web with 8 Key Rules. Mastering Mobile Web with 8 Key Rules

WEARIT DEVELOPER DOCUMENTATION 0.2 preliminary release July 20 th, 2013

Mobile Tablet Devices

, ACTIVITY AND, SLEEP TRACKING SMARTWATCH

APP CLOCK INTRODUCTION

Early vs. Late Onset Hearing Loss: How Children Differ from Adults. Andrea Pittman, PhD Arizona State University

Radio Interface Setup

InvenSense MPU Axis Accelerometer Gyroscope MEMS Motion Sensor

Sectra Communications ensuring security with flexibility

Application Note IMU Visualization Software

ipad, a revolutionary device - Apple

Step-by-Step RECD Guide

Transcription:

SESSION ID: MBS-F01 Side-Channels in the 21st Century: Information Leakage From Smartphones Gabi Nakibly, Ph.D. National Research & Simulation Center Rafael Advanced Defense Systems Inc. gabin@rafael.co.il Yan Michalevsky Stanford University yanm2@cs.stanford.edu

Side-Channel Attacks on Mobile Devices 2

Session s Main Points Mobile devices are susceptible to information leakage in weird and unexpected ways. Rogue applications might do harm even if they have few permissions. The bottom line: treat every app you install as having root on the phone. After this presentation you will think twice before installing a harmless game from an unofficial market having zero permissions. 3

Sensor ID: Mobile Device Identification via Sensor Fingerprinting H. Bojinov, Y. Michalevsky, G. Nakibly and D. Boneh

Mobile device identification The research question: Can an app (or a website) identify the device on which it runs? Answer: Yes! Android: Device ID, Serial number, MAC Address, ANDROID ID. ios :UDID, identifierforvendor, advertisingidentifier, MAC Address.

Mobile device identification (cont.) However, all of these standard identifiers either require the user's permission can be changed by the user does not survive factory reset not good for all mobile device types can not be used by a web application 6

The Basic Idea Each sensor has a tiny inaccuracy that is very specific to it. Such inaccuracies can be used to fingerprint the device. 7

Accelerometer Measures the acceleration of the phone in all three directions. 8

Accelerometer Skew a m =a t S+O measured acceleration actual acceleration sensitivity (ideally = 1) offset (ideally = 0) 9

But how can we measure S and O? We need some reference acceleration 10

11

Measuring S and O As a first step we tried to identify S and O for the Z axis 12

Measuring S and O Measure the acceleration face up and then face down and then do some calculations 13

Initial Experiment for 17 iphones 14

Results for 10,000(!) phones An estimated 7.5 bits of identification. If we can measure S and O for all three axes we can get 3*7.5 = 22.5 bits of identification. 15

Measuring S and O for all axes A phone does not usually stand up Alternatively, we can measure the phone is 6 resting positions. 16

Measuring S and O for all axes And then do some math. 17

Accelerometer is not alone Other sensors can also be fingerprinted For example, the microphone 18

Microphone Each microphone has a characteristic frequency response curve 19

How can we fingerprint a microphone? We need some audio reference. We can use.the phone s speaker 20

Experiment for 16 Motorola Droids 21

SendorID Conclusions We have founds ways to construct a device ID by sensor fingerprinting. All the sensors fingerprints may sum up to enough bits to identify all devices. It is hardware dependent. It can be used by web application. 22

Gyrophone: Recognizing Speech from Gyroscope Signals Y. Michalevsky, G. Nakibly and D. Boneh

Scenario People are talking in the vicinity of a mobile device 24

Microphone vs. Gyroscope Access Requires permission Does NOT require permission 25

MEMS Gyroscopes Major Vendors: STMicroelectronics (Samsung Galaxy) InvenSense (Google Nexus) 26

Gyroscopes are susceptible to sound 70 Hz tone PSD 50 Hz tone PSD 27

Gyroscopes are (lousy, but still) microphones Hardware sampling frequency: InvenSense: up to 8000 Hz STM Microelectronics: 800 Hz Software sampling frequency: Android: 200 Hz ios: 100 Hz Very low Signal-to-Noise ratio (SNR) Acoustic sensitivity threshold: ~70 db Comparable to a loud conversation Sensitive to sound angle of arrival Directional microphone (due to 3 axes) 28

Browsers allow gyroscope access too WebKit Gecko Applications based browsers 29

Problem: How do we look into higher frequencies? Adult Male Adult Female Speech Range 85 180 Hz 165 255 HZ 30

We can sense higher frequencies signals Due to aliasing Recording tones between 120 to 160 Hz on a Nexus 7 device 31

Experimental setup Room. Simple Speakers. Smartphone. Subset of TIDIGITS corpus 10 speakers 11 samples 2 pronunciations = 220 total samples 32

Speech analysis using a single Gyroscope Gender identification Speaker identification Isolated word recognition Speaker independent Speaker dependent 33

We can successfully identify gender Nexus 4 84% Galaxy S3 82% Random guess probability is 50% 34

Nexus 4 A good chance to identify the speaker Mixed Female/Male 50% Female speakers 45% Male speakers 65% Random guess probability is 20% for one gender, and 10% for a mixed set 35

Nexus 4 Isolated word recognition (speaker independent) Mixed Female/Male 17% Female speakers 26% Male speakers 23% Random guess probability is 9% 36

Isolated word recognition (speaker dependent) Nexus 4 Male speaker 65% Random guess probability is 9% 37

Can we use multiple devices to improve the method? Answer: Yes. Raising speaker dependent recognition rate to 77%. 38

Defenses

Software Defenses Low-pass filter the raw samples 0-20 Hz range might be enough for browser based applications (learning from Web-Kit s example) Access to high sampling rate should require a special permission Can possibly be applied by software providers / open-source community 40

Hardware Defenses Hardware filtering of sensor signals (not subject to configuration) Acoustic masking Can possibly be applied by vendors 41

More details can be found here crypto.stanford.edu/gyrophone 42

To conclude We believe this is only the beginning Many more unexpected information leakages will be found in coming years. Treat every app you install as having root on the phone! Now we know you will think twice before installing that harmless game. 43

Questions? Yan Michalevsky yanm2@cs.stanford.edu Gabi Nakibly gabin@rafael.co.il 44