Multimedia Evolution. Ian Smythe Director of Marketing Media Processing Division

Transcription

1 Multimedia Evolution Ian Smythe Director of Marketing Media Processing Division 1

2 The ARM Vision A world in which all electronic products and services are based on energy-efficient technology from ARM, making life better for everyone 2

3 Consumer Entertainment Drivers 3

4 Revolution in Content Consumption Growth in connected devices in the home Major change in how content and services are consumed Killer apps are social networking and video sharing Personalized content driving increased need for transactional security Petabytes per month % of Homes with IP Enabled Devices Sources: Cisco VNI Q4 2009: Futuresource Consulting 4

5 Enabling the Change Infrastructure Global adoption of 3G with 2.8Bn subscribers and ~45% penetration by 2014 Evolution of mobile broadband access from 2G to LTE+ Services moving to the cloud Enabled by multi-service IP networks OEM innovation driving wide range of products into the market 5

6 The Mobile Internet The Internet of Things Minicomputer The PC Internet Mainframe 6

7 Mobile is winning... It s amazing to me that the smartest developers now are writing apps for mobile before they write for Windows or Apple Mac desktop operating systems. Eric Schmidt Google CEO, July

8 On the Move 2014 Mobile Mobile Phone demands Personalized compute platform Advanced video, console quality gaming Navigation with augmented reality Secure transactions All-day battery life Mobile Computing demands Support for rich internet applications Secure transactions Continual innovation in UI and form factors High speed wireless data access All-day battery life 8

9 Mobile 1956: H Osborne of AT&T 9

10 1924: Google and 1935 Twitter 10

11 Social Media changing the world 11

12 THE IMPACT OF IMMEDIATE ACCESS ON MULTIMEDIA EVOLUTION 12

13 GPUs Everywhere Anything with a screen Graphics acceleration is key Software is a necessity 13

14 Graphics demands increasing Per-pixel depth of field effects YUV texturing to pull video into graphics pipeline...including realtime contrast, brightness and saturation adjustment Per-pixel diffraction effects More complex effects require more processing... Same number of output pixels, but more work done for each pixel For example, a dual core ARM Mali -400 MP can perform 20 shader operations per cycle...in addition to texture filtering, blending, anti-aliasing... realtime contrast, brightness and saturation adjustment with YUV texturing to 275MPix/s 14

15 Insatiable Performance Requirement Screen resolution: 4.3x increase in number of pixels WVGA WXGA 1080p Increasing content complexity: >10x increase in processing per pixel OpenGL ES 1.1 Samurai (Complexity=1) OpenGL ES 2.0 Taiji (Complexity=5) Desktop (Complexity=10) >40x increase in graphics processing With power budget suitable for handheld. 15

16 The Gaming Experience Complex content (geometry, texture data, etc ) Smooth gameplay through high framerates Improved anti-aliasing techniques Realistic environments, water reflections, shadows, bump mapping, environment mapping, etc... 16

17 The UI Experience User interfaces exploit Mali GPU Overlay and alpha blending Complex Transitions Animated icons Applicable for phones, TVs, set top boxes, car dash boards - anything with a screen 17

18 A World of Infinite Content Internet everywhere Broadcast, pay-per-view, pre-recorded, web content, user generated content, video conferencing Almost infinite array of content How to personalize and simplify access? How to draw consumers to directed advertising? Good, intelligent user interface design Critical for any screen-based solution 18

19 ARM Graphics Architecture Design principles Tile-based deferred rendering is the right choice for power-efficient design Multicore delivers true performance scalability Focus on compute performance for advanced content Common ISA and software driver across a family of GPUs Delivering industry leadership Performance, memory bandwidth, area and power efficiency Constant innovation New GPU product on regular tick 2x increase in performance / year Common software driver to protect software investment Improved performance per core in each generation Increased architectural efficiency (performance/area and power) 19

20 Multicore Performance Scalability Mali-400 MP World s 1st embedded multicore GPU Khronos OpenVG 1.1, OpenGL ES 2.0 support Separate vertex (geometry) and fragment (pixel) Multicore performance scalability 1 to 4 fragment processors Near-linear performance scaling in real systems Delivers in excess of 1G visible* pixels/s Single, optimized software driver for all configurations Multicore performance at 1080p Relative Performance processing for maximum parallel throughput Industry-leading memory bandwidth efficiency Level 2 cache reduces memory bandwidth and system-level power consumption Number of cores * No artificial overdraw assumptions 20 OpenGL ES 2.0 OpenGL ES 1.1

21 Mali & Stereoscopic 3D ARM have already demonstrated Stereoscopic 3D on both Mali-200 and Mali-400 platforms at HD 720p No changes to Mali driver stack required to achieve stereo 3D Essentially Stereoscopic 3D represents an increased performance load on the GPU as more pixels need to be processed Demo details: Mali renders the entire world twice per frame at 30 frames per second Mali-200 driving HD720p, 1280x720 horizontal split Triangle count 16,000 (8,000 per eye) / frame Average pixel shader complexity : 2-6 cycles per pixel draw, 5% - 10% overdraw 21

22 Summary Bewildering array of content available Increasingly complex content and more and more interaction Good UI design allows personalization and simplifies access to content GPU is a must-have for connected screens Use of 3rd dimension & the Apple effect for UI HD screens demand very high pixel throughput & bandwidth ARM s partners deploying GPUs today in wide range of devices Bringing the multimedia evolution to you 22

23 Want to know more? See Mali demos from our partners Amlogic: Android 2.2 Quake demo STM: Sti7108 demo Arphic: 3D font demo on SmartQ Brogent: 3D UI on SmartQ Digimax: Bare eye Stereoscopic 3D TV Rightware: UI demo TAT: UI demo Come and see us: Mali-400 tablet demo (TAT) SmartQ raging thunder 2, Stereoscopic game BruteForce 23

24 ...or go to Mali Developer Center Full range of Mali developer resources Tools, Development boards, Demos, Examples, Tutorials 24

25 QUESTIONS 25