IoT: Smart Vision Leads The Way

Transcription

1 IoT: Smart Vision Leads The Way Peter McGuinness Multimedia Technology Marketing

2 IoT is changing from amorphous to concrete: Imagination Technologies US Summit May

3 IoT is changing from amorphous to concrete: We have had several years now to learn what IoT is. Covers an enormous application space Technology space is much more limited Camera Actuator Gyro Wireless comms Imagination Technologies US Summit May

4 IoT basic technology set. Sensing, understanding and interpreting unconstrained real world data Sensing Computation Communication Actuation Camera Actuator Gyro Wireless comms Imagination Technologies US Summit May

5 Camera - led applications Vision enabled apps are becoming dominant wherever detailed interaction with the real world is needed. Home security ADAS Retail Analytics Robotic Telepresence Home automation Personal medicine Imagination Technologies US Summit May

6 Camera - led applications Vision enabled apps are becoming dominant wherever detailed interaction with the real world is needed. Home security ADAS Retail Analytics Telepresence Home automation Personal medicine Imagination Technologies US Summit May

7 Where to locate the intelligence? In the cloud or on the device? Reliability Efficiency In general, there is a need to place the intelligence as close to the sensor as possible. Responsiveness Imagination Technologies US Summit May

8 Intelligent Vision is a continuing challenge Two main axes of development: image quality and vision functionality. Larger formats Greater bit depth Higher dynamic range Better low light performance Faster response times Greater functionality Recognition vs detection GOPS B/W Power/OP 1 VGA SVGA HD UHD Imagination Technologies US Summit May

9 Driving to a technology solution Ultra-efficient hardware with optimised software CPU / Multicore GPU / Heterogeneous Image-dedicated ISP Vision-oriented ISP Soft / flexible codecs Hardware optimised codecs Ad-hoc / opportunistic compression Interoperable memory compression Imagination Technologies US Summit May

10 PowerVR Vision IP Platform Whole-system approach to multimedia subsystem design PowerVR Vision IP Platform Re-entrant vision functions path Customer H/W Vision Processing MIPI Image streaming path Statistics feedforward path Multiple sensor inputs PowerVR Raptor Camera ISP Compressed memory i/f PowerVR Graphics GPU IP Compressed memory i/f PowerVR Video/Still Encoder IP Compressed memory i/f Encoded Video Output Image stream and statistics GPU Compute path Statistics assisted encode path SoC Fabric Imagination Technologies US Summit May

11 PowerVR unique system-level features Leveraging breadth of PowerVR IP: the whole is more than the sum of its parts. Direct I/O Hardware Zero copy Hardware Zero Memory Statistics feedforward Imagination Technologies US Summit May

12 and finally: Software. Software can make or break the system Open standard, optimised software. PowerVR SDK with development and performance optimisation tools plus programmers guide for GPU compute on PowerVR GPUs Powerful imaging framework available to IP licensees and OEM partners. Imagination Technologies US Summit May

13 Real world interaction is driven by sensors Smart camera is at the forefront Vision presents significant challenges Focus of compute is moving from CPU to heterogeneous components, primarily GPU today. Imaging pipeline changing to support vision functions System level challenges of power and bandwidth must be solved Significant advantages can be gained by using components designed specifically to work together. Standards based software is key to a vision ecosystem PowerVR vision platform addresses these issues Imagination Technologies US Summit May

14 Thank You!