Easy! D3 Intelligent Camera Platform

Transcription

1 Easy! D3 Intelligent Camera Platform Intelligent Cameras Framegrabbers Made in Germany

2 Ease of Use The D3 Intelligent Camera The D3 Industrial Camera has a rigid aluminum body and industry-standard interfaces such as 24 V power supply and Power over Ethernet. New Intelligent Camera Platform The D3 is the latest, most advanced intelligent camera generation by VRmagic. The D3 platform was designed with usability, flexibility, and performance in mind. Excellent Usability The D3 platform runs a wide range of embedded software and libraries, such as Common Vision Blox Embedded, EyeVision, or HALCON Embedded. This way you can easily take advantage of the latest, stateof-the-art machine vision algorithms. Additionally, the new Mono compatible.net interface makes application development with the VRmagic SDK much easier. Software development for the D3 intelligent camera platform that s ease of use. Built-In Flexibility The D3 s embedded system provides users with a high level of flexibility by supporting a multitude of interfaces, such as Ethernet, USB, and GPIOs. Choose either a standard OEM interface board for compact systems integration or an interface evaluation board for convenient test and development. A version for industrial environments is also available. Depending on the business case, a custom interface board may also be a viable option. High Performance The D3 intelligent camera platform features a 1 GHz ARM Cortex -A8 Core with floating point unit (FPU) running Linux. A 700 MHz C674x DSP with FPU is at your disposal for computationally intensive algorithms. 2 GB DDR3-800 RAM with 6103 MB/s bandwidth and a Gigabit Ethernet interface ensure rapid processing and efficient transmission of image data. Comparison of the D2 and D3 Intelligent Camera Platform Intelligent Camera Platform D2 D3 Operating System Debian Linux Ubuntu Linux ARM Core and Frequency 300 MHz ARM9 1 GHz ARM Cortex -A8 DSP Core and Frequency 600 MHz C64x 700 MHz C674x ARM and DSP Instruction Type Fixed point Floating point (FPU) and fixed point Cortex-A8 NEON Architecture RAM 256 MB DDR2/333 2 GB DDR3/800 Memory Bus Width, Bandwidth 32 bit, 1332 MB/s 2 x 32 bit, 6103 MB/s Flash Memory 512 MB 32 GB Ethernet Fast Ethernet (100 Mbit/s) Gigabit Ethernet (1 Gbit/s) Typical Ethernet Bandwidth 10 MB/s 40 MB/s SD Card USB Host / Device / / GPIOs up to 13 up to 44 RS232 / RS485 / / SATA CAN Bus JTAG Real-time Clock (RTC) Maximum Video Resolution 720p 1080p S-Video RGB888 HDMI Audio in/out Wake on LAN Power over Ethernet I2C Watchdog 24 V operation

3 D3 Dual-Core Programming Intelligent Camera with Ubuntu Linux Operating System Image Processing on the Dual-Core Chip The substantial processing power of the ARM processor is used to run the Linux OS as well as image processing tasks. The DSP is completely available for image processing. Both processors have a floating-point unit (FPU). Hardware codecs as well as various commercial codecs and open source algorithms are available for the DSP, for example the TI IMGLIB for basic image processing tasks. A free codec by VRmagic converts image data into various target formats, for example RGB565 or YUV. Extendable Linux Operating System The D3 platform runs a customized Linux kernel. The root file system is taken from Ubuntu LTS, which natively supports the instruction set of the Cortex-A8 Image Sensors (ARMv7, Thumb2) and its FPU (NEON). Additional components, such as web servers of NFS servers, can be easily installed using the Linux package repository. USB devices, such as Wi-Fi dongles, hard disks, or keyboards can also be used with the camera. Convenient Application Programming With a standard Ubuntu Linux operating system and full access to the ARM/DSP core, the D3 provides a convenient platform for programming applications with C/C++ or other programming languages. ARM software can be developed in standard integrated development environments under Ubuntu Linux. After cross-compiling, the software can be executed on the camera Compiling for ARM and DSP Applications developed on a x86 PC need to be crosscompiled for the D3 platform. Code for the ARM core can be cross-compiled using the ARM EABI toolchain. Code for the DSP needs to be cross-compiled using the TI DSP compiler. Both compilers and the required tools are available free of charge. Mono -Compatible.NET Framework Thanks to the Mono compatible.net interface available on all VRmagic intelligent camera platforms, applications development has now become easier. Mono is an open source implementation of Microsoft s.net Framework designed to facilitate cross-platform applications. Updates via Ethernet Updates of your camera applications and the camera firmware are possible via Ethernet. This saves time and money, especially if you cannot access the cameras directly in the field. ARM Core Linux Linux Memory Control Shared Memory CMEM RAM DSP Core Codecs DSP Memory Architecture of the dual-core chip: all memory sections can be resized according to your requirements. Dual-Core Chip Master ARM Cortex-A8 1 GHz Linux System Interconnection 64 Bit Interrupt Request Slave DSP C674x 700 MHz Codecs DDR3 RAM 400 MHz (DDR3-800) 2 GB 2 x 32 Bit Easy Debugging Applications can be developed, tested, and debugged on a PC and then transferred to the camera (ARM). Remote debugging via Ethernet is possible, for example with Eclipse and gdbserver (ARM). TI TraceUtil enables printf-debugging of DSP code. A JTAG port connects real-time emulators (XDS510 or XDS560) and enables DSP debugging with CCS. Simple Transfer from and to the D3 Create a network share (NFS or Samba/Windows) on your PC and mount it on the camera or vice versa. Transfer data via USB flash drive or SD card. Use the secure copy (scp) command under Linux. Ethernet 1 Gbit/S USB 2.0 Video Audio GPIO... The D3 intelligent camera architecture

4 Machine Vision SDK and Libraries Software Development for the D3 It Doesn t Get Much Easier Libraries and Toolkits for ARM and DSP Start Developing in 15 Minutes The VRmagic Easy Installer automatically sets up a complete development environment with all required applications and toolchain elements. After only a few minutes, you can compile demos and start developing applications for the D3 intelligent camera platform. CamLab Application The CamLab application is part of the VRmagic SDK. It offers user full control over all sensor parameters via a graphical user interface. Tool tips indicate the respective API property for each parameter. Free Demos with Source Codes The following demos and sources are included in the SDK: Bayer/Grey to RGB565 converter on ARM or DSP, demo for integration of customer specific DSP codecs (JPEG, Sobel, and more), viewer for S-Video output (DirectFB and SDL), control of general purpose I/Os. VRmagic SDK The included VRmagic SDK contains an application programming interface (API), which offers full control over the camera and works with all VRmagic cameras and frame grabbers. This makes it possible to exchange devices without additional programming costs. The SDK also contains a VRmagic codec for the ARM and DSP, which converts image data into different target formats, for example RGB32, YUV, or GRAY. Programming Libraries The D3 s floating point unit (FPU) allows a wide range of state-of-the-art machine vision libraries and toolkits to run on either the ARM or DSP cores. This lets you take advantage of numerous image processing algorithms. For example, develop a HALCON script on your PC and execute it directly on the D3 with HALCON Embedded development for intelligent cameras has never been easier. Programming Libraries for ARM The following libraries and applications create code or script that executes on the ARM processor of the D3. These tools cover a broad spectrum of project requirements, from simple to complex, and offer solutions for the full range of applications in the field of machine vision. Common Vision Blox Embedded: A fast and powerful programming library for vision applications. EyeVision: Software with a graphical user interface for intuitive development of image processing applications. GStreamer: Multimedia framework for playback, streaming and processing of video and audio. HALCON Embedded: A leading machine vision library with more than 1800 operators. OpenCV: An open source computer vision and machine learning software library. QT : A cross-platform application and UI framework for developers using C++ or QML. Programming Libraries for DSP Programming for the DSP requires advanced programming skills, however, making use of it boosts the speed of your applications considerably. The following libraries take advantage of the DSP on the D3. TI Codecs: Audio and video codecs optimized for the DSP, for example H.264, MPEG-2, or JPEG. TI IMGLIB: A collection of more than 70 building block kernels optimized for the DSP that can be used for image and video processing applications. TI VLIB: Video analytics and vision library for video surveillance, automotive vision, consumer electronics, and many more. VM_LIB: VRmagic machine vision library for object recognition, blob segmentation, barcode readers, and many more. Optimized for the DSP, but also runs on the ARM and on Linux or Mircosoft Windows PCs. x86 Host ARM Target the power of machine vision Source Code Binary ARM GCC ARM Header (.h) Dev Libs ARM Versions must match Runtime Libs ARM Development process for the ARM: code is developed on an x86 PC using specific development libraries. After cross-compiling the code, the binary can run on the D3 s ARM using the corresponding runtime libraries. Blob segmentation, one of the machine vision algorithms included in the VM_LIB.

5 Camera Designs and Image Sensors Multi-Sensor Camera Up to four external plug and play sensor boards may be connected to the camera base unit using flex-foil cables. This design enables pixel-synchronous images from multiple positions and facilitates 3D applications. Remote-Sensor Camera A single sensor board is connected to the camera base unit using a flex-foil cable or a round cable, making the camera perfect for narrow installation spaces. Single-Sensor Camera The sensor board is mounted directly onto the camera base unit, forming one compact unit. This is the most robust and cost-efficient camera design. Analog Video Converter Analog video converters convert PAL or NTSC cameras into a digital camera with the performance of the D3. This allows a step-by-step upgrade from analog to digital cameras. Available Image Sensors Sensor ID Sensor Type Aptina MT9T031 Aptina MT9M001 Aptina MT9V024 Sony ICX445 Technology CMOS rolling shutter CMOS rolling shutter CMOS global shutter CCD interline transfer Color l l l Monochrome l l l Sensor Size [inch] 1/2 1/2 1/3 wide 1/3 Resolution [px] 2056 x x x x 966 Pixel Size [µm] 3.2 x x x x 3.75 Bit Depth [bit] 8/10 8/10 8/10 8/10 Available Camera Design Single Remote Single Remote Multi Single Remote Multi Single Remote Multi Min. Exposure Time [µs] Pixel Clock [MHz] Max. Frame Rate [Hz] * Sensor ID Sensor Manufacturer Aptina MT9M024 Aptina AR0134 CMOSIS CMV2000 CMOSIS CMV4000 Technology CMOS rolling shutter CMOS global shutter CMOS global shutter CMOS global shutter Color l l l l Monochrome l l l l Sensor Size [inch] 1/3 1/3 2/3 ultra wide 1 Resolution [px] 1280 x x x x 2048 Pixel Size [µm] 3.75 x x x x 5.5 Bit Depth [bit] 8/10 8/10 8/10 8/10 Available Camera Design Single Remote Multi Single Remote Multi Single Single Min. Exposure Time [µs] Pixel Clock [MHz] x 25 4 x 25 Max. Frame Rate [Hz] * ** 24 ** Left: D3 remote-sensor camera Opposite page: D3 multi-sensor camera * This is the maximum value at full ROI with minimum exposure time. The actual frame rate depends on the pixel clock, sensor settings, and image format. ** With RLE image format

6 Built-In Flexibility D3 Interface Boards More Than 20 Interfaces 24 V Operation The D3 intelligent camera can be operated with 24 V DC, which allows easy integration into industry applications. JTAG Choose between a multitude of interfaces on different interface boards to get the most out of your application. Or order a custom interface board for production quantities. JTAG A JTAG interface makes it possible to connect real-time emulators (e.g. XDS510) for debugging purposes. SPI Bus The SPI bus is a synchronous serial data link standard. Devices communicate in master/ slave mode. Power over Ethernet Power over Ethernet allows the camera to obtain its power supply over the Ethernet cable, saving you time and money. Status LEDs The status LED indicates the camera system status, for example if the camera is booting up or ready for operation. The VRmEIO3 interface board features all interfaces supported by the D3. Industry standard connectors and the large euroboard form factor allow convenient evaluation of every interface. SVideo S-Video The analog S-Video output transfers standard-definition video signals encoded on two channels. VRmCUEO3 and VRmCUEOS3 OEM T/S Trigger and Strobe The camera can be controlled by an external trigger (trigger in) and output strobe signals (strobe out). VRmEIO3 Audio In/Out The D3 has various interfaces for audio input and output: S/PDIF digital out (coaxial/ optical), line out, line in, and microphone in. GigE PoE LED CAN Bus CAN bus is a multi-master broadcast serial bus standard designed for automotive applications. Real-Time Clock The real-time clock keeps track of the current date and time while the camera is switched off. Gigabit Ethernet The Gigabit Ethernet interface offers high data transfer rates, enabling extra fast streaming of images. RGB888 The RGB888 interface outputs image data in parallel 24 bit format. General Purpose I/Os Each general purpose I/O can be configured to be an input or output. Up to 44 GPIOs are available for your application. RS-232 The UART allows serial communication via two ports: Serial0 for RS232 / console and Serial1 for RS232 / RS485. HDMI The HDMI output transfers uncompressed digital video data to any compatible monitor, projector, or TV. SATA The Serial ATA bus interface allows fast connection of mass storage devices such as hard disks and optical drives. Watchdog The watchdog timer triggers a certain action, for example a processor reset, if another component fails. I2C Bus The I²C bus is a two-wire serial interface, which can be used to connect peripherals to the D3 platform. SD Card Reader The SD card interface enables writing and reading of SD cards. The VRmEIO3 interface board features a microsd card slot. All of the listed interfaces are supported by the D3, however, some restrictions may apply. Please contact us for details. Opposite page: VRmEIO3 interface board. Right: VRmCUEO3 interface board. HI-SPEED High-Speed USB The evaluation board features two highspeed USB ports. Both ports can be configured separately as USB device or host. The compact OEM interface boards are equipped with miniature connectors, thus making them perfectly suitable for OEM applications. VRmCUEO3 features all D3 interfaces except SATA and JTAG. VRmCUEOS3 is identical apart from an additional SATA interface. D3 Industrial Camera IC3 OEM The IC3 OEM has an interface board that is optimized for industry applications and features a 24 V power supply, Power over Ethernet, and standard industry connectors.

7 VRmagic GmbH Turley-Str Mannheim Germany Phone: Fax: Three Steps to Your Individual D3 Camera 1 Choose Design 2 Choose Sensor 3 Choose Interfaces Multi-sensor camera APTINA Aptina sensors evaluation Evaluation interface board Remote-sensor camera CMOSIS CMOSIS sensors oem OEM interface board Single-sensor camera SONY Sony sensors industrial Industrial interfaces Frame grabber custom Custom interface board 12/2014 VRmagic GmbH All rights reserved. Technical specifications subject to change without notice. Errors excepted. Photos similar to original products.