OpenCV on Android Platforms

Transcription

1 OpenCV on Android Platforms Marco Moltisanti Image Processing Lab

2 Outline Intro System setup Write and build an Android app Write and build an OpenCV app for Android

3 A couple of words about Android / 1 Android is a Linux-based OS, oriented to mobile devices; Android, Inc. was founded in 2003 by Andy Rubin, Rich Miner, Nick Sears and Chris White; Google acquired Android, Inc. in 2005; In 2007, Open Handset Alliance, a consortium including Google, HW manufacturers and TC operators, unveiled Android as its first product, a mobile device platform. First commercial device running Android was HTC Dream, released on October, 2008.

4 A couple of words about Android / 2 Each major release is named after a dessert: first was Cupcake (1.5), current is Jelly Bean (4.1) Distribution of Android Releases:

5 A couple of words about Android / 3 Applications for Android OS can be acquired through an app store, such as Google Play or the Amazon App Store; Moreover, it is possible download and install the app s APK file from a third party site.

6 Android Apps / 1 An Android app is packaged and distributed as an Android Package, i.e. a file with apk extension. All the code and data in a single apk file is considered a to be one application. Each app lives in a sandbox inside the Linuxbased Android OS. Each app has a unique ID and runs on its own Linux process. Each process has its own Virtual Machine.

7 Android Apps / 2 MyApp A single screen with a user interface Run in background Manage data Listen to system wide announcements

8 Android Apps: file Manifest The system must know the existence of the application s components. A «manifest» file, named AndroidManifest.xml, is needed in order to: Declare components; Identify user permissions (e.g. Internet Access); Declare minimum API level; Declare needed external lib;

9 Android Apps An exhaustive view of Application s architecture would take too much time Further informations available at

10 Let s start! First of all, we need to setup our work environment. Developer s Kits, Virtual Machines, API,

11 Ingredients Java SDK 6 or higher Eclipse IDE A C/C++ Compiler (Visual C++ / MinGW / Cygwin) Android SDK Android NDK

12 Recipe / 1 Download and install Java SDK from ase/downloads/jdk7u9-downloads html Let JAVA_FOLDER be the folder where we installed our JDK. Put the «JAVA_FOLDER\bin» directory in the System Path.

13 Recipe / 2 Download and install Android SDK from Download and unzip Android NDK from

14 Recipe / 3 Download and unzip Eclipse IDE for Java Developers from Install the Android Development Tools (ADT) plugin for Eclipse: lling-adt.html Install the C/C++ Development Tooling (CDT) for Eclipse

15 Recipe / 4 A good quick start guide is available at tion/android_binary_package/android_dev_in tro.html

16 Android application structure Project root folder Jni C/C++ application source code Control the C++ build process Present if we need C/C++ code Android.mk and Application.mk Written with Makefile syntax Libs Compiled libs Res Resources of the application Images xml files describing UI layout Src Java code of the application AndroidManifest.xml essential information about application to the Android system: Name of the Application Name of main application s package Components of the application Required permissions default.properties text file containing information about target Android platform and other build details

17 Hello World! / 1 Click on the highlighted button (if you don t have it, you have to reinstall ADT plugin) to create a new Android App.

18 Hello World! / 2 Fill the form and click next. Go forward to the end of wizard we don t care in this moment about icons and stuff!

19 Hello World! / 3

20 Run, Hello World, run! / 1 To run our HelloWorld! App we have to setup a Virtual Device. This can be done using Android Virtual Device Manager, that comes with the SDK. Launch AVD Manager and create a new device

21 Run, Hello World, run! / 2 From Eclipse, click Run (CTRL+F11) and select the Android App modality Eclipse will launch the device emulator and run your app.

22 A bit deeper / 1 The user interface (UI) of an application is stored in a xml file, which contains each component s settings. The UI can be created modifying the xml or using the tools provided by Eclipse. Example!

23 A bit deeper / 2 The logic part is in a java file, with the same name of the activity we re working on. In our example, it s in MainActivity.java It is possible to access layout elements using the findviewbyid method. public View findviewbyid (int id) id can be retrieved using R.id.componentName

24 Events Handling Nobody likes a static UI! Here we use the Java event handling paradigm: Event Listeners! Each event has its own listener onclicklistener oncheckedchangelistener Few lines of code are better than a thousand words!

25 OpenCV for Android There are 3 ways to use OpenCV on Android 1. Basic level OpenCV Java API only + Android SDK. 2. Advanced level OpenCV native interface + Android NDK. 3. Hacker level We don't suggest this way. 1 & 2 use prebuilt OpenCV package: It allows to use both Java and C++ OpenCV API 3 needs OpenCV builded from sources.

26 Basic level OpenCV exposes almost all its functionality to Java including camera You don't even need to dive into NDK stuff You simply add a reference to the OpenCV, import its classes and move forward The overhead is equal to a cost of one or several JNI calls This approach works in many cases, but sometimes JNI calls can consume too much

27 Advanced level The Android way is writing all your code in Java Sometimes it is not enough and you need to go to a native level and write part of your application in C/C++: For example: you already have some computer functionality which is written in C++ but do not want to rewrite the C++ code to Java. Add a class with native methods and wrapping your C++ functionality into the Java part of your Android application C++ code of OpenCV is cross-platform, that means that you can port your desktop code to mobile devices

28 Hacker level We don't recommend this way, but it is useful if you want to work with OpenCV sources. Implement some new features Optimize the performance Submit a bugfix Want to have an access to the latest OpenCV features We won t try this approach!

29 Install OpenCV Manager on the VD / 1 Launch Android Virtual Device (AVD) Manager Start the Virtual Device

30 Install OpenCV Manager on the VD / 2 Let ANDROID_SDK be the folder where we installed the SDK; Let ANDROID_OPENCV be the folder where we put the opencv4android libs; Open a shell: cd ANDROID_SDK\platform_tools adb install ANDROID_OPENCV\apk\OpenCV_2.4.3_Manager_2.0_platform. apk Wait for success!

31 And now? String code = "Let s go to write down the code!"; System.out.prinltn(code);