Developing apps for Android Auto

Transcription

1 Developing apps for Android Auto talk by Christian Dziuba & Sina Grunau 1

2 About us Sina Grunau, Christian Dziuba Android apps ( ) Automotive context: research + media apps c4c Engineering GmbH Automotive software app team 2

3 Topics 1. Introduction 2. How does Android Auto work? 3. APIs 4. Development Workflow 5. Summary 3

4 1 Introduction 4

5 Today family car car sharing 5

6 25 % of car accidents in the U.S happen because of smartphone usage while driving source: 6

7 Goal: Safe interactions (Navigation, phone, music) while driving Minimal driver distraction 7

8 In-Vehicle-Infotainment-Systems Car Vehicle Data Head Unit Car control Navigation Calls Smartphone Apps Calls Music Music 8

9 Smartphone - Car - Integration Car Vehicle Data Head Unit Navigation Calls Smartphone Apps Navigation Calls Music Music 9

10 Smartphone - Car - Integration: Comparison Technology Platform Development Car support Android Auto Android app extension /service limited, but promising Apple Carplay ios extension (?) / contact Apple Mirrorlink Android apps / certification limited, but promising limited Bosch MySpin ios/android not yet public very limited 10

11 2 Android Auto 11

12 Current state of Android Auto June 2014 / first announcement at Google I/O 2014 March 2015 / first aftermarket head-units (e.g. Pioneer, Kenwood) March 2015 / public release of companion app in Play Store Summer 2015 / first car manufacturers integrate Android Auto 2016 / 20+ car manufacturers announced to support Android Auto 12

13 Car Manufacturers supporting Android Auto Source: 13

14 How to use Android Auto 14

15 How to use Android Auto 15

16 Features: General 16

17 Features: Navigation 17

18 Features: Phone 18

19 Features: Music 19

20 Features: Exit Screen + Developer Mode 20

21 Currently compatible Android Auto apps Source: 21

22 3 Android Auto APIs 1. Messaging 2. Audio 22

23 Android Auto Apps audio app or messenger Android Auto app head unit service / interface get data forward user commands display logic mobile phone 23

24 Add Android Auto support to your app AndroidManifest.xml <application> <meta-data android:name="com.google.android.gms.car.application" /> </application> res/xml/automotive_app_desc.xml <automotiveapp> <uses name="notification"/> </automotiveapp> OR <uses name="media"/> 24

25 Messaging User Workflow 25

26 Messaging API received message is shown in overview screen no message content shown! message is read aloud, when button is pressed reply by voice 26

27 Notifications Notification CarExtender UnreadConversation MessageRead BroadcastReceiver RemoteInput Read PendingIntent Reply PendingIntent MessageReply BroadcastReceiver 27

28 Notifications Notification CarExtender UnreadConversation MessageRead BroadcastReceiver RemoteInput Read PendingIntent Reply PendingIntent MessageReply BroadcastReceiver 28

29 Create Message Reply Pending Intent Intent replyintent = new Intent().addFlags(Intent.FLAG_INCLUDE_STOPPED_PACKAGES).setAction("com.mychat.app.MY_ACTION_MESSAGE_REPLY").putExtra("conversation_id", conversation_id); PendingIntent replypendingintent = PendingIntent.getBroadcast( getapplicationcontext(), conversation_id, replyintent, PendingIntent.FLAG_UPDATE_CURRENT); 29

30 Notifications Notification CarExtender UnreadConversation MessageRead BroadcastReceiver RemoteInput Read PendingIntent Reply PendingIntent MessageReply BroadcastReceiver 30

31 UnreadConversation.Builder // build a RemoteInput for receiving the spoken voice input RemoteInput remoteinput = new RemoteInput.Builder("reply_key").setLabel("please say your message").build(); // group your messages from a particular sender UnreadConversation.Builder unreadconvbuilder = new UnreadConversation.Builder("conversation participant name").addmessage("the message text goes here").setlatesttimestamp(system.currenttimemillis()).setreadpendingintent(readpendingintent).setreplyaction(replypendingintent, remoteinput); 31

32 Notifications Notification CarExtender UnreadConversation MessageRead BroadcastReceiver RemoteInput Read PendingIntent Reply PendingIntent MessageReply BroadcastReceiver 32

33 Create a notification NotificationCompat.Builder builder = new NotificationCompat.Builder(getApplicationContext()).setSmallIcon(R.drawable.notification_icon).setLargeIcon(BitmapFactory.decodeResource( getapplicationcontext().getresources(), R.drawable.contact)).setContentText("this is the message text").setcontenttitle("participant name").setcontentintent(readpendingintent).extend(new CarExtender().setUnreadConversation(unreadConvBuilder.build())); contains the message(s) notificationmanager.notify(conversation_id, builder.build()); 33

34 Notifications Notification CarExtender UnreadConversation MessageRead BroadcastReceiver RemoteInput Read PendingIntent Reply PendingIntent MessageReply Broadcast Receiver 34

35 Register BroadcastReceiver <application>... <receiver android:name=".messagereplyreceiver"> <intent-filter> <action android:name="com.mychat.app.my_action_message_reply"/> </intent-filter> </receiver> </application> 35

36 BroadcastReceiver Example public class MessageReplyReceiver extends BroadcastReceiver public void onreceive(context context, Intent intent) { int conversation_id = intent.getintextra("conversation_id", -1); Bundle remoteinput = RemoteInput.getResultsFromIntent(intent); } CharSequence reply = remoteinput.getcharsequence("reply_key"); //ToDo send reply to other user } 36

37 Media API extend your audio app to allow users to: browse play audio content in the car 37

38 Define your app icon res/drawable/ic_notification.png <application> <meta-data android:name="com.google.android.gms.car.notification.smallicon" </application> /> 38

39 Audio Playback API MediaBrowserService MediaSession / MediaSession.Callback Android Auto Android Wear UI App 39

40 Overview MyAudioApp ongetroot() Android Auto MediaBrowserService ROOT_ID, sessiontoken Media Browser onloadchildren(id) List<MediaItem> MediaSession onplay(), onpause(),....setmetadata().setplaybackstate() Media Controller 40

41 MediaBrowserService Announcement of your media browser Service <application> <service android:name=".mymediabrowserservice" android:exported="true"> <intent-filter> <action android:name= "android.media.browse.mediabrowserservice"/> </intent-filter> </service> </application> 41

42 Overview MyAudioApp ongetroot() Android Auto MediaBrowserService ROOT_ID, sessiontoken Media Browser MediaSession Media Controller 42

43 MediaBrowserService - ongetroot() Authentification & binding to your media browser public BrowserRoot ongetroot(string clientpackagename, int clientuid, Bundle roothints) { // Check if this client is allowed to use service } return new BrowserRoot("my_Root_Id", Bundle roothints); Read more: tor.html 43

44 Overview MyAudioApp MediaBrowserService Android Auto Media Browser onloadchildren(id) List<MediaItem> MediaSession Media Controller 44

45 MediaBrowserService - public void onloadchildren (String parentmediaid, Result<List<MediaItem>> result) { } List<MediaBrowser.MediaItem> mediaitems = new ArrayList<MediaBrowser.MediaItem>(); // create your mediaitems here... result.sendresult(mediaitems); Don t block the UI thread! use result.detach() to detach in from the current thread! call result.sendresults(t result) when ready 45

46 MediaDescription MediaDescription.Builder builder = new MediaDescription.Builder(); builder.setmediaid(id); builder.seticonbitmap(icon); builder.settitle("first Line"); builder.setsubtitle("second Line");... MediaBrowser.MediaItem myitem = new MediaBrowser.MediaItem(builder.build(), MediaBrowser.MediaItem.FLAG_PLAYABLE OR MediaBrowser.MediaItem.FLAG_BROWSABLE); 46

47 Overview MyAudioApp MediaBrowserService Android Auto Media Browser MediaSession onplay().setmetadata().setplaybackstate() Media Controller 47

48 MediaMetadata MediaMetadata.Builder builder = new MediaMetadata.Builder(); builder.putstring (MediaMetadata.METADATA_KEY_TITLE, title); builder.putstring (MediaMetadata.METADATA_KEY_ARTIST, artist); builder.putbitmap (imagebitmap);... mediasession.setmetadata(builder.build()); 48

49 MediaSession - PlaybackState PlaybackState playbackstate = new PlaybackState.Builder() Display state.setactions(playbackstate.action_pause PlaybackState.ACTION_SKIP_TO_NEXT PlaybackState.ACTION_SKIP_TO_PREVIOUS).setState(PlaybackState.STATE_PLAYING, position, 1.0f, SystemClock.elapsedRealtime()).addCustomAction(ACTION_SHUFFLE, "Shuffle", R.drawable.ic_shuffle).build(); mediasession.setplaybackstate(playbackstate) 49

50 MediaSession - public void onplay() { }... player song selection public void onplayfrommediaid (String mediaid, Bundle extras) public void onplayfromsearch voice input (String query, Bundle extras) {} mediasession.setcallback(new MyMediaSessionCallback()); mediasession.setactive(true); 50

51 Voice Search Examples Play music from Madonna Play Stairway To Heaven from Led Zeppelin Google Knowledge Graph Artist focused search Title focused search 51

52 4 Development workflow 52

53 Android Auto Apps Restrictions Goal: Minimize driver distraction predictable interaction Design Guidelines enforce design & interaction patterns Functionality Guidelines enforces correct configuration and expected behaviour 53

54 Design Guidelines no animations or videos no visual ads, game features support voice input in media apps Read more: 54

55 Design Guidelines Day Night 55

56 Functionality Guidelines app starts and loads content within 10 secs keep state between auto & smartphone usage app works as described in Google Play... Read more: 56

57 Functionality Guidelines Task Limit A single action must be completed within 6 steps. (US) 4 steps (Japan) max hierarchy of 2 levels max 5 items on one page 57

58 Functionality Guidelines (messaging) App can successfully receive incoming messages Messages properly grouped and ordered User is able to successfully reply to a message. Only short-form messaging app design patterns (e.g. no s) Only peer-to-peer messaging services (no notification services, e.g. weather, stocks, and sport scores apps) Read more: 58

59 Testing on simulators Messaging Simulator (deprecated) Media Browser Simulator (deprecated) New: Android Auto Desktop Head Unit (DHU) Simulators: <path-to-sdk>/extras/google/simulators Head Unit: <path-to-sdk>/extras/google/auto 59

60 Android Auto Desktop Head Unit * adb forward tcp:5277 tcp:

61 Example DHU Commands Microphone (voice commands) e.g. mic play <absolute_path>/pause.wav ( Pause Music ) Day & Night mode e.g. day / night / daynight Controller and touch events ( hardware buttons) dpad up / dpad down tap x y 61

62 Publish / Test on Hardware Workflow: 1. upload apk to play store 2. get positive review 3. download app from store Direct 4. use on real device Rejected Approved Review 62

63 Example App Review Fast feedback from Android Auto Team - within 2 hours REASON(S) FOR EXCLUSION: - Your app continuous to play music during the use of the microphone, interfering with voice commands. - Your app does not perform all functions properly or as expected from a user perspective. 63

64 5 Summary 64

65 Learn more? Our favorite resources 65

66 Course: Android Auto Development on Udacity 66

67 Universal Music Player 67

68 babbq Texas 2015 talk by +Ian Lake 68

69 Thanks! Contact us: c4c Engineering GmbH Hildesheimer Str Braunschweig Germany 69