Enhancing VoIP Apps with CallKit

Transcription

1 App Frameworks #WWDC16 Enhancing VoIP Apps with CallKit Session 230 Sirisha Pillalamarri CallKit Engineer Stuart Montgomery CallKit Engineer Nick Fraioli CallKit Engineer 2016 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 How do VoIP apps work today?

3

4

5

6

7 Wouldn t it be nice if

8

9

10

11

12

13

14

15

16 CallKit

17 Agenda Architecture Incoming Call Outgoing Call API Details

18 Architecture System Services VoIP App - System

19 Architecture System Services VoIP App CallKit - System

20 Architecture System Services VoIP App CallKit CallKit - - System

21 Architecture VoIP App CallKit System

22 Architecture VoIP App CallKit System

23 Architecture System

24 Architecture System

25 Architecture Speakerbox System

26 Architecture Speakerbox App Code App UI System

27 Architecture Speakerbox App Code App UI CallKit System

28 Architecture Speakerbox App Code App UI CXProvider CallKit - System

29 Architecture Speakerbox App Code App UI CXProvider CallKit CXCallController - - System

30 CXProvider vs. CXCallController

31 CXProvider vs. CXCallController CXProvider

32 CXProvider vs. CXCallController CXProvider Out-of-band notifications

33 CXProvider vs. CXCallController CXProvider Out-of-band notifications Not user actions

34 CXProvider vs. CXCallController CXProvider Out-of-band notifications Not user actions External events Incoming call

35 CXProvider vs. CXCallController CXProvider CXCallController Out-of-band notifications Not user actions External events Incoming call

36 CXProvider vs. CXCallController CXProvider CXCallController Out-of-band notifications Requests from app Not user actions External events Incoming call

37 CXProvider vs. CXCallController CXProvider CXCallController Out-of-band notifications Not user actions Requests from app Local user actions External events Incoming call

38 CXProvider vs. CXCallController CXProvider CXCallController Out-of-band notifications Not user actions External events Incoming call Requests from app Local user actions Internal events Start call

39 CXProvider vs. CXCallController CXProvider CXCallController Out-of-band notifications Not user actions External events Incoming call Requests from app Local user actions Internal events Start call Interplay with other providers Hold and Start Call

40 CXProvider vs. CXCallController Example uses

41 CXProvider vs. CXCallController Example uses Use CXProvider to report Incoming call Outgoing call connected Call ended on remote side

42 CXProvider vs. CXCallController Example uses Use CXProvider to report Use CXCallController to request Incoming call Outgoing call connected Call ended on remote side Start outgoing call Answer call End call

43 Architecture Speakerbox App Code CXProvider CallKit System

44 Architecture Speakerbox App Code CXProvider CallKit - CXCallUpdate System

46 Architecture Speakerbox App Code CXProvider CallKit - CXAction System

47 Architecture Speakerbox App Code CallKit CXCallController System

48 - Architecture Speakerbox App Code CallKit CXCallController CXTransaction System

49 Incoming Call

50 Architecture Speakerbox App Code CallKit System

52 Architecture Speakerbox App Code CXProvider CallKit - CXCallUpdate System

53 Architecture Speakerbox App Code CXProvider CallKit System UI - Incoming Call CXCallUpdate System -

54 Architecture Speakerbox App Code CXProvider CallKit System UI System

55 Architecture Speakerbox App Code CXProvider CallKit System UI Answer - System

56 Architecture Speakerbox App Code CXProvider CallKit - System UI - CXAnswerCallAction System

57 Architecture Speakerbox App Code Answer CXProvider CallKit - System UI - CXAnswerCallAction System

58 Architecture Speakerbox App Code App UI CXProvider CallKit System

59 Architecture Speakerbox App Code App UI End CXProvider CallKit CXCallController System

60 Architecture Speakerbox App Code App UI CXProvider CallKit CXCallController - System CXTransaction(CXEndCallAction)

61 Architecture Speakerbox App Code App UI CXProvider CallKit CXCallController - - CXEndCallAction System CXTransaction(CXEndCallAction)

62 Architecture Speakerbox App Code App UI End CXProvider CallKit CXCallController - - CXEndCallAction System CXTransaction(CXEndCallAction)

63 Demo Incoming Call Stuart Montgomery

64 Recap Incoming call

65 Recap Incoming call Reported incoming call to system provider.reportnewincomingcall(with: UUID, update: CXCallUpdate) { error in /*... */ }

66 Recap Incoming call Reported incoming call to system provider.reportnewincomingcall(with: UUID, update: CXCallUpdate) { error in /*... */ } Performed the CXAnswerCallAction func provider(_ provider: CXProvider, perform action: CXAnswerCallAction) { /*... */ }

67 Recap Incoming call Reported incoming call to system provider.reportnewincomingcall(with: UUID, update: CXCallUpdate) { error in /*... */ } Performed the CXAnswerCallAction func provider(_ provider: CXProvider, perform action: CXAnswerCallAction) { /*... */ } Fulfilled the CXAnswerCallAction answercallaction.fulfill()

68 Call Actions CXAnswerCallAction CXStartCallAction CXEndCallAction CXSetHeldCallAction CXSetGroupCallAction CXPlayDTMFCallAction CXSetMutedCallAction

69 Managing Multiple Calls

70 Managing Multiple Calls CXTransaction

71 Managing Multiple Calls CXTransaction List of multiple actions

72 Managing Multiple Calls CXTransaction List of multiple actions CXEndCallAction and CXAnswerCallAction

73 Managing Multiple Calls CXTransaction List of multiple actions CXEndCallAction and CXAnswerCallAction Fulfill each action individually

74 Managing Multiple Calls CXTransaction List of multiple actions CXEndCallAction and CXAnswerCallAction Fulfill each action individually

75 Outgoing Call

76 Outgoing Call Call controller

77 Outgoing Call Call controller

78 Outgoing Call Call controller Speakerbox Handle start call intent Start Call

79 Outgoing Call Call controller Speakerbox Handle start call intent Start Call Introducing SiriKit Presidio Wednesday 5:00PM

80 Outgoing Call Call controller Speakerbox Handle start call intent Create start call action App Code Start Call

81 Outgoing Call Call controller Speakerbox Handle start call intent Create start call action App Code Start Call Request start call action CallKit CXCallController

82 Outgoing Call Call controller Speakerbox Handle start call intent App Code Create start call action Request start call action Receive start call action CXProvider CallKit CXCallController System

83 Outgoing Call Call controller Speakerbox Handle start call intent App Code Create start call action Start Call Request start call action Receive start call action CXProvider CallKit CXCallController Execute start call action System

84 Outgoing Call Lifecycle

85 Outgoing Call Lifecycle

86 Outgoing Call Lifecycle Starting

87 Outgoing Call Lifecycle Starting

88 Outgoing Call Lifecycle Starting Started

89 Outgoing Call Lifecycle Starting Started

90 Outgoing Call Lifecycle Starting Started Connecting

91 Outgoing Call Lifecycle Starting Started Connecting

92 Outgoing Call Lifecycle Starting Started Connecting Connected

93 Demo Outgoing Call Stuart Montgomery

94 Recap Outgoing call

95 Recap Outgoing call Request start call action with Call Controller callcontroller.request(startcalltransaction) { error in /*... */ }

96 Recap Outgoing call Request start call action with Call Controller callcontroller.request(startcalltransaction) { error in /*... */ } Fulfill start call action with Provider startcallaction.fulfill()

97 Recap Outgoing call Request start call action with Call Controller callcontroller.request(startcalltransaction) { error in /*... */ } Fulfill start call action with Provider startcallaction.fulfill() Send call state updates provider.reportoutgoingcall(with: call.uuid, startedconnectingat: call.connectingdate) provider.reportoutgoingcall(with: call.uuid, connectedat: call.connectdate)

98 API Details

99 API Details Authorization Configuration Action Errors System Restrictions Audio

100 Provider Authorization

101 Provider Authorization Check authorization status

102 Provider Authorization Check authorization status Request authorization

103 Provider Authorization Check authorization status Request authorization Observe authorization changes

104 Provider Configuration

105 Provider Configuration Customized experience

106 Provider Configuration Customized experience Localized name for display

107 Provider Configuration Customized experience Localized name for display Video support

108 Provider Configuration Customized experience Localized name for display Video support Masked image icon

109 Action Errors Failing actions appropriately

110 Action Errors Failing actions appropriately

111 Action Errors Failing actions appropriately Starting Receive action

112 Action Errors Failing actions appropriately Starting Receive action

113 Action Errors Failing actions appropriately Starting Started Receive action

114 Action Errors Failing actions appropriately Starting Started Receive action

115 Action Errors Failing actions appropriately Starting Started Receive action Fail action

118 Action Errors Timeouts

119 Action Errors Timeouts

120 Action Errors Timeouts Enforce app responsiveness

121 Action Errors Timeouts Enforce app responsiveness Respond to actions in a timely manner

122 Action Errors Timeouts Enforce app responsiveness Respond to actions in a timely manner React to action timeouts

123 System Restrictions Incoming call

124 System Restrictions Incoming call Not authorized

125 System Restrictions Incoming call Not authorized Block list

126 System Restrictions Incoming call Not authorized Block list Do not disturb

127 System Restrictions Incoming call Not authorized Block list Do not disturb React to completion handler provider.reportnewincomingcall(with: UUID(), update: CXCallUpdate()) { error in if let incomingcallerror = error, incomingcallerrorcode = CXErrorCodeIncomingCallError(rawValue: incomingcallerror.code) where incomingcallerrorcode ==.filteredbydonotdisturb { // handle do not disturb } }

128 Audio Benefits

129 Audio Benefits High priority session

130 Audio Benefits High priority session Fewer interruptions

131 Audio Benefits High priority session Fewer interruptions Audio routing hints

132 Audio Incoming call

133 Audio Incoming call

134 Audio Incoming call Answer Received Answer Fulfilled

135 Audio Incoming call Answer Received Answer Fulfilled

136 Audio Incoming call Answer Received Answer Fulfilled Configure AVAudioSession

140 Audio Incoming call Answer Received Answer Fulfilled Did activate AVAudioSession Configure AVAudioSession

141 Audio Incoming call Answer Received Answer Fulfilled Did activate AVAudioSession Configure AVAudioSession Start call media

142 Recap API details Authorization Configuration Action Errors System Restrictions Audio

143 Summary

144 Summary Integration into the system

145 Summary Integration into the system Feature parity

146 Summary Integration into the system Feature parity Better app visibility

147 More Information

148 Related Sessions Introducing SiriKit Presidio Wednesday 5:00PM Extending Your Apps with SiriKit Nob Hill Thursday 1:40PM Networking with for the Modern Internet Pacific Heights Thursday 3:00PM Delivering an Exceptional Audio Experience Nob Hill Friday 1:40PM

149 Labs CallKit Lab Frameworks Lab A Friday 9:00AM SiriKit Lab Frameworks Lab B Friday 9:00AM Networking Lab 2 Frameworks Lab D Friday 2:00PM Audio Lab Graphics, Games, and Media Lab D Friday 3:00PM

150