Continuous Integration and Code Coverage in Xcode

Transcription

1 Developer Tools #WWDC15 Continuous Integration and Code Coverage in Xcode Session 410 Matt Moriarity Xcode Engineer 2015 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 Agenda What is Xcode Server What's new in Xcode 7 Code coverage Extending Xcode Server Demos

3 What Is Xcode Server

4 What Is Xcode Server Continuous integration

5 What Is Xcode Server Continuous integration Enhances collaboration and improves software quality

6 What Is Xcode Server Continuous integration Enhances collaboration and improves software quality Builds and tests projects on a schedule

7 What Is Xcode Server Continuous integration Enhances collaboration and improves software quality Builds and tests projects on a schedule Easy to set up with Xcode and OS X Server

8 What Is Xcode Server Continuous integration Enhances collaboration and improves software quality Builds and tests projects on a schedule Easy to set up with Xcode and OS X Server Deep integration with Xcode

9 What Is Xcode Server Terminology

10 What Is Xcode Server Terminology Scheme Recipe for building your project

11 What Is Xcode Server Terminology Scheme Recipe for building your project Bot Analyze, build, test, and archive on a schedule

12 What Is Xcode Server Terminology Scheme Bot Integration Recipe for building your project Analyze, build, test, and archive on a schedule A single run of a bot

13 New in Xcode Server Better bot editing

14 New in Xcode Server Choosing repositories and branches

15 New in Xcode Server Source control security

16 New in Xcode Server Updated reports

17 New in Xcode Server Updated reports

18 New in Xcode Server Improved issue tracking

19

20

21

22

23

24 New in Xcode Server Xcode 7 features

25 New in Xcode Server Xcode 7 features User Interface Testing

26 New in Xcode Server Xcode 7 features On Demand Resources

27 New in Xcode Server Xcode 7 features Code Coverage

28 Code Coverage

29 Code Coverage A tool for measuring the value of tests

30 Code Coverage A tool for measuring the value of tests Shows which code is exercised by unit tests

31 Code Coverage A tool for measuring the value of tests Shows which code is exercised by unit tests Exposes areas of your code that are untested

32 Code Coverage

33 Code Coverage Tightly integrated with LLVM Counts each expression that is executed

34 Code Coverage Hierarchical coverage report

35 Code Coverage In the editor

36 Code Coverage In Xcode Server

37 Code Coverage Multiple devices

38

39

40 Code Coverage Coverage trends

41

42

43

44 Demo Code coverage in Xcode Eric Dudiak Xcode Engineer

45 Extending Xcode Server

46 Extending Xcode Server Triggers

47 Extending Xcode Server Triggers Custom actions: notifications or scripts

48 Extending Xcode Server Triggers Custom actions: notifications or scripts Use your language of choice Include a #! in your script, otherwise Bash is assumed

49 Extending Xcode Server Triggers Custom actions: notifications or scripts Use your language of choice Include a #! in your script, otherwise Bash is assumed Before and after integrations run

50 Extending Xcode Server Triggers Custom actions: notifications or scripts Use your language of choice Include a #! in your script, otherwise Bash is assumed Before and after integrations run Gated on the result of the integration

51 Extending Xcode Server Environment variables in triggers XCS XCS_BOT_NAME XCS_BOT_ID XCS_INTEGRATION_NUMBER XCS_INTEGRATION_ID XCS_INTEGRATION_RESULT XCS_SOURCE_DIR XCS_OUTPUT_DIR XCS_DERIVED_DATA_DIR XCS_PRODUCT XCS_(TYPE)_COUNT XCS_(TYPE)_CHANGE Always set to 1, use to detect Xcode Server The name of the current bot The ID of the current bot The sequential number of the current integration The ID of the current integration The overall result of the integration Location where your project s code was checked out Location where logs and assets for the integration are stored Location where derived data is stored for this bot Path to an.ipa or.app, if the bot produced one Number of issues of each type (error, warning, failed test, etc.) Change in number of issues from previous integration

52 Extending Xcode Server Environment variables in triggers XCS XCS_BOT_NAME XCS_BOT_ID XCS_INTEGRATION_NUMBER XCS_INTEGRATION_ID XCS_INTEGRATION_RESULT XCS_SOURCE_DIR XCS_OUTPUT_DIR XCS_DERIVED_DATA_DIR XCS_PRODUCT XCS_(TYPE)_COUNT XCS_(TYPE)_CHANGE Always set to 1, use to detect Xcode Server The name of the current bot The ID of the current bot The sequential number of the current integration The ID of the current integration The overall result of the integration Location where your project s code was checked out Location where logs and assets for the integration are stored Location where derived data is stored for this bot Path to an.ipa or.app, if the bot produced one Number of issues of each type (error, warning, failed test, etc.) Change in number of issues from previous integration

53 Extending Xcode Server Environment Variables in Triggers XCS XCS_BOT_NAME XCS_BOT_ID XCS_INTEGRATION_NUMBER XCS_INTEGRATION_ID XCS_INTEGRATION_RESULT XCS_SOURCE_DIR XCS_OUTPUT_DIR XCS_DERIVED_DATA_DIR XCS_PRODUCT XCS_(TYPE)_COUNT XCS_(TYPE)_CHANGE Always set to 1, use to detect Xcode Server The name of the current bot The ID of the current bot The sequential number of the current integration The ID of the current integration The overall result of the integration Location where your project s code was checked out Location where logs and assets for the integration are stored Location where derived data is stored for this bot Path to an.ipa or.app, if the bot produced one Number of issues of each type (error, warning, failed test, etc.) Change in number of issues from previous integration

54 Extending Xcode Server

55 Extending Xcode Server Open standards

56 Extending Xcode Server Open standards Secure communication over HTTPS

57 Extending Xcode Server Open standards Secure communication over HTTPS REST pattern of resources and actions

58 Extending Xcode Server Open standards Secure communication over HTTPS REST pattern of resources and actions Data exchanged using JSON

59 Extending Xcode Server Open standards Secure communication over HTTPS REST pattern of resources and actions Data exchanged using JSON Compatible with most scripting languages

60 Extending Xcode Server API example: bots GET { "count": 3, "results": [{ "_id": " c6fad1f8c0477eaf3df", "name": "CoffeeBoard Bot", "configuration": { "builtfromclean": 0, "schemename": "CoffeeBoard", "performsanalyzeaction": true, "performstestaction": true, "performsarchiveaction": true, "exportsproductfromarchive": false, "triggers": [], "scheduletype": 2,

61 Extending Xcode Server API example: integrations

62 Extending Xcode Server API example: integrations GET.../bots/ c6fad1f8c0477eaf3df/integrations

63 Extending Xcode Server API example: integrations GET.../bots/ c6fad1f8c0477eaf3df/integrations { "count": 30, "results: [{ "_id": "93040d da6ff05a20032bc", "bot": {... }, "number": 23, "currentstep": "completed", "result": "build-errors", "buildresultsummary": { "errorcount": 3, "errorchange": -1, "warningcount": 11, "warningchange": 0,

64 Extending Xcode Server API example: integrating a bot

65 Extending Xcode Server API example: integrating a bot POST.../bots/ c6fad1f8c0477eaf3df/integrations

66 Extending Xcode Server API example: integrating a bot POST.../bots/ c6fad1f8c0477eaf3df/integrations { "_id": "93040d da6ff05a20032bc", "bot": {... }, "number": 23, "currentstep": "pending" }

67 Extending Xcode Server API example: integrating a bot POST.../bots/ c6fad1f8c0477eaf3df/integrations { "shouldclean": true } { "_id": "93040d da6ff05a20032bc", "bot": {... }, "number": 23, "currentstep": "pending" }

68 Demo Extending Xcode Server Eric Dudiak Xcode Engineer

69 Extending Xcode Server Available endpoints GET /bots List bots on server POST /bots Create a new bot GET /bots/(id) Retrieve a bot by ID PATCH /bots/(id) Update a bot s configuration GET /bots/(id)/integrations Get the most recent integrations for a bot POST /bots/(id)/integrations Enqueue a new integration GET /integrations List integrations on server GET /integrations/(id) Retrieve an integration by ID GET /integrations/(id)/commits List the commits included in an integration GET /integrations/(id)/issues List the build issues produced by an integration GET /devices List devices connected to server GET /repositories List hosted repositories on server POST /repositories Create a new hosted repository

70 Summary Xcode Server improvements New testing features Code coverage Triggers Xcode Server API

71 More Information Xcode Server and Continuous Integration Guide Apple Developer Forums Stefan Lesser Swift Evangelist

72 Related Sessions UI Testing in Xcode Presidio Wednesday 11:00AM Continuous Integration with Xcode 6 WWDC 2014

73 Related Lab Testing and Continuous Integration Developer Tools Lab B Thursday 1:30PM

74