Copyright Notice. Mobile Testing Enterprise 7.3. September Copyright Keynote LLC. All rights reserved.

Transcription

1

2 Mobile Testing Enterprise 7.3 Release Notes Mobile Testing Enterprise 7.3 September 2015 Copyright Notice Copyright Keynote LLC. All rights reserved. THE INFORMATION CONTAINED IN THIS DOCUMENT IS PROVIDED AS IS WITHOUT ANY EXPRESS REPRESENTATIONS OF WARRANTIES. IN ADDITION, KEYNOTE DISCLAIMS ALL IMPLIED REPRESENTATIONS AND WARRANTIES, INCLUDING ANY WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT OF THIRD PARTY INTELLECTURAL PROPERTY RIGHTS. All text and figures included in this publication are the exclusive property of Keynote and may not be copied, reproduced, or used in any way without the express permission in writing of Keynote. Information in this document is subject to change without notice and does not represent a commitment on the part of Keynote. Keynote may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents except as expressly provided in any written license agreement from Keynote. The trademarks or registered trademarks of Keynote LLC in the United States and other countries include Keynote, DataPulse, CustomerScope, Keynote Customer Experience Rankings, Perspective, Keynote Red Alert, Keynote WebEffective, The Internet Performance Authority, MyKeynote, SIGOS, SITE, keynote The Mobile & Internet Performance Authority, Keynote FlexUse, Keynote DeviceAnywhere, DeviceAnywhere, Keynote DemoAnywhere, Keynote MonitorAnywhere. All related trademarks, trade names, logos, characters, design and trade dress are trademarks or registered trademarks of Keynote LLC in the United States and other countries and may not be used without written permission. All other trademarks are the property of their respective owners. Please forward any comments or suggestions regarding this document to Keynote Support. Keynote LLC 777 Mariners Island Blvd. San Mateo, CA ii Keynote Confidential

3 Release Notes Mobile Testing Enterprise 7.3 Contents 1 Overview New Features Updates Resolved Issues Known Issues... 6 Keynote Confidential iii

4 Mobile Testing Enterprise 7.3 Release Notes 1 Overview Mobile Testing Enterprise 7.3 for the shared device cloud comes with a new automation dashboard in the Enterprise Portal. 2 New Features Automation Dashboard Users of the Mobile Testing Enterprise cloud system can now see test cycle results graphically in a dashboard. After you have clicked Result Portal in Studio, you are directed to the Automation Results section of the portal. Select the Dashboard tab. You must first a time period for viewing test cycle data on the dashboard (up to a maximum of 5 days), select a project, and optionally, select the primary test cycle device. By default, test cycles with both devices are displayed. Figure 2-1 Configuring the Automation Dashboard 4 Keynote Confidential

5 Release Notes Mobile Testing Enterprise 7.3 Figure 2-2 Dashboard Display for a Selected Test Cycle On the dashboard, test cycle statistics are displayed on the top right: Number of runs Successes, fails, and invalid runs a test cycle is considered failed when any test case it contains fails. Start time of first test cycle run and end time of last run Results are graphed in a pie chart on the top left. Below the pie chart, a list displays all test cases executed as part of test cycle runs. If a test cycle containing 4 test cases is run 4 times, each set of four test cases is repeated four times over, showing the result for each test case. Click Success or Fail next to each test case to see high-level test case results in the bottom-right panel: Test case execution start and end times Project and primary device names Success or failure of run 3 Updates Auto-Recovery ios object scripting has been improved with the auto-recovery of the Agent installed on the device. Autorecovery will automatically restore connectivity when things like system popups for software update availability impact communication with the device. Keynote Confidential 5

6 Mobile Testing Enterprise 7.3 Release Notes 4 Resolved Issues Object Commands in Safari When using Object commands to capture and run a script on ios Safari, the script would freeze when there was a browser pop-up. After the script first freezes due to a pop up in Safari, the Agent on the device automatically recovers, enabling subsequent script executions to be completed (see Updates). 5 Known Issues Studio Application List for iphones Sometimes, the iphone tab of the device console in the Studio desktop client does not display the list of uploaded and installed applications for the selected ios device. Closing a Browser Without Logging Out of Web Studio When using the Web UI of Studio, users who close the browser without logging out are not subsequently able to start a new session as they see an error stating that they already have a session open. As a workaround, account administrators must revoke the license from the License Management tab of the Enterprise Portal. Cleanup Tab For users of the web Studio interface, the Cleanup tab in the device console is not available. Discarding Changes in Pick Data Command When using the Pick Data command in object-based scripts on ios devices, discarding a value by clicking the Discard button, e.g., clearing a selected date, is not reflected in the command. License Revocation After an account administrator revokes a license in the License Management tab of the Enterprise Portal, a message confirming license revocation might not be displayed. Device Reservations For users of the Studio web UI on Internet Explorer in the Mobile Testing Enterprise shared system, a reserved device is not automatically revoked when it is being used by another user at the time of the reservation. Launching Studio from the Test Plan Portal on Chrome Studio is not automatically launched when you click Access Devices in the Test Plan Portal on Chrome. To automatically launch Studio: 1 Log in to Test Plan Portal at portal.keynotedeviceanywhere.com. 2 In the Chrome address bar, enter the following string: chrome://flags/#enable-npapi 3 Click Access Devices in the Test Plan Portal to launch Studio. You need to perform this workaround just once to be able to launch Studio. 6 Keynote Confidential

7 Release Notes Mobile Testing Enterprise 7.3 NOTE You can launch Studio from the Test Plan Portal on Firefox; automatically launching Studio from the Test Plan Portal is not supported on Internet Explorer. Appium on Web Studio IE10 When running Web Studio on Internet Explorer 11, users are not able to highlight and copy the Appium connection URL for insertion into an Appium script. As a workaround, use Chrome for Web Studio. Idle Time on Web Studio If a user is logged in to web Studio and idle for a while, the idle time displayed in the Enterprise Portal is always 0. This issue occurs in enterprise environments. Galaxy S5 and S6 Objects on the Home and App screen of the Galaxy S5 and S6 devices are not captured/displayed in Object commands. Swiping to Enter Text in Safari When creating an object-based script and using the Object Edit command to enter text in Safari, text is not entered when you swipe to select the text entry field. Check Marks Not Recognized Check marks on the device screen in object-based applications are not recognized in Object commands. Hard Coded Timeout for Extracting Objects from a Page The time allowed for extracting objects from an application page when you first drag a command to the script is hard coded. If your page has thousands of objects, objects will not be displayed if the timeout for extraction is exceeded. Limitations of Recording Object Touch on Android 4.3 Samsung When recording the Object Touch command on Android 4.3 Samsung devices, clicks are recorded incorrectly in the application tray after opening it from the home screen. For instance, you might want to record a click to launch device settings from the application tray after opening the tray from the home screen. The click to launch device settings is incorrectly recorded after navigating to the application tray from the home screen. External Version Control Issue When using external version control for Studio test assets, you must populate custom folders in your projects with scripts. If user-created folders are left empty, they are erased when you close the project containing them. Waiting for Native Objects in Wait Event If you have multiple branches based on image-, text-, and object-based reference points in Wait Event, objects can take up to 30 seconds to be matched. As a workaround, use a separate Wait Event command for object-based reference points and other types of reference points. Creating a Text-Based State Using a Global Variable After creating a text-based state that waits to verify a text string contained in a global variable, both the device screen captured and the Text to wait for field are empty if you reopen the implementation without acquiring the device. Keynote Confidential 7