Contest 12 Task Pick any three mnemonics from http://www.qualityperspectives.ca/resources_mnemonics.html and find at least three bugs for each mnemonic. Feel free to use any application (website/desktop/mobile) for the testing purpose. Mnemonic-1: I SLICED UP FUN App: HomeBound 1.1 (https://play.google.com/store/apps/developer?id=zebu+games) Device: Samsung GT-S5302 Android 2.3.6 Bug-1 Mnemonic Attribute Used: Platform Title: Installation of the HomeBound on 2.3.6 device was not successful while manifest reads the minimum SDK version is 9 i.e. Android 2.3. 1. I started installation of HomeBound on Samsung GT-S5302. 2. In the end, I noticed message which read, Installation is not successful. 3. Signed into Play Store web and connected the same mobile device. 4. I noticed the message This app is incompatible with your device. Looking at the Additional Information section for HomeBound in Play Store, it shows, the app can be installed from Android version 2.3 onwards. I cross verified this to see how the app is compiled by extracting the manifest of the app. It says, android:minsdkversion="9" i.e. 2.3 and android:targetsdkversion="19" i.e. 4.4 This indicates me there is a trouble with Platform. To cross verify this, I used other phone which is also Samsung GT-S5302 and noticed the same behavior. From this observation, the impression of problem in the platform looks to be prominent. s Ravisuriya ravisuriya1@gmail.com @testinggarage 1
Mnemonic-1: I SLICED UP FUN App: HomeBound 1.1 (https://play.google.com/store/apps/developer?id=zebu+games) Device: LG Google Nexus 5 Android 5.0 Bug-2 Title: HomeBound continues to remain in foreground screen activity and play music when there is an incoming call. In Nexus 5, noticed the HomeBound being on screen while there is an incoming call. There was a display of call incoming on top of the screen. As well, the app continued to play the sound along with the set ring tone in device. I expected, the sound from HomeBound to be stopped when there is a Telephony Manager interruption. On tapping over the calling identity screen, the HomeBound went to background and stopped playing its music. On investigating I see, this behavior is specific to Google Nexus 5 and I could not try it on Nexus 6. The activity window management looks to have the influence here as per the log read and I notice the Illegal Argument Exception in the log during this activity indicating the Window and argument passed to it. The same behavior was not observed on Moto G 2 nd Gen device. From log, it is evident that, the HomeBound activity is not paused at time of Telephony Manager Interruption (broadcast). Refer the log attached. This is classified under Platform, User Scenario, Interaction/Interruption and Function attributes of the mnemonic. And very precisely it is on the Interaction/Interruption attribute of this mnemonic. The screenshot shows the game in action and incoming call. Game activity was not in background as music and game moves were in activity. Log 1. HomeBound_Nexus5: https://drive.google.com/open?id=0b3nsedjxjea0rgjlqjlla3zouvu&authuser=0 Ravisuriya ravisuriya1@gmail.com @testinggarage 2
Mnemonic-1: I SLICED UP FUN App: HomeBound 1.1 (https://play.google.com/store/apps/developer?id=zebu+games) Device: Moto G Android 4.4 LG Google Nexus 5 Android 5 Samsung Note 2 Android 4.4 Rooted and Custom ROM Note 3 Bug-3 Title: The advertisement from Google Ad Sense is not displayed. The Ad Sense SDK marks the Console Info log of reading it from cache. The Google Ad Sense SDK is integrated and used with the app. I see the ads displaying sometimes and not regularly. With this, the pattern of showing up ads i.e. when the level is lost by getting lost in space or blowing the space ship is not consistent. I have not seen ads displayed from past one day in the said contexts in last sentence. Analyzing the log, I see below trace [INFO:CONSOLE(0)] Document was loaded from Application Cache with manifest https://googleads.g.doubleclick.net/mads/static/mad/sdk/native/sdk-core-v40-loader.appcache, source: https://googleads.g.doubleclick.net/mads/static/mad/sdk/native/sdk-core-v40-loader.html (0) I see, the ads not being fetched neither from Ad Sense nor from the Cache. I uninstalled and installed the app and followed the same sequence of actions. I did not see the Ads. As the result, the revenue which has to come from the Ads Sense is being missed to the Product Owner. Cross investigating on different devices, I notice the same behavior. Using the Proxy to spoof the IP and see the behavior of the Ads, the same behavior is noticed. This behavior is classified precisely under Function and Data, although it involves other attributes of the mnemonic. The functionality of the Ad Sense looks not functional and the data being read from cache while no data exist looks not appropriate in this context. And, there is a problem with Ads cache and network. Logs 1. HomeBound_Samsung Note2: https://drive.google.com/open?id=12snxdwh6o4_bvmmyvmbafb8ghd8vg8gkggawgsjihtw&authuse r=0 2. HomeBound_Nexus5: https://drive.google.com/open?id=0b3nsedjxjea0rgjlqjlla3zouvu&authuser=0 3. HomeBound_MotoG?id=0B3nSEdjXJEa0T004TmZmZDNOQ2M&authuser=0 Ravisuriya ravisuriya1@gmail.com @testinggarage 3
Mnemonic-2: FAILURE Product: Vodafone Web India Service & Payment Gateway Bug-4 Title: The message displayed on failure of connecting to the payment gateway is unclear and did not help me. I signed into valid account. Looking at the Outstanding Bill amount, I proceeded to make payment via Net Banking. Filling up the amount details and selecting the bank, I was redirected to Payment Gateway site. During this time, I noticed the message Technical Issue and no other word in the page. It did not say what it is and what to do. I tried again, I noticed the same. I did not know what s happening and it was last due date for my bill payment and last hour of the day. I had no other choice and had to make payment at this time. I was clueless seeing here and did not wish to make customer care call as I wasn t sure if the talk time would be deducted. I want to save my talk time to talk with people rather than saying problem to customer care. I apply the Appropriate and Recovery aspect of the mnemonic here though I can apply every attributes. The message is not appropriate and does not tell me what it is. Technical Issue, where at my end or at their end and what to do? No information about to recover from here and make the payment. I was left alone on this screen with that message. Still, I made the payment next day. With this, they could have lost the payment coming to their account at that time. Probably someone who wanted to make payment at last minute and couldn t because of this, had to pay fine? I m not sure about this. with the message that is not useful to me for taking appropriate action. Ravisuriya ravisuriya1@gmail.com @testinggarage 4
Mnemonic-2: FAILURE Product: I could not mention the product name here because of the detail it exposes in server directory. Bug-5 Title: The error handling in the application programming is not handled when the reference to object is lost. Trying to look at the detail of an event published in the event management website, it showed me the message which I could not understand in first what it is. Later, reproducing the behavior, I noticed, there was a JavaScript error which was not handled while loading the page. As a result, the content the page did not get loaded. Instead I saw the message as in below screenshot. I can apply all the attributes of FAILURE here and make one error page or customized error message for the module of the product. For example, Sorry, the event details cannot be loaded due to problem at our end. For the immediate assistance please contact our Customer Support. Mnemonic-2: FAILURE Product: MS Office Word 2007 OS: Windows 7 Ultimate SP1 Bug-6 Title: The message says it is error but dialog indicates it as warning and no info what I should do. I could not save the content in the file. I created a MS Word file and embedded the Excel Worksheet Object into it. Started filling in the details to cells and saved the file. Next time, I created a copy of this file and removed the content which showed Excel Worksheet section. Continued the work and tried to save the so far work in this file. I noticed the message which said Word cannot complete the save due to a file permission error. I did not know what permission is needed for a file to save. Ravisuriya ravisuriya1@gmail.com @testinggarage 5
The dialog indicated it as warning but message say it is an error. I had no way how to recover from the error and save the file. Each time, I tried to save the file, it showed me the same message. On investigating, it looks like it was recording the change version and it conflicted with changes of Object Embedded removal. Applying the mnemonic and Microsoft message standards, it has to be error symbol and not the warning. As per the MS standards, it did not tell me how to recover from here too. I could not use the functionality of saving a file here, message was not appropriate, recovery method was not mentioned and this message did not help me. For example, message as, The permission to save this file is denied due to version conflict. Resolve the version conflict. Refer the Versioning section in Help for more information. Mnemonic-3: ICE OVER MAD Product: http://imageedited.com Bug-7 Title: No validation for the file type submitted to analysis. I uploaded the text file of size zero. On analysis by the product, it showed the message File is too small. Considering this as a simple REST (any simple URL performing an action or navigation is REST), I see the error handling is missing. I expected to see a message saying to upload the image file on parsing it for metadata i.e. EXIF details. One can copy the metadata of an image file and paste it to a normal text file and save it without an extension or with an extension of an image file. Taking this case, I m not sure how the parsing will happen and it is note tested for this case at this time of testing. This behavior is classified under Error Handling attribute of the mnemonic. Ravisuriya ravisuriya1@gmail.com @testinggarage 6
Mnemonic-3: ICE OVER MAD Product: http://imageedited.com Bug-8 Title: Uploading of the exe file looks to be successful although it will not be processed. I uploaded an exe file instead of an image file. It took around 30 seconds in my test environment to say, Can t tell. And there was a message which read Upload Finished. It was shocking to see the simple REST action of uploading a file is not validating at client end for file type and taking it to its server for further analysis. What if, I uploaded a malware or virus file which can be an exe or script or disguised file? I expected the client end validation for first and only if it succeeds the file to get uploaded on to server. At present irrespective of what it is, looks like the file gets uploaded to the server, for first. This behavior is classified under the Authentication attribute of this mnemonic. Ravisuriya ravisuriya1@gmail.com @testinggarage 7
showing the exe file uploaded and successful upload message. Mnemonic-3: ICE OVER MAD Product: http://imageedited.com Bug-9 Title: From the REST action of uploading a zero size file, I will be navigated to page which has no option for getting back to uploading state. I uploaded the zero size text file. Clicking on the page I m shown the page which has no option to upload a file again. No hypertext (which again is a form of REST) in page to get back to previous state. I had to refresh the page to see the page which helps me to see an option to upload the file again. This behavior is classified under Endpoints attribute of the mnemonic. From any endpoint of a state, I should be able to visit the state which I used to be there. Ravisuriya ravisuriya1@gmail.com @testinggarage 8
No option to get back to state which helps me to upload a file other than the reloading of page. Ravisuriya ravisuriya1@gmail.com @testinggarage 9