Software Quality Characteristics Tested For Mobile Application Development

Transcription

1 Thesis no: MGSE Software Quality Characteristics Tested For Mobile Application Developent Literature Review and Epirical Survey WALEED ANWAR Faculty of Coputing Blekinge Institute of Technology SE Karlskrona Sweden

2 This thesis is subitted to the Faculty of Coputing at Blekinge Institute of Technology in partial fulfillent of the requireents for the degree of Master of Science in Software Engineering. The thesis is equivalent to 10 weeks of full tie studies. Contact Inforation: Author(s): WALEED ANWAR E-ail: University advisor: Dr. Sion Poulding Departent of Software Engineering Faculty of Coputing Internet : Blekinge Institute of Technology Phone : SE Karlskrona, Sweden Fax :

3 ABSTRACT Context. Sart phones use is increasing day by day as there is large nuber of app users. Due to ore use of apps, the testing of obile application should be done correctly and flawlessly to ensure the effectiveness of obile applications. Objectives. The objective of this research is to find out the iportant obile application quality characteristics fro developer s perspective and how developers actually test for the. Apart fro that how the developers test their obile applications are also addressed. Methods. Two ethodologies were used: the literature survey and the epirical survey. The literature survey was used to get failiar with the ost coonly known obile application quality characteristics for which obile applications are tested for. The epirical survey was used to get data fro developers by sending an online questionnaire link to the Google Play store developers and their response was recorded and further evaluated to present results. I categorized apps as top rated apps and low rated apps. Results. I got 43 responses as a whole fro 1000 developers. I got 20 responses out of 500 fro the top rated apps developers and 23 responses out of 500 fro the low rated apps developers. The results were used to copare the quality characteristics iportance to testing. According to the responses fro both top rated and low rated apps developer, functional testing and usability testing is considered to be the ost iportant and are ostly tested for Android obile applications. Load testing and energy testing is considered to be not that iportant fro developer s point of view but energy testing and eory testing is not so often tested for Android obile applications by developers. When it coes to testing process, top rated and low rated apps developer perfor testing by creating test cases that are predefined in scripts or docuents. They prefer to execute their tests on eulator rather than on obile and run their tests autoatically via tool or service as a cloud. Conclusion. My study reports the quality characteristics iportance for which the obile applications are tested for fro developer s perspective, actual testing done by developers and the testing process used by the. Functional testing and usability testing are considered to be ost iportant and ostly tested quality characteristics according to developer s perspective. Testing is done by running their tests on eulator autoatically through soe tool. They prefer to create their test cases that are predefined in scripts. Keywords: Mobile Application Testing, Quality Characteristics 3

4 ACKNOWLEDGEMENT I would like to extend y gratitude to y supervisor Sion Poulding for his vital support and feedback till end. This thesis would not have been possible without Sion Poulding guidance throughout the research. I really feel honored working with hi. I would like to thank y o, siblings and friends who helped e and supported e. Finally, I sincerely appreciate all the participants of the web questionnaire fro all over the world because without their response y thesis would not be accoplished. 4

5 TABLE OF CONTENTS ABSTRACT... 3 ACKNOWLEDGEMENT... 4 TABLE OF CONTENTS... 5 LIST OF FIGURES... 7 LIST OF TABLES INTRODUCTION AIMS AND OBJECTIVES RELATED WORK METHODOLOGY: RESEARCH QUESTIONS LITERATURE REVIEW EXTENDED DESIGN AND DERIVING THE START SET OF PAPERS: EMPIRICAL SURVEY PREPARATION OF QUESTIONNAIRE RESEARCH DESIGN AND DATA COLLECTION: RESULTS TOP RATED APPS DEVELOPER S FEEDBACK IMPORTANCE OF QUALITY CHARACTERISTICS TESTING OF QUALITY CHARACTERISTICS TESTING PROCESS OF TOP RATED APPLICATIONS LOW RATED APPS DEVELOPER S FEEDBACK IMPORTANCE OF QUALITY CHARACTERISTICS TESTING OF QUALITY CHARACTERISTICS TESTING PROCESS OF LOW RATED APPLICATIONS ANALYSIS DATA ANALYSIS TOP RATED APPS IMPORTANCE BY TOP RATED DEVELOPERS TESTING BY TOP RATED DEVELOPERS TESTING PROCESS OF TOP RATED APPS LOW RATED APPS

6 4.3.1 IMPORTANCE BY LOW RATED DEVELOPERS TESTING LEVEL BY LOW RATED DEVELOPERS TESTING PROCESS BY LOW RATED DEVELOPERS COMPARISON OF QUALITY CHARACTERISTICS IMPORTANCE, TESTING AND THEIR TESTING PROCESS DISCUSSION CONCLUSION VALIDITY FUTURE WORK REFERENCES APPENDIX A: QUESTIONNAIRE APPENDIX B: TOP RATED DEVELOPER S INFORMATION: APPENDIX C: LOW RATED DEVELOPER S INFORMATION:

7 LIST OF FIGURES Figure 1: Coparison of iportant quality characteristics fro top rated developer s perspective..26 Figure 2: Coparison of testing level of quality characteristics fro top rated developer s perspective Figure 3: Coparison of iportant quality characteristics fro low rated developer s perspective 30 Figure 4: Coparison of testing level of quality characteristics fro low rated developer s perspective

8 LIST OF TABLES Table 1: Research Questions Table 2: Quality characteristics iportance by top rated apps developers Table 3: Quality characteristics testing by top rated apps developers Table 4: Testing perfored by top rated developers Table 5: Quality characteristics iportance by low rated apps developers Table 6: Quality characteristics testing by low rated apps developers Table 7: Testing perfored by low rated apps developers Table 8: Analysis for the iportance of quality characteristics fro top Rated apps developer s perspective Table 9: Analysis for the testing level of quality characteristics fro top rated apps developer s perspective Table 10: Analysis for the iportance of quality characteristics fro low Rated apps developer s perspective Table 11: Analysis for the testing level of quality characteristics fro low Rated apps developer s perspective

9 1 INTRODUCTION A obile application (or obile app) is a software application that is designed to run on sartphones, tablet coputers and on other obile devices [1]. Mobile applications are becoing popular and also very coplex. As obile application users expect the applications to be reliable and fault free, so it akes the duty for application testers to ensure the quality of obile applications before it is released in arket [2]. Testing is a technique used to identify the faults in applications and to satisfy their custoers by providing the highly reliable and error free applications [27]. Testing of obile application is extreely difficult because there is a lot of diversity in obile devices, their runtie environent and the resources needed to test a obile application differs fro obile phone to tablet [28]. According to Mobile Application Testing Tutorial published by the IEEE Coputer Society [7], obile application testing is different fro the conventional software testing because of the following several unique requireents. 1. Mobile applications ust be able to work correctly anytie and anywhere. 2. As obile applications are often developed for a set of targeted devices, these applications ust work properly on different platfors having different operating systes, screen sizes, processing power, network bandwidth and battery life. 3. Mobile applications ust also include ultiple input channels (e.g. keyboard, voice, and gestures), ultiedia support, and other enhanced usability features in order to provide the rich experience as expected by the obile device users. 4. As obile devices support a range of wireless networks (e.g. 2G, 3G, 4G, Wi-Fi, WiMAX), obile applications ust also able to work in different network connectivity environent. Considering these unique requireents for obile applications and to be fully aware of iportant obile application quality characteristics, I was interested in using the research ethod literature survey and epirical survey. The literature survey was carried out to know about the well-known quality characteristics tested for obile applications. The quality characteristics is defined as what characteristics should an application have for exaple application should function properly, application should be easy to use for users, application should be copatible with different devices etc. The epirical survey was perfored to find out which quality characteristics are iportant fro developer s perspective and how often those quality characteristics are tested for Android obile applications by developers. Apart fro that I was also interested in perforing epirical survey on the testing process used by developers for testing of Android obile applications. In epirical surveys, inforation is gathered by asking people questions [8]. Afterwards, those quality characteristics were copared according to respondent s answers which helped e in finding out which quality characteristics were iportant fro their point of view and how they actually use the. Moreover, how the testing is perfored was also figured out. The epirical survey is the ethod used to collect data fro developers. An online questionnaire was ade through Google For and sent to 1000 developers and their response was recorded and further evaluated to present results. The apps whose rating was 4 or above was categorized as top rated apps and the apps whose rating was below 4 cae into the category of low rated apps. The developer s inforation is given in Appendix B and Appendix C. I contacted 500 developers of top rated apps and 500 developers of low rated apps to balance y findings and it was also tie 9

10 consuing to find developer s inforation anually. The apps were chosen randoly fro different categories available on play store i.e. top grossing apps, top selling apps, new and updated gaes, new and updated apps, apps, recoended for you apps, ovies apps, books apps, tools apps, counication apps, photography apps, offline apps etc. The developers contact inforation is given in Appendix which can be reused when soeone wants to survey again on Android obile applications. This inforation will help the to just copy the eail addresses and sent the their questionnaire as it will save tie and effort. It took e two weeks to get this inforation fro rando apps by checking its rating and storing it. This thesis contributes to find out which quality characteristics are iportant fro developer s perspective and how often these quality characteristics are tested for Android obile applications. Apart fro that it also contributes to know the current testing state of Android obile applications by addressing how the developers test their Android obile applications. The results can be used by developers to know which quality characteristics should be given high priority in testing of Android obile applications and how to actually test obile applications. 1.1 Ais and Objectives This research will be organized in two surveys (i.e. a literature survey and an epirical survey). Main ai of the literature survey is to know about well-known quality characteristics tested for obile application developent. Main objective of conducting the epirical survey is to find out which well-known quality characteristics for which obile applications are tested for is iportant fro developer s point of view and how they actually test the. Moreover, the testing process used by developers to test obile applications is also surveyed. 1.2 Related Work Mobile application testing is an activity which is aied at evaluating quality of a progra and also for iproving it, by identifying defects and probles [2]. In 2013, Android s Google Play crossed one illion available applications and fifty billion downloads [3]. Therefore due to large nuber of app users and their expectations fro the app to be error free, it is very iportant to eet the quality criteria of an application. Mobile applications growth is increasing intensively today. According to Gartner Inc. [4], in 2013, illion obile devices with Android operating syste were shipped, and in 2014 the expectation of this growth ight increase to over one billion. "Every onth, around 20,000 new applications are released, and the current nuber of apps in the Android arket is over 1,200,000 [5]". These nubers reflect that this platfor is intensively increasing day by day and that the focus of developers is to develop ore and ore obile applications. Furtherore, apps are easily available through Google Play Store so it has attracted a large nuber of developers and copanies to develop their apps and put it on Google Play Store [9]. Due to this ease there are illions of apps on this platfor but it doesn t ensure that apps are error free. The apps containing errors can significantly affect the developer s iage and ay har the users. So it is the duty of developers to test the apps before releasing to the arket to ensure the quality of apps [2]. The apps with alost no errors are ost downloaded and used by users and trust is built between user and developers [2]. 10

11 Mobile application testing is an activity which is aied at evaluating quality of a progra and also for iproving it, by identifying defects and probles [2]. It is uch ore difficult than the conventional software testing because the ipact of obile applications are saller than the desktop applications on a virtual achine. Mobile application testing has becoe a great challenge that needs iediate action to be tackled and there is no doubt that obile applications need specific quality characteristics [6]. The quality characteristics are used by obile application developers to ensure the quality of obile applications [2]. Google Play fraework akes it very easy for users to search and install the app. Therefore, soe developers think it is not necessary to test the app before releasing as it requires a lot of tie, so they wait for the users feedback if they report any proble they try to fix it and release the new version of app.[9] In y research ethodology course, I contacted 200 developers to perfor the epirical survey on quality characteristics tested for Android obile applications by developers. The developers were contacted to know about the ost quality characteristic that the obile applications are tested for. Those 200 developers are the part of these 1000 developers that are contacted. The saple size was sall and few quality characteristics were asked. But the iportance, use and testing process of Android apps still needs to be figured out. There have been any epirical studies conducted on Android obile application testing. Takala applied odel based user interface testing on Android applications and he has reported his experience [17]. Bhattacharya et al. perfored an investigation on bug reports and bug fixing ethod of Android applications [18]. Kropp and Morales exained strengths and weaknesses of instruentation fraework and positron fraework for testing obile graphical user interface applications [19]. Syer et al. studied the 15 ost coon Android applications and then copared it with 3 desktop applications [20]. McDonnell et al. studied the constancy and acceptance of APIs in Android network [21]. Maji et al. studies and characterized the failures in both Android and Sybian obile OSes [22]. Recently there was a research done that used survey ethodology, the tools were identified that are used in testing of Android obile applications by calculating their code coverage, the presence of test case and the challenges faced by developers in testing of Android obile applications [9]. Another research was done to understand the challenges faced by Android obile application developer s [23]. The quality characteristics tested for windows phone has been researched recently [9]. Different testing techniques are being introduced to overcoe the challenges faced by developers but still quality characteristics that Android developers think are iportant and are tested for Android obile applications is unknown and are being ignored. So, to overcoe this gap I was interested in perforing the epirical survey on the quality characteristics iportance and how often these quality characteristics are tested for Android obile applications. Apart fro that I was also interested in perforing epirical survey on the testing process used by developers for testing of Android obile applications. I surveyed Android obile application developers to know about current testing state of Android obile applications. The rest of the sections are organized as follows: Section 2 presents the research questions and the ethodologies used. Section 3 presents the results of an epirical survey. Section 4 presents the analysis of the results. Section 5 presents discussion section in which answers to the research questions are explained briefly and connected with RQS. Section 6 describes validity threats, conclusion and the future work needed. 11

12 2 METHODOLOGY: A ixed approach: literature review and epirical survey was used in this research to carry out the answers of research questions. The literature review was conducted to know about the wellknown quality characteristics for which obile applications are tested for fro the published work and the epirical survey was used to know the current testing state of Android obile applications. 2.1 Research questions The research questions considered in this work are as follows: Table 1: Research Questions Research Questions RQ1: What are the quality characteristics that obile applications are tested for? RQ2: Which are the ost and least iportant quality characteristics for which obile applications is tested for according to developer s perspective? RQ3: Which are the frequently and barely quality characteristics for which the obile applications is actually tested for by developers? RQ4: Does the iportance and testing of quality characteristics for which the obile application is tested for differs between top rated and low rated apps developer? RQ5: How are Android obile applications tested? Description This research question ais at finding the set of quality characteristics used to test obile applications fro the published work. This research question ais to find out the ost iportant and least iportant quality characteristics for which the obile applications is tested for according to developer s perspective. This research question ais to find out the frequently and barely quality characteristics for which the obile applications is actually tested for fro the developers perspective. This research question ais to find out whether the iportance and testing of quality characteristics for which the obile applications are tested differs between top rated and low rated apps developer. This research question ais to find out the current testing process used by developers in testing of Android obile applications. 2.2 Literature review A ixed approach: database search and snowballing approach was used to extract the papers. Soe papers were extracted fro IEEE and ACM databases by using the keywords that were derived fro research questions. The snowballing approach is then used which involves two steps: (1) deriving the start set of the papers and (2) perforing forward and backward snowballing. The research papers extracted fro IEEE and ACM databases were used as a start set to perfor snowballing. 12

13 2.2.1 Extended Design and deriving the Start set of papers: According to Wohlen, a good start set should have the following characteristics [29]. Diversity of the papers should be targeted which should cover different publishers, authors, years. To obtain this, it is recoended to cover this in start set. Size of start set depends on the size of area being studied for exaple if you are focusing on a specific area it requires lesser papers than focusing on a broader area. If search string is not forulated well too any papers can be found, To itigate it papers which are highly cited and have ore relevant references can be used by to obtain perfect start set. There can be a risk to iss relevant papers by using different terinology. To itigate it, synonys can be used with keywords that are derived fro research questions. The following search string was used to identify the start set was the following: (Testing types OR practices OR quality characteristics) And (Mobile applications) I used backward snowballing which is looking at the reference of the papers by applying inclusion and exclusion criteria. The ain advantage of using snowballing is that it just focuses on the referenced and cited papers [26]. The snowballing approach is as good as database search and easy to perfor as copared to database. I did the literature review not a systeatic literature review due to tie constraint. Systeatic review is basically in depth study of the relevant topic that identifies, selects all high quality research evidence which is relevant to that topic and to do it successfully it requires a lot of tie. Literature review is basically qualitatively reviews on a topic using general ethods to collect data. The literature review was conducted to find different quality characteristics for which the obile applications is tested. The literature review covers the answer of RQ1. Following are the different testing characteristics that the obile applications are tested for is found fro the published work. I. Usability Testing: Usability testing is used for activities that assess UI content and alerts, user operation flows and scenarios, edia richness, and gesture interaction [7] [9]. II. Perforance Testing: Perforance testing is used for the activities to deterine the speed or effectiveness of coputer, network, software progra or device [6] [7] [9] [24]. III. Reliability Testing: Reliability Testing relates to testing software s ability to function in given environental conditions for a particular aount of tie [6] [7] [24]. IV. Security Testing: Security testing includes encryption/decryption techniques to ensure the data counication, checks for ulti user support, and checks within app for the access of files [6] [7] [23] [24]. V. Meory Testing: 13

14 Meory testing is used to check how uch eory the application is taking. It is also used to check for the eory leakage, if the applications are already killed and their active processes are still taking eory [6] [24]. VI. Energy Testing: Energy testing is used to ensure that the applications don t use ore energy than required one. If ore energy is taken by single application then it will reduce the battery life of device [6] [24]. VII. Functional Testing: Functional testing is a quality assurance (QA) process and a type of black box testing that is used to check each and every function works perfectly or not. Functional testing usually describes what the syste actually does. Functional testing tests the portion of the functionality of the whole syste [6] [7] [9]. VIII. Interoperability Testing: Interoperability testing involves testing whether a given software progra or technology is copatible with others and prootes cross-use functionality [7]. IX. Copatibility Testing: Copatibility testing is part of software non-functional tests, is testing conducted on the application to evaluate the application's copatibility with the coputing environent [23] [6] [9]. X. Connectivity Testing: Connectivity testing is a testing activity designed to validate the continuity of network counications [6] [7] [23] [24]. XI. Load Testing: Load testing is the process of putting deand on a syste or device and easuring its response to check its efficiency [9]. 2.3 Epirical Survey There are any different ways to perfor a survey like street surveys, telephone survey and electronic surveys. I used the epirical survey (online survey) to gather required data because it is a suitable strategy to collect data fro ore nuber of people (ethods, tools, developers and copanies) to gain the understanding of larger population [10]. With an increasing use of internet users it is easy to perfor surveys because you can contact the developers or copanies online (i.e. online surveys) and with the availability of this technology the interest to perfor surveys is increasing day by day this. Kitchenha and Pfleeger s [16] show that the interest in doing a survey is increasing in the field of software Engineering. There is another study which is done within the Geran ViSEK project depicts the growing interest of epirical survey. My survey was based on an online questionnaire with three close ended questions and one open ended question (optional) to collect the required inforation. All the three close ended questions [11] have a fixed nuber of options that the respondent has to choose while in open ended question, the respondent is required to write soething as answer. The online questionnaire was 14

15 created on Google Fors [12] and the questionnaire link was provided to respondents via eail. There are two challenges arise in collecting the online survey: (1) keeping track of response sources and (2) preventing ultiple responses fro the sae person [25]. I filtered responses received based on subission tie [15].Since there can be ultiple subissions fro one syste due to browser or internet connectivity proble so screening for tie of subission (within a 2- inute interval) eliinated such duplicate responses. Abiguous responses were not received as our survey was liited to the Android developers of obile applications in play store. Survey responses have to be saved in the database such as Oracle or MySQL [25]. My survey was done through Google Fors so responses were saved online in Google database. 2.4 Preparation of Questionnaire Based on the results of the literature review, the questionnaire was developed.the questionnaire was then discussed with the supervisor and soe changes were ade according to the research questions. The questionnaire was then finalized and sent it to the developers for their feedback. The questionnaire was divided into three parts: The first part was related to the quality characteristics iportance fro their perspective. The second part was related to the actual testing of quality characteristics by Android obile application developers. The third part was related to what testing process is used by developers in testing of Android obile application. The questions were close ended and every question has checkboxes provided for the predefined answer because nowadays ostly people prefer to answer close ended questions [10].There was also one open ended question but that was optional in case if a developer wants to add any other inforation. The questionnaire is provided in the Appendix (A). There was a sequence in the questions so that respondents get interest in filling the survey. The questionnaire did not have a lot of questions as it is said that the ore questions you ask, the ore tie it will take to answer it and respondent will lose their interest in filling the questionnaire [10]. 2.5 Research Design and Data Collection: I divided the quality characteristic iportance into three levels (ost iportant, least iportant and not iportant) and testing of quality characteristic also in three levels (i.e. ostly used, rarely used and never used). By doing the literature review in section 2.2, I found eleven unique quality characteristics for which obile applications are tested for. I included the in the online questionnaire as close ended questions. In addition, I added an open ended question in order to get a response about any other quality characteristic that is also uniquely used by obile application developers. I decided to liit y research to only one online obile application store. So I perfored the survey on Google Play App. store developers, because according to the Sartphone OS Market Share analysis by IDC [13], Android OS has the largest OS arket share as copared to other obile operating systes. Google Play App. Store website [14] enabled us to easily find contact inforation of developers. The questionnaire was sent on 20 th May to 400 developers but I didn t get enough responses. The developers nuber was then increased fro 400 to Again the eail was sent to reaining 600 developer s (300 top rated and 300 low rated) on June15. Three reinders were given to the. First one was in the onth of May, second was in the onth of July and last reinder was given on the onth of August. The questionnaire was open fro 20 th May to 5 th Septeber. 15

16 Total 43 responses were obtained out of 1000 developers contacted of the Google Play App. Store.20 responses out of 500 were obtained fro the top rated apps developers and 23 responses out of 500 were obtained fro the low rated apps developers. All the developers contact inforation was gathered fro Google Play store. 16

17 3 RESULTS The results are categorized according to the top rated developer s response and low rated developer s response separately. The suary of each quality characteristics iportance, testing and testing process is given in the tables with the help of a pie chart. There is one box on which it is entioned any other quality characteristics iportance and its testing level. Blue color indicates the Iportant and Mostly used quality characteristic fro developer s perspective, Red color indicates the Less iportant and Rarely used quality characteristic and yellow color indicates Not iportant and Never used quality characteristics. This color schee applies to all the graphs given in the results section. The analysis on this raw results are perfored in section Top rated apps developer s feedback The results shown below are the feedback I got fro the top rated Apps developers in ters of iportance, testing of quality characteristics and the testing process used to test Android obile applications Iportance of quality characteristics The suary of each quality characteristics iportance according to the top rated developer s perspective are given below in Table 2 with the help of pie chart. Table 2: Quality characteristics iportance by top rated apps developers. 1.1 Usability Testing 1.2 Perforance Testing 1.3 Reliability Testing Iportant 16 80% Iportant 16 80% Iportant 12 60% Less Iportant 4 20% Less Iportant 3 15% Less Iportant 7 35% Not Iportant 0 0% Not Iportant 1 5% Not Iportant 1 5% 1.4 Security Testing 1.5 Meory Testing 1.6 Energy Testing Iportant 14 70% Iportant 13 65% Iportant 12 60% Less Iportant 4 20% Less Iportant 4 20% Less Iportant 3 15% Not Iportant 2 10% Not Iportant 3 15% Not Iportant 5 25% 17

18 1.7 Functional Testing 1.8 Interoperability Test 1.9 Copatibility Testing Iportant 19 95% Iportant 11 55% Iportant 12 60% Less Iportant 1 5% Less Iportant 7 35% Less Iportant 6 30% Not Iportant 0 0% Not Iportant 2 10% Not Iportant 2 10% 1.10 Connectivity Testing 1.11 Load Testing Any other quality characteristic and its iportance? Iportant 12 60% Iportant 10 50% Less Iportant 8 40% Less Iportant 6 30% Not Iportant 0 0% Not Iportant 4 20% None Testing of quality characteristics The Suary of each quality characteristics testing according to the top rated developer s perspective are given below in Table 3 with the help of pie chart. Table 3: Quality characteristics testing by top rated apps developers. 2.1 Usability Testing 2.2 Perforance Testing 2.3 Reliability Testing Mostly Used 14 70% Mostly Used 12 60% Mostly Used 15 75% Rarely used 6 30% Rarely used 7 35% Rarely used 4 20% Never Used 0 0% Never Used 1 5% Never Used 1 5% 18

19 2.4 Security Testing 2.5 Meory Testing 2.6 Energy Testing Mostly Used 12 60% Mostly Used 9 45% Mostly Used 8 40% Rarely used 5 25% Rarely used 7 35% Rarely used 4 20% Never Used 3 15% Never Used 4 20% Never Used 8 40% 2.7 Functional Testing 2.8 Interoperability Test 2.9 Copatibility Testing Mostly Used 17 85% Mostly Used 10 50% Mostly Used 13 65% Rarely used 3 15% Rarely used 7 35% Rarely used 5 25% Never Used 0 0% Never Used 3 15% Never Used 2 10% 2.10 Connectivity Testing 2.10 Load Testing Any other quality characteristic and its testing level? Mostly Used 9 45% Mostly Used 9 45% Rarely used 7 35% Rarely used 5 25% Never Used 4 20% Never Used 6 30% None 19

20 3.1.3 Testing process of top rated applications Below in Table 4 it s been suarized how do the top rated apps developer perfor testing on Android obile applications. Table 4: Testing perfored by top rated developers. 3.2 Low rated apps developer s feedback The results shown below are the feedback I got fro the low rated Apps developers in ters of iportance, testing of quality characteristics and the testing process used to test Android obile applications. 20

21 3.2.1 Iportance of quality characteristics The Suary of each quality characteristics iportance according to the low rated developer s perspective are given below in Table 5 with the help of pie chart. Table 5: Quality characteristics iportance by low rated apps developers. 1.1 Usability Testing 1.2 Perforance Testing 1.3 Reliability Testing Iportant % Iportant 20 87% Iportant % Less Iportant 2 8.7% Less Iportant 3 13% Less Iportant % Not Iportant 0 0% Not Iportant 0 5% Not Iportant 0 0 % 1.4 Security Testing 1.5 Meory Testing 1.6 Energy Testing Iportant % Iportant % Iportant % Less Iportant 3 13% Less Iportant % Less Iportant % Not Iportant 1 4.3% Not Iportant % Not Iportant % 1.7 Functional Testing 1.8 Interoperability Test 1.9 Copatibility Testing Iportant % Iportant % Iportant % Less Iportant 1 4.3% Less Iportant % Less Iportant % Not Iportant 0 0% Not Iportant 1 4.3% Not Iportant 1 4.3% 21

22 1.10 Connectivity 1.11 Load Testing Testing Any other quality characteristic and its iportance? None Iportant % Iportant % Less Iportant % Less Iportant % Not Iportant 2 8.7% Not Iportant 1 4.3% Testing of quality characteristics The suary of each quality characteristics testing according to the low rated developer s perspective are given below in Table 6 with the help of pie chart. Table 6: Quality characteristics testing by low rated apps developers. 2.1 Usability Testing 2.2 Perforance Testing 2.3 Reliability Testing Mostly Used 14 70% Mostly Used 12 60% Mostly Used 15 75% Rarely used 6 30% Rarely used 7 35% Rarely used 4 20% Never Used 0 0% Never Used 1 5% Never Used 1 5% 2.4 Security Testing 2.5 Meory Testing 2.6 Energy Testing Mostly Used 12 60% Mostly Used 9 45% Mostly Used 8 40% Rarely used 5 25% Rarely used 7 35% Rarely used 4 20% Never Used 3 15% Never Used 4 20% Never Used 8 40% 22

23 2.7 Functional Testing 2.8 Interoperability Test 2.9 Copatibility Testing Mostly Used 17 85% Mostly Used 10 50% Mostly Used 13 65% Rarely used 3 15% Rarely used 7 35% Rarely used 5 25% Never Used 0 0% Never Used 3 15% Never Used 2 10% 2.10 Connectivity Testing 2.10 Load Testing Any other testing characteristic and its testing level? Mostly Used 9 45% Mostly Used 9 45% Rarely used 7 35% Rarely used 5 25% Never Used 4 20% Never Used 6 30% None Testing process of low rated applications Below in Table 7 it s been suarized how do the low rated apps developer perfor testing on Android obile applications. Table 7: Testing perfored by low rated apps developers. 23

24 24

25 4 ANALYSIS 4.1 Data Analysis The purpose of data analysis was to copare the quality characteristics with respect to their iportance and how they are actually used by obile application developers. To obtain this, I assigned the points to every type of answer. I.e. I assigned 1 point to Most Iportant and Mostly used characteristic, 0.5 point to Less Iportant and Rarely used and (0) point to Not iportant and Never used. I added these points for each quality characteristic to obtain the total points for that characteristic. Moreover, to represent how the testing is perfored and the coparison of quality characteristics I decided to use Bar Chart to represent y analysis result. 4.2 Top Rated Apps Iportance by top rated developers Here the analysis is being done to understand which quality characteristics are iportant, less iportant and not iportant fro top rated developer s perspective. Table 8 represents the analysis done for the iportance of quality characteristics fro top rated apps developer s perspective. Table 8: Analysis for the iportance of quality characteristics fro top Rated apps developer s perspective. S. Quality Iportant Less Not No Characteristic (1p) Iportant iportant Total Points (0.5p) (0p) 1- Usability Testing 16*(1) = 16 4*(0.5) = 2 0*(0) = = Perforance Testing 16*(1) = 16 3*(0.5) = 1.5 1*(0) = = Reliability Testing 12*(1) = 12 7*(0.5) = 3.5 1*(0) = = Security Testing 14*(1) = 14 4*(0.5) = 2 2*(0) = = Meory Testing 13*(1) = 13 4*(0.5) = 2 3*(0) = = Energy Testing 12*(1) = 12 3*(0.5) = 1.5 5*(0) = = Functional Testing 19*(1) = 19 1*(0.5) = 0.5 0*(0) = = Interoperability 11*(1) = 11 7*(0.5) = 3.5 2*(0) = = 14.5 Testing 9- Copatibility Testing 12*(1) = 12 6*(0.5) = 3 2*(0) = = Connectivity Testing 12*(1) = 12 8*(0.5) = 4 0*(0) = = Load Testing 10*(1) = 10 6*(0.5) = 3 4*(0) = = 13 25

26 The calculation results for each quality characteristic iportance according to top rated developer s perspective can also be illustrated by using bar chart as shown in Figure 1 below: Figure 1: Coparison of iportant quality characteristics fro top rated developer s perspective. According to the survey responses received, the ost iportant quality characteristic for which obile applications are tested for aong obile application developers is functional testing and the least iportant quality characteristic is load testing as illustrated in the Figure 1. We can order these quality characteristics with respect to their iportance as following: 1. Functional Testing 2. Usability Testing 3. Perforance Testing 4. Security Testing 4. Connectivity Testing 6. Reliability Testing 7. Meory Testing 7. Copatibility Testing 9. Interoperability Testing 10. Energy Testing 11. Load Testing 26

27 4.2.2 Testing by top rated developers Here the analysis is being done to understand which quality characteristics are ostly used, rarely used and never used fro top rated developer s perspective. Table 9 represents the analysis done for the testing level of quality characteristics fro top rated apps developer s perspective. Table 9: Analysis for the testing level of quality characteristics fro top rated apps developer s perspective. S. Quality Mostly Rarely Used Never Used No Characteristic Used (0.5p) (0p) Total Points (1p) 1- Usability Testing 14*(1) = 14 6*(0.5) = 3 0*(0) = = Perforance Testing 12*(1 ) = 12 7*(0.5) = 3 1*(0) = = Reliability Testing 15*(1) = 15 4*(0.5) = 2 1*(0) = = Security Testing 12*(1 ) = 12 5*(0.5) = 2.5 3*(0) = = Meory Testing 9*(1) = 9 7*(0.5) = 3.5 4*(0) = = Energy Testing 8*(1) = 8 4*(0.5) = 2 8*(0) = = Functional Testing 17*(1) = 17 3*(0.5) = 1.5 0*(0) = = Interoperability 10*(1) = 10 7*(0.5) = 3.5 3*(0) = =13.5 Testing 9- Copatibility Testing 13*(1) = 13 5*(0.5) = 2.5 2*(0) = = Connectivity Testing 9*(1) = 9 7*(0.5) = 3.5 4*(0) = = Load Testing 9*(1) = 9 5*(0.5) = 2.5 6*(0) = = 11.5 The calculation results for each quality characteristics testing level according to top rated developers can also be illustrated by using Bar Chart as shown in Figure 2 below: 27

28 Figure 2: Coparison of testing level of quality characteristics fro top rated developer s perspective. According to the survey responses received, the ost used quality characteristic aong obile application developers is functional testing and the least used quality characteristic is Interoperability Testing as illustrated in the Figure2. We can order these quality characteristics with respect to their testing as following: 1. Functional Testing 2. Usability Testing 2. Reliability Testing 4. Copatibility Testing 5. Perforance Testing 6. Security Testing 7. Interoperability Testing 8. Connectivity Testing 9. Meory Testing 10. Load Testing 11. Energy Testing Testing process of top rated apps In this section, it is explained how the top rated developers actually test their applications. According to the survey responses received ost of the top rated apps developer while 28

29 creating test cases they prefer to use the test cases that are predefined in scripts or docuents instead of doing testing by theselves (for exaple rando tests, exploratory test etc.). To run their tests, top rated app developers prefer to run their tests on eulator rather than running on phone and 55% of the developers prefer to run their tests autoatically via a tool or service as a cloud while reaining 45% run their tests anually. 4.3 Low Rated Apps Iportance by low rated developers Here the analysis is being done to understand which quality characteristics are iportant, less iportant and not iportant fro low rated developer s perspective. Table 10 represents the analysis done for the iportance of quality characteristics fro low rated apps developer s perspective. Table 10: Analysis for the iportance of quality characteristics fro low Rated apps developer s perspective. S. Quality Iportant Less Not No Characteristic (1p) Iportant iportant Total Points (0.5p) (0p) 1- Usability Testing 21*(1) = 21 2*(0.5) = 1 0*(0) = = Perforance Testing 20*(1 ) = 20 3*(0.5) = 1.5 0*(0) = = Reliability Testing 11*(1) = 11 12*(0.5) = 6 0*(0) = = Security Testing 19*(1 ) = 19 3*(0.5) = 1.5 1*(0) = = Meory Testing 12*(1) = 12 6*(0.5) = 3 5*(0) = = Energy Testing 11*(1) = 11 7*(0.5) = 3.5 5*(0) = = Functional Testing 22*(1) = 22 1*(0.5) = 0.5 0*(0) = = Interoperability 13*(1) = 13 9*(0.5) = 4.5 1*(0) = = 17.5 Testing 9- Copatibility 14*(1) = 14 8*(0.5) = 4 1*(0) = = 18 Testing 10- Connectivity Testing 12*(1) = 12 10*(0.5) = 5 1*(0) = = Load Testing 10*(1) = 10 11*(0.5) = 5.5 2*(0) = =

30 The calculation results for each quality characteristic iportance can also be illustrated by using Bar Chart as shown in figure (3) below: Figure 3: Coparison of iportant quality characteristics fro low rated developer s perspective. According to the survey responses received, the ost iportant quality characteristic aong obile application developers is functional testing and the least iportant quality characteristic is eory testing as illustrated in the Figure 3. We can order these quality characteristics with respect to their iportance as following: 1. Functional Testing 2. Usability Testing 3. Perforance Testing 4. Security Testing 5. Copatibility Testing 6. Interoperability Testing 7. Reliability Testing 7. Connectivity Testing 9. Load Testing 10. Energy Testing 11. Meory Testing Testing level by low rated developers Here the analysis is being done to understand which quality characteristics are ostly used, rarely used and never used fro low rated developer s perspective. Table 11 represents the 30

31 analysis done for the testing level of quality characteristics fro low rated apps developer s perspective. Table 11: Analysis for the testing level of quality characteristics fro low Rated apps developer s perspective. S. Quality Mostly Rarely Used Never Used Total Points No Characteristic Used (0.5p) (0p) (1p) 1- Usability Testing 18*(1) = 18 5*(0.5) = 2.5 0*(0) = = Perforance Testing 13*(1 ) = 13 10*(0.5) = 5 0*(0) = = Reliability Testing 10*(1) = 10 10*(0.5) = 5 3*(0) = = Security Testing 11*(1 ) = 11 8*(0.5) = 4 4*(0) = = Meory Testing 3*(1) = 3 14*(0.5) = 7 6*(0) = = Energy Testing 5*(1) = 5 8*(0.5) = 4 10*(0) = = 9 7- Functional Testing 19*(1) = 19 4*(0.5) = 2 0*(0) = = Interoperability 6*(1) = 6 15*(0.5) = 2*(0) = = 13.5 Testing Copatibility 8*(1) = 8 14*(0.5) = 7 1*(0) = = 15 Testing 10- Connectivity Testing 7*(1) = 7 15*(0.5) = 1*(0) = = Load Testing 4*(1) = 4 15*(0.5) = 4*(0) = = The calculation results for each quality characteristic can also be illustrated by using Bar Chart as shown in figure (4) below: 31

32 Figure 4: Coparison of testing level of quality characteristics fro low rated developer s perspective. According to the survey responses received, the ost used quality characteristic aong obile application developers is functional testing and the least used quality characteristic is energy testing as illustrated in the Figure 4. We can order these quality characteristics with respect to their testing as following: 1. Functional Testing 2. Usability Testing 3. Perforance Testing 4. Security Testing 4. Copatibility Testing 4. Reliability Testing 7. Connectivity Testing 8. Interoperability Testing 9. Load Testing 10. Meory Testing 11. Energy Testing Testing process by low rated developers In this section, it is explained how the low rated developers actually test their applications. According to the survey responses received ost of the low rated apps developer while creating test cases they prefer to use the test cases that are predefined in scripts or docuents instead of doing testing by theselves (for exaple rando tests, exploratory test etc.). To 32

33 run their tests, low rated app developers also prefer to run their tests on eulator rather than running on phone and 70% of the developers prefer to run their tests autoatically via a tool or service as a cloud while reaining 30% run their tests anually. 4.4 Coparison of quality characteristics iportance, testing and their testing process In this section the analysis which was done earlier for the top rated and low rated is copared. The ost iportant quality characteristics aong top rated and low rated apps developer for which obile applications are tested is functional testing and usability testing and these quality characteristics are ostly used by both of the when testing obile applications. Quality characteristics which are not that iportant fro top rated developer s perspective for which obile applications are tested is load testing and energy testing and they are not used often by top rated apps developer. Quality characteristics which are not that iportant fro low rated developer s perspective is energy testing and eory testing and these quality characteristics are not used often by low rated apps developers. When it coes to testing, top rated and low rated developer s both create test cases that are predefined in scripts or docuents. Both developer s prefer to execute their tests on eulator rather than on obile and they prefers to run their tests autoatically via a tool or service as a cloud. The iportance, testing and testing process of top rated apps and low rated apps developer doesn t differ uch but when it coes to uniportance and not testing of quality characteristics for which obile applications are tested for it differs between top rated and low rated apps. 33

34 5 DISCUSSION In this research study I explored various quality characteristics that are used in testing of Android obile applications. Then an epirical study was perfored to verify the literature findings by conducting an epirical survey. The iportance and testing of quality characteristics of both the top rated and low rated were figured out. Moreover, the testing process used by top rated apps developer and low rated apps developer was also figured out. Answer to Research questions: RQ1: What are the quality characteristics that obile applications are tested for? Answer: 11 different quality characteristics that the obile applications are tested for is found fro the literature I-e Usability Testing, Perforance Testing, Reliability Testing, Security Testing, Meory Testing, Energy Testing, Functional Testing, Copatibility Testing, Interoperability Testing, Connectivity Testing and Load Testing. RQ2: Which are the ost and least iportant quality characteristics for which obile applications is tested for according to developer s perspective? Answer: According to the survey responses top rated apps developers and low rated apps developer both responded functional testing and usability testing are the ost iportant quality characteristics for which the obile application is tested for. Top rated apps developer responded energy testing, load testing are not iportant while low rated apps developer responded eory testing and energy testing are not iportant when testing Android obile applications. So the results differ between top rated and low rated apps developer when asked about the not iportant testing characteristics for which the obile applications are tested for. RQ3: Which are the frequently and barely quality characteristics for which the obile applications is actually tested for by developers? Answer: According to the survey responses top rated apps developers and low rated apps developers both responded functional testing, usability testing are the ost tested quality characteristics for which the obile applications is tested for. Top rated apps developer responded energy testing, load testing are not tested often while low rated apps developer responded eory testing and energy testing are not tested often when testing Android obile applications. So the results differ between top rated and low rated apps developer when asked about the not tested quality characteristics for which the obile applications are tested for. RQ4: Does the iportance and testing of quality characteristics for which the obile application is tested for differs between top rated and low rated apps developer? Answer: According to the results, the iportance and testing of quality characteristics that the obile applications are tested for doesn t differ between top rated and low rated apps developer doesn t differ. They both responded functional testing and usability testing is ost iportant and ostly tested quality characteristics for which obile applications are tested for. There is a difference between top rated apps developer and low rated apps developer regarding uniportance and not tested quality characteristic for which the obile applications are tested for. Top rated apps developer responded energy testing and load testing are not that iportant fro their perspective and is not tested often. Low rated apps developer responded eory testing and energy testing is not iportant so they don t test it often. 34

35 RQ5: How are the Android obile applications tested? Answer: Most of the developers create test cases that are predefined in scripts or docuents. They prefer to execute their tests on eulator rather than on obile. They run their tests autoatically via tool or service as a cloud. 35

36 6 CONCLUSION My research objective was to find out which quality characteristics are iportant and not iportant for which the obile applications are tested for fro developer s perspective and how they are actually tested by Android obile application developers and the testing process used by the for testing of Android obile applications. My research result shows that functional testing and usability quality characteristics for which the obile applications are tested for are very iportant fro top rated and low rated app developer s perspective and are ostly tested by obile application developers in testing of Android obile applications. Top rated apps developer think energy testing and load testing are not that iportant fro their perspective and they don t test it often. Low rated apps developer thinks energy testing and load testing is not that iportant and they don t test it often. When it coes to testing process, both the developers create test cases that are predefined in scripts or docuents. Both of the prefer to execute their tests on eulator rather than on obile and prefers to run their tests autoatically via a tool or service as a cloud. The iportance, testing and testing process of Android obile application doesn t differ between top rated and low rated apps developer. The quality characteristics uniportance and not tested differs between top rated and low rated apps developer. 6.1 Validity I filtered responses received based on subission tie [15]. Since there can be ultiple subissions fro one syste due to browser or internet connectivity proble so screening for tie of subission (within a 2-inute interval) eliinated such duplicate responses. Abiguous responses were not received as y survey was liited to the Android developers of obile applications in play store. In the start I contacted 400 developers and I expected to get a response fro at least 50 people but unfortunately I couldn t get that response. So I had to increase the nuber of developers to 1000 and I got 43 responses and received response ratio was 4.3%. Reinder eail was sent continuously to increase the nuber of responses. Following are the validity threats to y research work: 1. I targeted the developers of only one obile platfor and didn t consider other platfor developers. The results claied are only for Android obile application developers. 2. I didn t ask about the experience of developers during the survey, so every respondent is considered as equally experienced. 3. The quality of apps developed by respondents was not exained. Every app was given equal iportance and the apps were chosen on their rating. Nuber of downloads or year of the app was not easured. 4. I didn t consider the doain of obile application developers as the iportance and testing of quality characteristics also depends on the obile application type. 5. The questionnaire ight not be designed properly which can result in confusion and isinterpretation for developers. 6. I only used backward snowballing approach and did not use forward snowballing approach which can be added to threats to validity. 36

37 6.2 Future Work For future research, the survey can be extended to ore nuber of developers and different platfors so that ore nuber of responses can be received that allows statistical analysis and therefore brings significant to our results. Coparison can be done with different platfors and see whether all the platfors use the sae quality characteristics for which obile applications are tested for or not. Moreover, in future it can be figured out why the uniportance and not testing of quality characteristics for which obile applications are tested for differ between top rated and low rated apps developer. 37

38 7 REFERENCES [1] G. Chen and D. Kotz, A Survey of Context-Aware Mobile Coputing Research, Hanover, NH, USA, Tech. Rep., [2] Zhifang Liu,Xiaopeng Gao, Xiang Long. Adaptive Rando Testing of Mobile Application,Coputer Engineering and Technology (ICCET), nd International Conference on (Volue:2) April 2010,pp V V [3] Coibra Morgado, I. Paiva, A.C.R.; Faria, J.P. Autoated Pattern-Based Testing of Mobile Applications.Pattern Recognition, Inforatics and Mobile Engineering (PRIME), 2014 International Conference on Sept pp [4] Gartner, "Gartner Says Worldwide Traditional PC, Tablet, Ultraobile and Mobile Phone Shipents Are On Pace to Grow 6.9 Percent in 2014",March, 2014, last acessed April [5] AppBrain, "AppBrain Stats", last accessed May, [6] Kirubakaran, B. Karthikeyani,V. Mobile Application Testing Challenges and Solution Approach through Autoation.Pattern Recognition, Inforatics and Mobile Engineering (PRIME), 2013 International Conference on Feb pp [7] Jerry Gao, Xiaoying Bai, Wei-Tek Tsai, Tadahiro Uehara. "Mobile Application Testing: A Tutorial". Coputer (Volue: 47, Issue: 2), 02 January pp [8] Robert M. Groves, Floyd J. Fowler, Jr., Mick P. Couper, Jaes M. Lepkowski, Eleanor Singer, Roger Tourangeau. "Survey Methodology, 2nd Edition". ISBN: July [9] Kochhar, P.S ; Thung, F. ; Nagappan, N. ; Zierann, T. Understanding the Test Autoation Culture of App Developers Software Testing, Verification and Validation (ICST), 2015 IEEE 8th International Conference on April 2015,pp [10] Teade Punter, Marcus Ciolkowski, Bernd Freiut, Isabel John. Conducting Online Surveys in Software Engineering. Epirical Software Engineering, ISESE Proceedings International Syposiu. Oct pp [11] Dillan D., Syth J., & Christioan LM. (2009) Internet and Mixed-Mode Surveys. The Tailored Design Method. John Wiley & Sons. New Jersey.Q. [12] Google For Last accessed August 30, [13] Sartphone OS Market Share, Q " [14] Google Play App. Store. Last accessed August [15] M. V. Sel and N. W. Jankowski, Conducting online surveys, Qual. Quantity, vol. 40, no. 3, pp , [16] B. Kitchenha, S. Pfleeger, Principles of Survey Research series of 6 articles, in: ACM Sigsoft Software Engineering Notes, Vol 26 (No.6), Vol 27 (No. 1,3,5), Vol 28 (No.2),

39 [17] T. Takala, M. Katara, and J. Harty, Experiences of syste-level odelbased GUI testing of an Android application, in ICST, pp , [18] P. Bhattacharya, L. Ulanova, I. Neatiu, and S. C. Koduru, An epirical analysis of bug reports and bug fixing in open source Android apps, in CSMR, pp , [19] M. Kropp and P. Morales, Autoated GUI testing on the Android platfor, Testing Software and Systes, p. 67, [20] M. D. Syer, M. Nagappan, B. Adas, and A. Hassan, Revisiting prior epirical findings for obile apps: An epirical case study on the 15 ost popular open source Android apps, in CASCON, pp , [21] T. McDonnell, B. Ray, and M. Ki, An epirical study of API stability and adoption in the Android ecosyste, in ICSM, pp , [22] Kuar Maji, K. Hao, S. Sultana, and S. Bagchi, Characterizing failures in obile cases: A case study with Android and Sybian, in ISSRE, pp , [23] Harleen K. Flora, Xiaofeng Wang, Swati V.Chande, An Investigation into Mobile Application Developent Processes: Challenges and Best Practices in IJMECS Vol.6, No. 6, June [24] Muccini, H. Di Francesco, A, Esposito, P, Software testing of obile applications: Challenges and future research directions Autoation of Software Test (AST), th International Workshop on 2-3 June 2012.pp [25] Singh A., Taneja A., Mangalaraj G. "Creating online surveys: soe wisdo fro the trenches tutorial". Professional Counication, IEEE Transactions. Volue: 52, Issue: pp [26] Wohlin, Guidelines for Snowballing in Systeatic Literature Studies and a Replication in Software Engineering, in: Proceedings of the 18th International Conference on Evaluation and Assessent in Software Engineering (EASE'14), ACM, London, UK, [27] S M K Quadri & Farooq, S.U. 2010, "Software Testing - Goals, Principles, and Liitations", International Journal of Coputer Applications, vol. 6, no. 9. [28] Logeshwaran Murugesan, Prakash Balasubraanian. Cloud Based Mobile Application Testing Coputer and Inforation Science (ICIS), 2014 IEEE/ACIS 13th International Conference on 4-6 June 2014, PP [29] C. Wohlin, Guidelines for Snowballing in Systeatic Literature Studies and a Replication in Software Engineering, in: Proceedings of the 18th International Conference on Evaluation and Assessent in Software Engineering (EASE'14), ACM, London, UK,

40 8 APPENDIX A: QUESTIONNAIRE Thank you for taking the tie to coplete the survey. The survey consists of ultiple choice questions and will take about 5 inutes. The responses fro this survey will be used to analyze which testing characteristic is iportant and is ostly used in obile application, and how actually the applications are tested. Q1: Which Testing Characteristic is iportant in testing of obile applications? 1-Usability Testing (activities that assess UI content and alerts, user operation flows and scenarios, edia richness, and gesture interaction) o Iportant o Less iportant o Not iportant 2-Perforance Testing (activities for deterining the speed or effectiveness of coputer, network, software progra or device) o Iportant o Less iportant o Not iportant 3-Reliability Testing (relates to testing software s ability to function in given environental conditions for a particular aount of tie) o Iportant o Less iportant o Not iportant 4-Security Testing (includes eleents of confidentiality, integrity, authentication, authorization) o Iportant o Less iportant o Not iportant 5-Meory Testing (eory leaks ay occupy the liited eory resource) o Iportant o Less iportant o Not iportant 6-Energy Testing (active processes of killed applications ay reduce the device battery freedo) o Iportant o Less iportant o Not iportant 7-Functional Testing (To test each and every function works properly or not) o Iportant o Less iportant o Not iportant 40

41 8-Interoperability Testing (involves testing whether a given software progra or technology is copatible with others and prootes cross-use functionality) o Iportant o Less iportant o Not iportant 9- Copatibility Testing (part of software non-functional tests, is testing conducted on the application to evaluate the application's copatibility with the coputing environent) o Iportant o Less iportant o Not iportant 10-Connectivity Testing (A testing activity designed to validate the continuity of network counications.) o Iportant o Less iportant o Not iportant 11-Load testing (the process of putting deand on a syste or device and easuring its response) o Iportant o Less iportant o Not iportant Any Other Testing Characteristic? (Please write in the box with its iportance) Q2: Which Testing Characteristic is ostly used in testing of obile applications? 1-Usability Testing o Mostly used o Rarely used o Never used 2-Perforance Testing o Mostly used o Rarely used o Never used 3-Reliability Testing o Mostly used o Rarely used o Never used 41

42 4-Security Testing o Mostly used o Rarely used o Never used 5-Meory Testing o Mostly used o Rarely used o Never used 6-Energy Testing o Mostly used o Rarely used o Never used 7-Functional Testing o Mostly used o Rarely used o Never used 8-Interoperability Testing o Mostly used o Rarely used o Never used 9-Copatibility Testing o Mostly used o Rarely used o Never used 10-Connectivity Testing o Mostly used o Rarely used o Never used 11-Load testing o Mostly used o Rarely used o Never used Any Other Testing Characteristic? (Please write in the box with its usage level) 42

43 Q3: How do you actually test your applications? 1- How do you create Test Cases? o Predefined in scripts or docuents o By doing testing itself (for exaple Rando inputs, Exploratory Testing) o Other 2- How do you execute Tests? o On Phone o On Eulator o Other 3- Do you run your tests? o Manually o Autoatically (via tool or Testing as a Service/Cloud) o Other 43

44 9 APPENDIX B: TOP RATED DEVELOPER S INFORMATION: This is publicly available inforation fro the GOOGLE PLAY STORE and it doesn t include any personal inforation that the developer s provided as part of the survey. Application Nae Rating Developer Nae Eail SVT Play 4 Sveriges [email protected] Television AB FB Messenger 4 Facebook [email protected] Spotify Music 4.5 Spotify Ltd. [email protected] ZigZag 4 Ketchapp [email protected] Agent Alice 4.2 Wooga [email protected] Instagra 4.5 Instagra [email protected] Crossy Road 4.5 Yodo1 Gaes [email protected] Skype - free IM & video calls 4 Skype [email protected] Snapchat 4 Snapchat, Inc [email protected] Viber 4.3 Viber Media S.à r.l. [email protected] Candy Crush Soda Saga 4.2 King [email protected] WhatsApp Messenger 4.4 WhatsApp Inc. [email protected] 360 Security - Antivirus Boost 4.4 Qihoo 360 (NYSE:QIHU) [email protected] Netflix 4.4 Netflix, Inc. [email protected] Clean Master (Speed Booster) 4.7 Cheetah Mobile [email protected] Super-Bright 4.5 Surpax [email protected] LED Torch Technology Inc. Bus Siulator 4.1 Ovidiu Pop [email protected] 2015 Subway Surfers 4.4 Kiloo [email protected] App of the Day Appturbo [email protected] 100% Free Kik 4.2 Kik Interactive [email protected] Wish - Shopping Made Fun 4.4 Wish Inc. [email protected] Unblock king 4.2 obirix [email protected] All-In-One 4.6 AIO Toolbox Inc. [email protected] Toolbox AdVenture 4.4 Kongregate [email protected] Capitalist M Fingers 4.1 Noodlecake Studios Inc [email protected] My Talking Angela 4.3 Outfit7 [email protected] One Finger Death Punch 4 obirix [email protected] Teple Run Iangi Studios [email protected] Hill Clib 4.4 Fingersoft [email protected] Racing City Maps 2Go 4.1 Ulon GbH [email protected] 44

45 Offline Maps Clash of Clans 4.4 Supercell Badoo - Meet New People 4.4 Badoo [email protected] Swordigo 4.3 Touch Foo [email protected] Geoetry Dash Lite 4.4 RobTop Gaes [email protected] Lifesu Calorie Counter 4.2 ShapeUp Club AB [email protected] CM Security 4.7 Cheetah Mobile [email protected] Antivirus AppLock 8 Ball Pool 4.4 Miniclip.co [email protected] Twitter 4.1 Twitter, Inc. [email protected] RunKeeper FitnessKeeper, Inc [email protected] GPS Track Run Walk QR Code Reader 4 Scan, Inc. [email protected] Bloons Monkey City 4.1 ninja kiwi [email protected] Adobe Reader 4.3 Adobe [email protected] Hay Day 4.4 Supercell [email protected] Fruit Ninja Free 4.3 Halfbrick Studios [email protected] Pinterest 4.7 Pinterest, Inc. [email protected] Bike Race Free - Top Free Gae 4.5 Top Free Gaes. [email protected] Wordfeud FREE 4.5 Bertheussen IT [email protected] Hungry Shark Evolution 4.4 Future Gaes of London [email protected] Battery Saver 4.1 IGNIS AMERICA, INC. [email protected] ytuner Radio 4 Appgeneration [email protected] UK Despicable Me 4.4 Gaeloft [email protected] Shaza 4.4 Shaza [email protected] Entertainent Liited PriceSpy 4.1 Prisjakt Sverige [email protected] AB Gae of War - Fire Age 4.1 Machine Zone, Inc. [email protected] LEGO Juniors 4 The LEGO Group [email protected] Create & Cruise FarVille: 4 Zynga [email protected] Harvest Swap Touchgrind BMX 4.1 Illusion Labs [email protected] Sonic Dash 4.4 SEGA of Aerica [email protected] AntiVirus Security - FREE 4.4 AVG Mobile [email protected] Pirate Kings 4.2 Jelly Button [email protected] Gaes Traffic Racer 4.4 Soner Kara [email protected] Angry Birds Go! 4.2 Rovio [email protected] Entertainent Ltd Eniro Navigation 4.2 Eniro [email protected] - Offline GPS 45

46 Barbie Magical Fashion 4 Budge Studios [email protected] SoundCloud - Music & Audio 4.4 SoundCloud [email protected] Torch - Tiny 4.4 Nikolay Ananiev [email protected] Flashlight Zalando 4.4 Zalando SE [email protected] Shopping & Fashion Tango: Free 4.2 Tango [email protected] Video Calls & Text LINE: Free Calls & Messages 4.2 LINE Corporation [email protected] GO Keyboard GO Keyboard Dev [email protected] Eoji, Tea Eoticons Frozen Free Fall 4.3 Disney [email protected] Yr 4.2 NRK [email protected] VLC for Android 4.3 beta Videolabs [email protected] 1010! Puzzle 4.2 Gra Gaes [email protected] io free video calls and chat 4.2 io.i [email protected] Castle Clash 4.6 IGG.COM [email protected] Firefox Browser for Android 4.3 Mozilla [email protected] Twitch 4.4 Twitch Interactive, [email protected] Inc Shaza 4.4 Shaza [email protected] Entertainent Liited RIX FM 4 MTG AB [email protected] Radio FM 4 RadioFM [email protected] SoundHound 4.3 SoundHound Inc. [email protected] djay FREE 4.1 Algoriddi [email protected] Deezer Music 4 Deezer Mobile [email protected] Walk Band: 4.3 Revontulet Soft [email protected] Piano,Guitar,Dru Inc.. Top Music 4.1 Top Music App [email protected] Player Shuttle Music Player 4.1 SipleCity [email protected] Real Piano Free 4 Gisart [email protected] Ringtone Maker and Editor 4.1 Zabaan [email protected] Laya Music 4 SVAIRIN [email protected] Player Voice Recorder 4.4 lovekara [email protected] My Guitar 4 Borce Trajkovski [email protected] Music Player : Rocket Player 4.3 JRT Studio [email protected] Collage Maker 4.1 Drea Solutions [email protected] Pro YouCa Perfect 4.3 CyberLink.co [email protected] - Selfie Ca 46

47 HD Caera Ultra 4.3 Jess Developent Video Maker 4 Multiedia Apps [email protected] Splash Colour 4 Swiss [email protected] Effects Codeonkeys Open Caera 4.2 Mark Haran [email protected] PhotoWonder 4.3 Baidu HK [email protected] InstaMag 4.3 Fotoable,Inc. [email protected] Sart 4.6 Alex Kravchenko [email protected] AudioBook Player Hugo Troll Race 4 Hugo Gaes ApS [email protected] Logo Quiz - 5 Mangoo Gaes [email protected] Svenska ärken EA SPORTS 4.4 ELECTRONIC [email protected] UFC ARTS Criinal Case 4.6 Pretty Siple [email protected] Archery Master 3D 4.4 TerranDroid [email protected] Baby Cops: Tiny 4.1 TabTale [email protected] Police Acadey Monster Busters: 4.7 Purplekiwii [email protected] Hexa Blast Banana Pirate 4.7 JDerp Studios [email protected] FRONTLINE 4.2 Glu [email protected] COMMANDO: WW2 Princess PJ Party 4.1 TabTale [email protected] Fashion Story: 4.4 Stor8 Studios [email protected] Pink Punk YAHTZEE 4.5 Scopely [email protected] With Buddies Fancy Nail Shop 4 Tabtale [email protected] Splash: 4 DeNA Corp. [email protected] Underwater Sanctuary Iplosion - Never Lose Hope 4.5 Rayark Inc [email protected] Foot Surgery Siulator 4 667g [email protected] Restaurant Story: 4.5 Earth Day Stor8 Studios [email protected] Borderline - Life on the Line 4.2 CrazyLabs [email protected] Captain Rocket 4.3 Ketchapp [email protected] UNT 4.8 NTM AB [email protected] Candy Block Pop 4.1 block bubble tap [email protected] Pinball Sniper 4.5 Ketchapp [email protected] Candy Bubble Shooter 4.2 pop star red [email protected] Police Cars vs Street Racers 4.2 VascoGaes [email protected] TeeHee: Official Ryan Higa App 4.9 Ryan Higa [email protected] Moy Queen's 4.2 Kids Go Media [email protected] Newborn Ice Baby 47

48 5 Differences ~ Photo Quiz 4.3 Taps Arena [email protected] Crie Town Police Car Driver 4.1 Tapinator, Inc. (Ticker: TAPM) [email protected] Hovercraft High Score Hero [email protected] Build Fly Retry LLC Google 4.6 Google Inc. [email protected] Handwriting Input Epires and 4.6 Zynga [email protected] Allies Truck Driver 3D: 4 Offroad Rooster Gaes [email protected] Candy Sugar Splash 4.2 Fat Face Photo Frae [email protected] Unblock Ball 4.3 igold Technologies [email protected] Dragon Hills 4.7 Rebel Twins [email protected] Police Moto Driver 4 nullapp [email protected] Cruise Kids - Ride the Waves 4 Tabtale [email protected] Perfect Pitch HighSchool Girls 4.4 Ipro [email protected] Peppa in the Superarket 4.1 Peppa pig gaes [email protected] Secret 4.1 Pocket Ges [email protected] Passages:Hidden Objects Eleven(11) 4.2 boxes ania [email protected] Dungeon Link 4.6 GAMEVIL Inc [email protected] Escape City 4.5 Mobigrow [email protected] My Newborn Pet Baby 4.2 Libii [email protected] Reote Control for TV 4 TUR Software Developing [email protected] Ice Moy's g [email protected] Newborn Baby Magic Rush: 4.5 Elex [email protected] Heroes Fashion Doll: Pastry Chef SPA 4.3 Salon [email protected] City 4.1 Chi Chi Gaes a @yahoo.co.tw Crie:Mafia Assassin 3D Furious Racing 4.2 Haerhead [email protected] Studio Party Bus Driver 4.1 Tapinator, Inc. [email protected] 2015 (Ticker: TAPM) Pop Ge HD 4.3 GiGalaxy [email protected] Pony Gives Birth 4.2 Baby Gaes Titan Media [email protected] FilOn Faily Live TV Free 4.1 Flon [email protected] Gold Thee for 4.6 Eoji Keyboard [email protected] KikaKeyboard Thee Studio Pet Heroes: 4.3 Libii [email protected] Firean 48

49 Candy Bubble World 4.1 block bubble tap Shall we 4.7 NTT Solare date?:blood in Corp. Roses+ Driver Speedboat 4.3 Ubisoft Paradise Entertainent Reskoll 5 MTR Stockhol [email protected] Stockhol AB Wedding 4.3 TNN gae [email protected] Preparation Salon Lion vs Zobies 4 Tapinator, Inc. [email protected] (Ticker: TAPM) TWIST3D 4.1 Chroa Studios [email protected] Fake Call & Fake 4.2 SMS Onex Softech [email protected] AIK Fotboll atchprogra 5 AIK Fotboll AB [email protected] Furious 3D 4.4 MobileGaes [email protected] Abulance Race 2015 Grand Escape 4.5 Goblin LLC [email protected] Furious Fast Taxi 4.2 TricoGaes [email protected] Driver 2015 Helicopter Flight 4 i6 Gaes [email protected] Siulator 3D Keypad Lock Screen 4.6 WoW Lock Screen [email protected] MobiTV - Watch 4.4 TV Live Undertap [email protected] Furious Russian 4.2 MobilePlus [email protected] Vendetta Kitty Moy 4.3 Kids Go Media [email protected] Angel's New Baby Police Car Racer 4 sst [email protected] 3D PopCorn Blast 4.4 RetroStyle Gaes [email protected] Crazy Dessert Maker 4.3 Sunstor [email protected] Peppa kids ini 4.1 Peppa pig gaes [email protected] gaes City Biker 3D 4.3 Tapinator, Inc. [email protected] (Ticker: TAPM) Bakery Story: Spring 4.5 Stor8 Studios [email protected] Ninja Runner 3D 4.1 Fast Free Gaes [email protected] Wild West Escape 4.5 Trapped [email protected] Nitro Nation 4.1 Creative Mobile [email protected] Stories Block Shock 4 Apex Apps [email protected] DMCC Pet heros land 4.1 MonkeyIde [email protected] Solitaire King 4.4 obirix [email protected] Word Acadey 4.5 SCIMOB [email protected] Must Deliver 4.6 cherrypick gaes [email protected] 49

50 Parkour 4.1 Tab Ause Studio Siulator First Person PlayTube 4.2 Alfa Studio Baby Hazel Siblings Day 4.4 Axis Entertainent Crie City Street 4 i6 Gaes [email protected] Driving 3D Firean 4.3 MobileGaes [email protected] Eergency Rescue 2015 Zoo Puzzle for kids & toddlers 4.9 Puzzle King AB [email protected] Nationsguiden 5 Swace Digital AB [email protected] Monster Puzzle 3D MMORPG 4.5 Wizardcoders Gaes [email protected] Tiltagon 4.1 Noodlecake [email protected] Studios Inc This Means 4 kaba [email protected] WAR! Super realis Clock Weather 4.6 Weather Widget Tea [email protected] Words Crush! 4.4 BitMango [email protected] Balloons Pop 4 Peppa pig gaes [email protected] Peppa Kids Gaes Lazys Clean & 4.5 Lazys Austra [email protected] Wipe PlayTube HD 4.4 aoaibio [email protected] Free Mp3 Music PRO PDF Reader 4.4 Ivan Ivanenko [email protected] Sverige Radio 4.7 Pollux Studios [email protected] Running Circles 4.2 BooBit Gaes [email protected] Final Fable 4.4 IGG.COM [email protected] Angry Birds Fight! 4.4 Rovio Entertainent Ltd. [email protected] Arrow 4.3 Ketchapp [email protected] Sart Search & Web Browser 4.5 Reactive Phone [email protected] Far Story 2: 4.2 Stor8 Studios [email protected] Birthday Party Crazy Beach 4.1 Coco Play By [email protected] Party-Coco TabTale Suer! Res i STHLM: 4.7 Nobina [email protected] SL trip planner Kodi 4.7 XBMC Foundation [email protected] Kivra 4.3 Kivra [email protected] Bohusläningen 4 Stapen Local Media [email protected] Triple Jup 4 Ketchapp [email protected] Transparent 4.2 Kuboo Gae [email protected] Launcher Studios Caera Brickies 4 Noodlecake [email protected] 50

51 Studios Inc P3 Radio 4.3 Sveriges Radio Digging Mania 4.1 konaobile Spot the 4.1 Taps Arena Difference! My Tiny Pet 4.3 CanadaDroid HTC Sense Input 4.2 Htc cooperation - EN Donut Haze 4.1 Qublix Gaes NA O Open Art 4.5 Proedia [email protected] Mitt Dory 4.2 Dory Golf [email protected] HTC Sense Input 4.4 Htc cooperation [email protected] - EN(UK) Siegefall 4.2 Gaeloft [email protected] Doteater 4.3 Tiny Gaes Srl [email protected] My Sweet 4.1 Tabtale [email protected] Bakery - Donut Shop (FREE) GO SMS 4.5 Ztart [email protected] LUMINOUS THEME Extree Car 4.2 Tapinator, Inc. [email protected] Stunts 3D (Ticker: TAPM) Deolition 4.2 Lunagaes Fun & [email protected] Derby: Crash Gaes Racing Real Cricket Test Match 4 Nautilus Mobile [email protected] Dubai Drift Zero Four LLC [email protected] Perfect Kick 4.4 Gaegou Liited [email protected] Meorado Meorado Gbh [email protected] Brain Gaes Paperaa 4.4 FDG [email protected] Entertainent GbH & Co.KG Angry Birds Rovio [email protected] Entertainent Ltd. Warhaer 4.1 HeroCraft Ltd [email protected] 40,000: Space Wolf VEGA Conflict 4.1 KIXEYE [email protected] Pocket Mine Roofdog Gaes [email protected] Heroes of Order & Chaos 4.3 Gaeloft [email protected] Etherlords (Arena) 4.4 Nival [email protected] Feed Me Oil CHILLINGO [email protected] Super Muzzle 4.1 Die Studios [email protected] Flash Battle of Heroes 4.3 Ubisoft [email protected] Entertainent Kritika: The White Knights 4.2 GAMEVIL Inc [email protected] Dungeon Rush 4 DH Gaes [email protected] 51

52 Monster Squad 4.3 NEXON M Inc. [email protected] Tiny Warriors 4 Noodlecake Studios Inc [email protected] League of 4.4 GTArcade [email protected] Angels -Fire Raiders The Secret Society 4.3 G5 Entertainent [email protected] Pirate Battles: Corsairs Bay 4 HeroCraft Ltd [email protected] JellyKing : Rule The World 4 Jellyking Studio [email protected] King of Thieves 4.4 ZeptoLab [email protected] Ball King 4.5 Qwiboo Ltd [email protected] Happy Chicken Town 4 (주)쏘뉴 [email protected] Bears vs. Art 4.2 Halfbrick Studios [email protected] Zen Koi - Breed 4.2 LandShark [email protected] & Collect Fish Ingress 4.3 NianticLabs@Goo [email protected] gle DRAGON 4 BANDAI [email protected] BALL Z NAMCO DOKKAN BATTLE Konbini Story 4.3 Gaenai [email protected] Epire: Four Kingdos 4.2 Goodgae Studios [email protected] os.co Solitaire TriPeaks 4.3 GSN.co [email protected] Kill Shot 4.3 Hothead Gaes [email protected] GrandChase M 4.1 Eyedentity Mobile [email protected] Bears vs. Art 4.2 Halfbrick Studios [email protected] Super Muzzle Flash 4.1 Die Studios [email protected] Yr 4.2 NRK [email protected] Copass 4.3 espengineer [email protected] Candy Crush 4.3 King [email protected] Saga Booking.co 4.6 Booking.co [email protected] Hotel Reservations Crossy Road 4.5 Yodo1 Gaes [email protected] App of the Day Appturbo [email protected] 100% Free V live 4.4 NAVER Corp. [email protected] Broadcasting app GO SMS Thee 4.3 GO Dev Tea [email protected] DIY Cloud Path 4.2 Ketchapp [email protected] Case Siulator Soked Studios [email protected] Luxury Clock 4.4 Cheetah Mobile [email protected] CM Locker 52

53 Thee Snowboard 4 EnJen Gaes [email protected] Freestyle Mountain Stagefright Detector 4.3 Lookout Mobile Security [email protected] Allone 4.5 Allone AB [email protected] Extree Car 4.1 Pudlus Gaes [email protected] Driving 2016 Funny Photo 4 Dexati [email protected] Effects Best Fiends 4.5 Digital studios [email protected] Arcane Legends 4.4 Spacetie Gaes [email protected] Nitro Nation Online Racing 4.3 Creative Mobile [email protected] Don't get fired! 4.1 QuickTurtle [email protected] MARVEL 4.2 Kaba [email protected] Contest of Chapions Top Developer 4.5 TACOTY JP adc [email protected] Fast & Furious: Legacy Onefootball Onefootball [email protected] Pure Soccer! Musixatch 4.5 Musixatch [email protected] usic & lyrics IF by IFTTT 4.1 IFTTT [email protected] Forza Soccer 4.6 FootballAddicts [email protected] Boto the Pink Dolphin 4 Creative Bob Co. [email protected] Adobe Brush CC 4 Adobe [email protected] RedBull.co 4.4 redbull inc [email protected] Perfectly Clear 4.2 Athentech [email protected] BUBL Ice Crea 5 Fox sheep [email protected] Adobe Shape CC 4.1 Adobe. [email protected] Hexlock - App 4.4 Liquidu Liited [email protected] Lock Security Multi Measures: 4.2 SkyPaw Co.,Ltd [email protected] All-in-1 kit Quip: Docs, 4.1 Quip, Inc. [email protected] Chat, Spreadsheets Jelly Band 4.3 Infinite Dreas [email protected] ICQ - Free video 4.3 Icq [email protected] calls & chat Legend Stupeflix Inc. [email protected] Aniate Text in Video Scooter Freestyle 4 EnJen Gaes [email protected] Extree 3D Legion of Heroes 4.3 NEXON COMP [email protected] Rally Racer Dirt 4.2 Sbkgaes [email protected] Tekken Card 4.1 Tekken [email protected] 53

54 Tournaent (CCG) Can You Escape - Tower 4.2 MobiGrow [email protected] ICC T20 World Cup Zapak [email protected] Top Developer 4.1 WGT [email protected] WGT : World Golf Tour Gae PLAY KBC 9 : 4.1 KGS [email protected] HINDI Epire Z 4.2 Eber Entertainent [email protected] Roulette Royale 4.1 Mywavia Studios [email protected] FREE Casino Real Cricket Test Match 4 Nautilus Mobile [email protected] Boost Power 4.1 gaes2win [email protected] Cricket Clash of Mafias 4.4 IGG.COM [email protected] Nazara Cricket 4 Nazaragaes [email protected] Master Blaster 4 gaes2win [email protected] T20 Cricket Bike Mayhe 4.2 Best Free Gaes [email protected] Free Inc. Cricket 2015 Top 4 Tinysol Studio [email protected] Gaes Bocce 3D 4 Giraffe Gaes [email protected] Liited Snowboard Party 4.4 ratrodstudio [email protected] Lite PES CLUB 4.2 Konai [email protected] MANAGER Real Cricket 4.1 nautilusobile [email protected] English 20 Bash Pool Break 3D 4.2 kineticbytes [email protected] Billiard Snooker SUPER 4.3 Nikhil Suresh [email protected] CRICKET 2 KungFu Warrior 4.2 Triniti Interactive [email protected] Ltd Head Soccer La 4.3 Liga de Fútbol [email protected] Liga Profesional Kanche 4 puransoftware [email protected] First Touch 4.5 First Touch [email protected] Soccer 2015 MX Motocross 4.3 vndynapp [email protected] Free Play KBC Gaetion [email protected] ONE PIECE 4.6 BANDAI [email protected] TREASURE NAMCO CRUISE Entertainent World T20 4 Gaes2win.co [email protected] Cricket Chaps Taichi Panda 4.1 snailgaesusa [email protected] Flick Shoot UK 4.5 MobileCraft [email protected] 54

55 Modern Cobat 5: Blackout 4.2 Gaeloft Flick Shoot US: Multiplayer 4.6 raza inc Far Village 4.3 Playday Gaes Deck Heroes 4.7 IGG Texas Hold'e 4.2 Haolan Qin Tap Titans 4.7 Gaehivepublishe r Brave Trials 4.3 Andy Epires and Allies 4.4 Zynga Puped: BMX 4.1 noodlecake Free Studios Inc Monster Squad 4.3 NEXON M Inc. [email protected] imobsters 4.3 Stor8 Gaes [email protected] DOWNTOWN MAFIA (RPG) 4.3 DYNAMICNEXT [email protected] Forces of War 4.3 Ukengaes [email protected] Can You Escape - Adventure 4.2 Mobiobs [email protected] Escape The Ghost Town 4 A-S-G [email protected] Pool Live Tour 4.4 Geewa [email protected] DoiNations 4.3 Nexon [email protected] Tech Deck Skateboarding 4 Spin Master Studios [email protected] Table Tennis 3D 4.1 The app guruz [email protected] Live Ping Pong Wrestling 4.2 Mdickie [email protected] Revolution WWE Presents: Rockpocalypse 4.1 wwe,inc [email protected] Tie To Escape 4.2 Goblinllc [email protected] Stick Soccer 4.7 stick sport [email protected] Batan Arkha Origins 4.2 warner bros [email protected] Top Developer 4.4 Disney [email protected] Inside Out Thought Bubbles Laser Gun Prank 4.5 Laser X [email protected] Cracked Screen 4.5 Technology expertise [email protected] Bouncing Ball 3.9 Ketchapp [email protected] Pregnant Girl 4.1 Purple Studio [email protected] Eergency Doctor Baby Monster 4.6 Kaufco Gaes [email protected] Truck Gae Apps Widgets Cars Surprise Eggs 4.3 IdeaMK [email protected] Peppa on the river 4.1 Peppa pig gaes [email protected] iha Store 4.5 ihackalbania DEV [email protected] InstaFollow Get FforF [email protected] 55

56 5000Followers Gran Knit Siulator 4.1 FunXL Apps FC Barcelona 4.5 KIBO Official Keyboard GUN STRIKER 4.2 (주)도연게임즈 Pasta & Pizza - Food Maker! 4.1 Kids Food Gaes Inc. [email protected] Book Reader(β) 4.6 binzue [email protected] PDF Reader Pro 4.7 Dung Carles [email protected] PDF Reader Kdan Mobile [email protected] Scan, Edit & Software Ltd. Share Battery Man 4.7 TACOTY JP adc [email protected] Battery StatusBar 4.1 JSC Co.,Ltd. [email protected] Cliffy Jup 4.3 WeGo Interactive [email protected] Co., LTD Juping Fox: 4.2 Thubspire [email protected] Clib That Tree! USA Crie City Vasogaes [email protected] August Festival 4 Sukfest [email protected] Wrestle Funny 4.1 GuonianGae [email protected] Top Developer 4.2 Disney Publishing [email protected] Disney Creativity Worldwide Studio 2 Crazy Beach 4 Coco Play By [email protected] Party-Coco TabTale Suer! Res i STHLM: 4.1 Nobina [email protected] SL trip planner Kodi 4.3 XBMC [email protected] Foundation Kivra 4.7 Kivra [email protected] Bohusläningen 4.2 Stapen Local [email protected] Media Triple Jup 4.6 Ketchapp [email protected] Transparent 4.1 Kuboo Gae [email protected] Launcher Studios Caera The Secret 4.3 G5 Entertainent [email protected] Society Clock Live 4.3 yadavapp [email protected] Wallpaper QR Code Scan & 4.2 Barcode Scanner pickwick santa [email protected] ElectroDroid 4.7 Iero [email protected] CPU-Z 4.5 CPUID [email protected] Prayer Ties 4.7 Dawat e islai [email protected] Conversation Translator 4.3 NyxCore [email protected] Flashlight: LED Torch Light 4.3 Mobile Apps [email protected] Turbo Download 4.1 Point Blank [email protected] 56

57 Manager Translator 4.3 Recoendado Musli Azan & Salah Ties 4.5 MasjidNow by Yousuf Jukaku DU Flashlight - Brightest LED 4.3 DU Apps [email protected] Acer Life 4.1 Acer Inc. [email protected] Weather 2.2 Free VPN 4.3 Viatun Software [email protected] VIATUN Inc. IDM - Download 4.1 Manager Guru inc [email protected] Tasbeeh counter: 4.6 AwardSofts [email protected] zikr, tasbih Zvondik (Call 4.2 ViktorDegt [email protected] recorder) Unified Reote 4.5 Unified Intents [email protected] Classic Black [email protected] Thee - ZERO Freapp - Free 4.5 NB lab [email protected] Apps Daily! Super Bright Flashlight 4 SiilarGroup [email protected] Voice Recorder 4.2 Appliqato [email protected] Fallout Shelter 4.6 Bethesda Softworks LLC [email protected] Top Eleven Be a Soccer Manager 4.4 Nordeus [email protected] Vikings: War of Clans 4.3 Plariu Global Ltd [email protected] Iron Desert - Fire 4.1 Stor My.co B.V Halfbrick Studios Big Bear 4.3 Super Awesoe Inc. [email protected] ICARUS 4.2 Livezen Corp [email protected] Package Nae Viewer 4.2 GIJOON [email protected] Dragons: Rise of Berk 4.2 Ludia Inc. [email protected] Trivia Crack 4.5 Eterax [email protected] Bubble Shooter Pop 4.2 Paleblue [email protected] Pet Rescue Saga 4.2 King [email protected] Ocean Blast 4.3 Pandastic Gaes [email protected] Faily Far Seaside 4.2 Dindian [email protected] Words With Friends 4.3 Zynga [email protected]%20 Top Far 4.2 Halfbrick Studios [email protected] I love pasta 4 PATI Gaes Corp. [email protected] Battlestation: Harbinger 4.7 Bugbyte [email protected] LEGO Batan: 4.2 Warner Bros. [email protected] Beyond Gotha Gathering Sky 4.4 A stranger gravity [email protected] World Cricket 4.2 Nextwave [email protected] 57

58 Chapionship Multiedia Inc Card Crawl 4.2 Arnold Reurs March of Epires 4.2 Gaeloft FootLOL: Crazy Soccer 4.3 HeroCraft Blood Gate - Age 4.2 of Alchey Dena Corp [email protected] This War of Mine bitstudios [email protected] Show Me the Money Part1 4.5 Y Factory [email protected] djay FREE - DJ 4.2 Algoriddi [email protected] Mix Reix Music Papyrus - Natural 4.2 Steadfast [email protected] Note Taking Innovation, LLC AZ Caera Hecorat Caera [email protected] Manual Pro Ca File Coander 4.2 Mobisystes [email protected] - File Manager Wego Flights & Hotels 4.3 Wego.co [email protected] Peak - Brain 4.5 Peaklabs [email protected] Training Veooz: Latest & 4.4 Veooz Labs [email protected] Personal News GolfNow GPS Rangefinder 4.4 Golfnow [email protected] Pepe & Friends 4.4 Nexon [email protected] Play Storybook Device Assist 4.2 Google [email protected] The Spiritual Man 4.2 Christ's servant [email protected] Hoe Library - Free Books 4.4 Sky Horse Apps [email protected] Quran in Urdu ق مامن همجرت 4.5 Goodword Books [email protected] Prophets' stories 4.5 Bangla droid [email protected] in isla Holy Qur'an 4.5 BooApp [email protected] (read and listen) Tajveed 4.7 Dhariyat [email protected] Khawabon Ki 4.1 Tapps Venture [email protected] Tabeer Learn Quran 4.5 Perfect Islaic [email protected] Basics Apps Yajooj Majooj in Urdu 4 Oracle Developers [email protected] The Law of 4.1 FREEBOOKS [email protected] Attraction Editora BOOK AsaUlHusna 4.6 AppTriple [email protected] All Bible Stories 4.4 AaliaDev [email protected] Quotes 4.2 Real Drea [email protected] Asaan Naaz 4.5 Saudagran Tech [email protected] Sahih Al Bukhari 4.6 Trios Labs [email protected] 58

59 Think and Grow Rich 4.3 Thanakorn Papan Quotes Book 4.4 naveeninfotech Free ebooks - Classics 4.1 Freetop10ebooks.c o [email protected] Telugu 4.3 Ra Mareedu [email protected] Telusukondi Sahih Al Bukhari 4.6 Geek Brain Studio [email protected] Book-3 The Art of War Audiobook 4.3 Darrick Kouns / JVB Enterprise [email protected] Middle Earth Index 4.3 Ti Dyck [email protected] Bahishti Zewar 4.5 Netsolution [email protected] Mushaf Tajweed 4.5 Oar Raadan [email protected] Waka 4.3 Vega cooperation [email protected] Goodreads 4.1 Goodreads [email protected] BFGuide - Brave Frontier Guide 4.6 Pha Thi Thuy Anh [email protected] Photo Editor 4.3 Lyrebird Studio [email protected] Collage Maker Pro Pic Collage Editor 4.1 cucat [email protected] Instazz 4.3 icoderz Solutions [email protected] Forever Love Photo Fraes 4 Tejeiro Dev [email protected] PicLen - Fotos Photo 4.2 PicLen - Fotos Photo [email protected] Flower Love 4.1 Tejeiro Dev [email protected] Photo Fraes Venus 4.3 RC PLATFORM [email protected] Waterfall Live Wallpaper 4.1 Creative Factory Wallpapers [email protected] Butterflies 3D live wallpaper 4.2 SkyDivers [email protected] Solo Launcher- 4.5 Solo Launcher [email protected] Clean,Sooth,DI Tea Y Twilioid - Twilio 4 Nethra L.L.C. [email protected] Connect Beta Clash of kings 4.3 Elex Wireless [email protected] Monuent Valley 4.7 ustwo [email protected] The Roo 4.8 Fireproof Gaes [email protected] Crazy 4.3 Ezone.co [email protected] Snowboard Pro Doulingo 4.6 Duolingo [email protected] 59

60 10 APPENDIX C: LOW RATED DEVELOPER S INFORMATION: This is publicly available inforation fro the GOOGLE PLAY STORE and it doesn t include any personal inforation that the developer s provided as part of the survey. Application Nae Rating Developer Nae Eail EQ - Music Player 3 DJiT [email protected] Equalizer SoundSeeder Music Player 3 JekApps [email protected] Car Music Player 3 Luis Teixeira [email protected] Music Player Pro 3.5 Grass Alpine [email protected] MO Player - MP3 Music 3.6 BRATSOFT [email protected] Player Shuffle Music Player beta 3.8 khannasahab [email protected] Caera MultiCaera 3.5 David Erosa [email protected] Moent Caera Shares 3.5 frank.app [email protected] Manner Caera 3.5 nadj [email protected] Caera Scanner 3.5 Wise Shark Software [email protected] Sart Feed Reader 3.7 Scand Ltd. [email protected] Reddit Reader 3.3 DahlenApps [email protected] o PDB Book Reader 3.5 Topnet999 [email protected] News Reader 3.5 FlyingBus Studio [email protected] o Pal Reader Guide 3.5 Movisol [email protected] Manga Meow - Manga Reader App 3.8 Gentouch Ltd. support@gentouchstudios. co Psychic Reader 3.6 TroopiFruity [email protected] Oyster Reader 3.3 Vince Brown [email protected] Mail Reader for MSN 3.8 Woboid Systes [email protected] Outlook King Turtle Run 3.3 imobifone [email protected] Brick Run 3.6 ygaes [email protected] Wolf Run Slots 3.6 Falandofu [email protected] Dino Run FREE 3.5 G-GEE GAMES [email protected] Bunny Run 2D 3.6 AppDegree [email protected] Bunny Run 3.6 Gae.Jungle [email protected] Run Dino Run 3.5 Bit of Gae [email protected] Mouse Run 3.4 Dexati [email protected] Cobra Run 3.4 No Six Five [email protected] Dinosaur Run Race Master 3.6 Kaufco Gaes Apps Widgets [email protected] Running Frenzy 3.2 reactor [email protected] Racing Motorbike Trial 3.6 Pudlus Gaes peter.jobbagy.play@gail. co Desert Traffic Race 3.6 LabException [email protected] 60

61 Crie Racing City 3.6 Racing Gaes Inc. Racing Gaes 3.6 Chuc MoEyes co Forula Car racing 3.5 JELLY Jelly Racing 3.7 SMS Services LLC Hill Racing 3.7 nullapp Dirt Bike Racing 3.7 TurboNUKE Real Forula Racing 3.4 Top Bike Race Car Gaes ail.co Cross Cars Racing 3.7 Poo and Play Car racing 3.7 nullapp Retro Racing 3.7 Mr Qwak Liited Racing Gaes 3.4 TheInvader360 Hill Racing 3.7 nullapp Dirt Bike Racing 3.7 TurboNUKE Real Forula Racing 3.4 Top Bike Race Car Gaes ail.co Spying Eye 3.2 Eelooz Spy Caera Pro 3.8 ccloud apps co Night Vision Caera HD 3 ChillyBrad [email protected] TrackAnyone - Location 3.7 VcareAll [email protected] Spy Beauty fights zobies 3.9 Beauty&Dragon [email protected] Cavean Fight 3 Tops Gae [email protected] o Machine Fury Run and 3.8 Raesh Babu [email protected] Fight Word Fight Online 3.6 Che [email protected] Stick Men Fighting H&G Mobile Apps [email protected] Christas Santa Fight 3.8 Labda Studios [email protected] Boxing Fight Gae 3.8 Chester Mobile chesterobilestar@gail. co Snowball fight 3.8 fuate Co., Ltd. [email protected] 3D girls artial art 3.5 virtualinfoco [email protected] Stickan Fight Killing 3.2 Betoladodgers [email protected] Fight Sounds Siulator 3.5 starbranches [email protected] Anials Fighting War 3D 3.5 Pro 3D Gaes Developer [email protected] Chinese Chess Fight 3.5 Nethru Liited [email protected] Fighting Boxing Gae 3.7 kang yongyi [email protected] (3D) Fight Fight Zobanite! 3.6 MojoBox Gaes [email protected] o Tank Fight War KallCook [email protected] Fight on State 3.8 Cyclone Kick Studio [email protected] Zobies Hand Fight 3D 3.5 App Teeka [email protected] Guardian Fight 3.5 Cross Field Inc. [email protected] Girl Group Fight Online 3.5 1Gaes [email protected] C More 2.5 C More Entertainent AB [email protected] 61

62 Svenskalag 3.6 Svenskalag AB Fotbollskapen 2.4 Intelligent Apps AB Canal Digital GO 2.5 Canal Digital As Sn 3.9 General Adaptive Apps Pty Ltd Ki 3 General Adaptive Apps Pty Ltd [email protected] Laser Gun Prank 2.9 Laser X [email protected] Cracked Screen 3.7 Technology expertise [email protected] Bouncing Ball 3.9 Ketchapp [email protected] o ci 2.9 General Adaptive Apps [email protected] Pty Ltd ba 3.5 General Adaptive Apps [email protected] Pty Ltd Cycling SRM Reti e Mobilità [email protected] Russian Crie Siulator 3.9 Mine Gaes Craft [email protected] Anno: Build an Epire 3.6 Ubisoft Entertainent [email protected] o Bus Rush 3.9 Play App King [email protected] Stick Run 2.6 Aliens Lab [email protected] ru 3.4 General Adaptive Apps Pty Ltd [email protected] sh 2.9 General Adaptive Apps Pty Ltd [email protected] E-tidning - TTELA 2 Stapen Local Media [email protected] Exploration Craft 3.3 Sartties [email protected] Squaroid 2.4 Aliens Lab [email protected] do 3.1 General Adaptive Apps Pty Ltd [email protected] Angry Shark Revenge 3D 3.6 Tapinator, Inc. (Ticker: TAPM) [email protected] Friv Gaes 3.5 kekacen [email protected] o Big Days - Events 3.4 Astrovic App [email protected] Countdown Casino spel 1 Ballardeno Carenue [email protected] Crie Siulator 3.8 Get Through Asphalt [email protected] Circline -- Hardest Gae 3.1 Aliens Lab [email protected] SiCraft : MultiCraft PE! 3.7 ITV Developer [email protected] Plastic Surgery 3.5 Mobile Apps Developers [email protected] Hjärtförbundet 1 AppInMed AB [email protected] Five Nights At Minecraft 2.9 Millie Gaes [email protected] Metro Train Siulator Sashing Geeks [email protected] pedoeter step count calories 3.8 Wako Developent wakodevelopent@gail. co Gun Siulator - Shoot 3.9 Guns Siulator GunShooterSiulator@ho Gun tail.net Parpas 3.8 Parks and Resorts parpasapp@parksandresort s.co 62

63 Abulance Parking 3D Rescue 3.8 Reality Gaefied Laser Siulator Prank Gun 3.6 App Phobia Mystery of Haunted 3.9 Point & Click LLC Hollow FREE o Cabotagestudien - Appen 3.5 Henrik Sternberg [email protected] o PeriscoDroid - Streas 2.8 Alp Apps [email protected] Clarity Keyboard Beta 2.7 SwiftKey Greenhouse SwiftKey Greenhouse Korsord 3 Korsord [email protected] Princess Gae: Salon 3.8 Kaufco Gaes Apps bauandroid@googleail Angela 2 Widgets.co Cydia for Android 3.5 Idev Tea [email protected] o Crie Driver 3.9 Mine Gaes Craft [email protected] Sand Excavator Siulator 3.9 3Dee Space [email protected] 3D Train Siulator 3D 3.9 MobilePlus [email protected] Cabotagestudien - Appen 3.5 Henrik Sternberg [email protected] o Skövde Basketcup 3.7 CupManager [email protected] Fake Call Girlfriend Prank 3.8 Appslyng [email protected] Anova Culinary Beta 3.9 Anova Culinary [email protected] Train Siulator 3D 3.9 MobilePlus [email protected] Pixelon Mod 2.7 Utility Today 2000 nonesakronpeerasiri@ga il.co Mitel Events 3.5 Luckylane [email protected] One Night to Kill Freddy 3.6 Ketchup Mobile [email protected] Pregnant Girl Eergency Doctor 3.8 Purple Studio [email protected] Baby Monster Truck Gae Cars 3.8 Kaufco Gaes Apps Widgets [email protected] Surprise Eggs 3.8 IdeaMK [email protected] Peppa on the river 3.9 Peppa pig gaes [email protected] iha Store 3.5 ihackalbania DEV [email protected] InstaFollow Get 5000Followers FforF [email protected] Gran Knit Siulator 2.3 FunXL Apps [email protected] FC Barcelona Official Keyboard 3.5 KIBO [email protected] GUN STRIKER 3.2 (주)도연게임즈 [email protected] Pasta & Pizza - Food Maker! 2.1 Kids Food Gaes Inc. [email protected] Slots - Money Rain 3.9 Tango slotsoneyrain_android@t ango.e Litago Moojis 3.4 TINE SA [email protected] Slide the NUMBER 3.4 Super Awesoe Inc [email protected] Cookie Bear Kitchen 3.7 DogPhyilCenter [email protected] Autoower Connect 3.2 Husqvarna Group lars.olofsson@husqvarnag roup.co InstaFollowers - for 3.9 Birdy Fae [email protected] 63

64 Instagra Hero Zero Splashtie 3.4 Playata GbH co Bakery Story: Spring 3.9 Stor8 Studios Candy Cookie Hero 3 Diaond Dots Splash [email protected] ปร ศนาฟ าแลบ 3.5 Aonite Studio [email protected] o Celebrity Fashion Stylist 3.5 Salon [email protected] Gae Burger Tycoon 2.3 obistar [email protected] Flinch Chat 3 Flinch Chat [email protected] o Magic Candy 3 XCQ United [email protected] Car transport 3D trailer 3.1 Mobilegaes [email protected] truck Pregnant Moy Doctor 3 TipyTapy Gaes adiha.uair.750@gail. co Pasta & Pizza - Food Maker! 2.2 Kids Food Gaes Inc. [email protected] Juice Maker: Kids Cooking Gae 3.3 Cupcake Kids Inc andy.haron@cupcakekid sinc.co Bloody Sniper: Zobie Plannet 3.2 PipoGae [email protected] Baby Hazel Pet Hospital 3.5 Axis Entertainent [email protected] Movin Movin 3.2 TYA [email protected] Battle Odyssey 3.2 Gaeloft [email protected] Tiltagon 3.1 Noodlecake Studios Inc support+android@noodlec ake.co Dino Robot - Velociraptor 3.8 TheFlash&FirstFox [email protected] Bubble Cat Rescue 3.5 Ezjoy [email protected] Moy Birth Twins - Baby Gaes 3 Mobile Gaes Media [email protected] Police Jeep Favela Parking 3 MobilePlus Police Jeep Favela Parking Crazy Dentist Salon TNN Gae [email protected] Street Food Maker - Kids Gae 3 Crazy Cats [email protected] o Pyraid Solitaire 3.4 ZZZ Solitaire [email protected] Traffic Car Driving 3.5 Erdal DOĞAN [email protected] o See You Again GO Launcher 3.5 ZT.art [email protected] Ninja Legend 3.9 CAVE APE [email protected] Fire screen 3.1 Cosic Mobile [email protected] Fruity Roll Up - Food 3.1 Kids Food Gaes Inc. [email protected] Maker Rainbow Cheetah Eoji keyboard 3.4 Pink Eoji Keyboard Hoe eojikeyboard.contact@g ail.co Meraid atch Eva LLC [email protected] Railroad Crossing 3.2 Baby Educational [email protected] 64

65 Learning Gaes Studio Faring 3D: Tractor Parking 3.4 Gerrit-Jan Jansen ezpdf Reader Free 3.5 Unidocs Inc. Car Tunes Music Player Lite 2.4 Diabolical Software, LLC l.co CloudAround Lite Music Player 3.5 CloudAround, LLC Ghost Caera 2.9 Dinh Lang Cherry Caera! 3.1 epriest Mobile Hidden Caera 3.9 zecurizoft era.co Sketch Caera 2.7 Pixelab Pixel Artist - Caera 3.8 Volar Developent [email protected] Effects Coic Caera 3.8 platinu books platinubooks2011@gai l.co Caera Vabohalo [email protected] fast reader 3.4 Vicente Roero [email protected] Free PDF Reader 3.6 Financial Systes [email protected] h Reader F 3 jianwu [email protected] Cool Reader Bronze Donation 3.3 Vadi Lopatin [email protected] 1st Myanar Reader 3.7 Htin Aung [email protected] Fanfiction Reader Preiu 3.9 Loktech Inc. [email protected] Gaaiho PDF Reader 2.5 ZEON Corp [email protected] Book Reader(β) 3.6 binzue [email protected] PDF Reader Pro 3.8 Dung Carles [email protected] PDF Reader -Scan, Edit & 3.5 Kdan Mobile Software [email protected] Share Ltd. o Battery Man 2.7 TACOTY JP adc Battery StatusBar 3.9 JSC Co.,Ltd. [email protected] o.jp The Battery 3.6 Mobix developent [email protected] 3G Manager - Battery saver 3.3 Matteo & Fabio [email protected] MiniWidget-Battery 3.5 MuisikaDesigns [email protected] Vijey Sword Fight 3.5 AazApps [email protected] Ultiate Fight Fan 2.7 DoApp, Inc [email protected] Ocean Block:Final Fight 3.9 IagingGaes [email protected] o Prabowo Survival Fight 2.8 Appholic [email protected] Does not Coute 3.9 Mediocre [email protected] Race Monitor 3.9 Karting Coach, Inc. [email protected] Lose Weight - Sliing! 3.4 Candy Mobile [email protected] Modern House Craft PE 3.3 Sith Inc. [email protected] 65

66 Rush of Heroes 3.9 Firefly Gaes Inc. Reote Control for TV 3.7 Copatible with ost TVs ail.co COOKING DASH Glu Ride My Bike 3.7 Tabtale HTC Sense Input - SV 3 HTC Corporation [email protected] Police bus prison transport 3.9 MobileGaes [email protected] 3D Cool School - Kids Rule!!! 3.6 Tabtale [email protected] Cops and Robbers! 3.9 Boobit Gaes [email protected] Hairy Nerds - Crazy Makeover 3.1 Tabtale [email protected] Clock 3.9 Google Inc. [email protected] Heart Surgery Siulator g.co [email protected] Red Bull Wingsuit Aces 3.9 Red Bull [email protected]. co Prison Break: Lockdown 3.9 Aphibius Developers [email protected] (Free) Dragon Story: Pool Party 3.8 Stor8 Studios [email protected] Candy's Town 3.9 Libii [email protected] PlayTube 3.9 LuGeMobile [email protected] SONIC RUNNERS 3.8 SEGA CORPORATION [email protected] MiniCraft 2: Bioes 3.8 SandStor Earl [email protected] Circle Spinner 3.5 Apex Apps DMCC [email protected] DRIFT SPIRITS 3.9 BANDAI NAMCO ww_gp_driftspirits_ad@ne t.bandai.co.jp Jungle Juping 3.8 BooBit Gaes [email protected] o Adventure Tie Puzzle Quest 3.6 D3 Go! [email protected] Groove Coaster TAITO Corporation [email protected] p Cliffy Jup 3.9 WeGo Interactive Co., LTD [email protected] Juping Fox: Clib That 3.9 Thubspire [email protected] Tree! USA Crie City Vasogaes [email protected] August Festival 2 Sukfest [email protected] Wrestle Funny 3.8 GuonianGae [email protected] Top Developer 3.8 Disney Publishing eberservices@disneydi Disney Creativity Studio 2 Worldwide gitalbooks.co X Ray Caera Scanner 3.5 Turkish Gaes ardatuskishgaes@gail. Prank co Final Hero:Speed Run 3.7 ICECRY [email protected] Drink Milk Siulator 3.2 シミュレータースタジ [email protected] オ Crazy Goat in Town 3D 3.8 Tapinator, Inc. (Ticker: TAPM) [email protected] Fun Kid Racing - Candy 3.9 Tiny Lab Productions tea@tinylabproductions. 66

67 Land co Bridge Builder Crane Operator 3.5 Kick Tie Studios Stunt Bike Hill Race 3.9 Best Cool Racing Gaes Paranoral Escape Aphibius Developers [email protected] Oddwings Escape 3.9 sall giant contact@sallgiantgae s.co Monster Dash 3.8 Halfbrick Studios [email protected] War of Nations: PvP Doination 3.8 GREE, INC [email protected] Super Troopers 3.9 syd [email protected] Driving School 3D 3.7 VascoGaes [email protected] Parking T20 WORLD CRICKET 3.8 you-bird [email protected] CHAMPIONS Top Developer 3.6 Google [email protected] Google Play Movies & TV Test Cricket Cup born2win [email protected] Free Scooter Freestyle Extree 3.9 EnJen Gaes [email protected] 3D UEFA CL PES FLiCK 3.9 konai [email protected] TL Cricket T20 World 3.6 Henry Anderson hjanderson007@googlea Cup Free il.co Soccer Manager Ultra 3.9 Trophy Gaes ApS [email protected] FMU 2015 T20 WORLD CRICKET 3.8 Haad [email protected] CHAMPIONS Moto Racing 3.8 SST [email protected] Tie Bob Broken Screen Prank 3.3 BlinkAlbert [email protected] Multiplayer Cricket Live 3.9 N2K [email protected] o Police vs Thief Joga loca gaes [email protected] Soccer Sanchezapps athewsanchezga@gail. co 100 Doors Zenfox [email protected] Drag Racer GT 3.7 gaevillestudio [email protected] Fast Police Car Driving 3D 3.8 i6 Gaes [email protected] Infinite Myths 3.9 Pocket_Studio pocket_studio@pocketga esol.co Turbo Car Racing 3.8 speedcar studio speed.car.real.racing@ga il.co Fire Screen 3.2 WEYE Studio [email protected] Total Doination - Reborn 3.9 Plariu Global Ltd [email protected] Soccer Football World 3.8 gaevillestudiousa gaevillestudiousa@gail Cup.co Stick Cricket sticksports Ltd obilesupport@sticksport s.co Ice Bucket Challenge 3.1 hottrix [email protected] Trick 67

68 Kursi Cricket World Cup 3.9 gaes2win Police Car Chase 3D 3.9 nullapp Walk Band: Piano,Guitar,Dru Revontulet Soft Inc Top Music Player 3.1 Top Music App gail.co Shuttle Music Player 3.8 SipleCity o Real Piano Free 3.9 Gisart Ringtone Maker and 3.1 Zabaan Editor Laya Music Player 3.7 SVAIRIN Dragon Hills 3.7 Rebel Twins Police Moto Driver 3.4 nullapp Cruise Kids - Ride the Waves 3.4 Tabtale [email protected] Perfect Pitch HighSchool Girls 3.9 Ipro [email protected] Peppa in the Superarket 2.5 Peppa pig gaes [email protected] Secret Passages:Hidden Objects 3.1 Pocket Ges [email protected] Eleven(11) 2.2 boxes ania [email protected] Arrow 2.3 Ketchapp [email protected] o Sart Search & Web Browser 3.5 Reactive Phone [email protected] Far Story 2: Birthday Party 3.2 Stor8 Studios [email protected] Crazy Beach Party-Coco Suer! 3.9 Coco Play By TabTale [email protected] Res i STHLM: SL trip planner 3.7 Nobina [email protected] Kodi 3.9 XBMC Foundation [email protected] Kivra 3.7 Kivra [email protected] Bohusläningen 3.9 Stapen Local Media [email protected] Triple Jup 3.9 Ketchapp [email protected] o Transparent Launcher 3.7 Kuboo Gae Studios [email protected] Caera The Secret Society 3.3 G5 Entertainent [email protected] Pirate Battles: Corsairs Bay 3.4 HeroCraft Ltd [email protected] JellyKing : Rule The World 3.9 Jellyking Studio [email protected] AntiVirus Security - FREE 3.6 AVG Mobile [email protected] Pirate Kings 3.5 Jelly Button Gaes [email protected] Traffic Racer 3.9 Soner Kara [email protected] o Peppa in the Superarket 3.7 Peppa pig gaes [email protected] Secret Passages:Hidden 3.4 Pocket Ges [email protected] Objects Eleven(11) 3.9 boxes ania [email protected] Dungeon Link 3.7 GAMEVIL Inc [email protected] Escape City 3.5 Mobigrow [email protected] 68

69 My Newborn Pet Baby 3.7 Libii Reote Control for TV 3.9 TUR Software Developing Ice Moy's Newborn Baby g The king of Pool billiards 3.9 obirix Bus Rush 3.9 Play App King City Driving 3D 3.8 Zuuks Gaes One For Eleven 3.9 eyedentityobile ile.co Pool Ball King 3.9 WEDO1.COM LTD Transparent Screen PRO 3.7 Futuristic Apps Inc. co Beach Cricket 3.6 Nextwave Multiedia Inc dia.co Fruit Shooter Mania 3.9 sailfishgg Cricket Cup 2015 Final Run 3.6 funlive Stickan BMX 3.8 Turbo Chilli Power Cricket T20 League 3.9 gaeswin 2015 co Golden Manager - Soccer 3.9 Kerad Gaes [email protected] o Pro Pool iware Designs Ltd. [email protected]. uk ICC Chapions Trophy Zapak Mobile Gaes Pvt. Ltd [email protected] Transparent Screen PRO 3.7 Futuristic Apps Inc. CalluMcRaess5@gail. co Far Town : Happy Day 3.9 foranj [email protected] BMX Freestyle Extree 3D 3.9 Enjen [email protected] Electric Screen (Pro Version) 3.8 Strange Apps [email protected] Night Moto Race App Holding [email protected] FATAL Driver GT 3.8 foosegaes [email protected] o ICC Pro Cricket Indiagaes [email protected] o Escape the Prison Roo 3.5 lcobileapp79 [email protected] Cricket Ultiate 3.7 Happy Papaya Dev [email protected] o Crazy Surgeon - casual 3.3 i6677 [email protected] gaes Cricket 3D 3.9 Duadu Gaes [email protected] Cricket Ultiate 3.7 happyrichard [email protected] o Moto Racing 3.7 6Decgaes [email protected] BMX Freestyle Extree 3D 3.9 EnJen Gaes [email protected] Cricket Play 3D: Live The Gae 3.9 oonglabs [email protected] Icontrivia : Wrestlers 3.8 Dnis [email protected] Play Street Soccer 2015 Gae 3.4 Footccer - real sports gaes [email protected] 69

70 Play KBC Quiz Cxapps FreeKick - World Chapionship 3.6 Lazyharts [email protected] Mafia Gae - Mafia Shootout 3.9 Ace viral [email protected] Motocross Motorbike Siulator 3.4 RC Racing Gaes [email protected] Turbo Car Racing 3.8 Speedcar speed.car.real.racing@ga il.co Bocce 3D 3.9 Giraffe Gaes Liited [email protected] Snowboard Freestyle 3.9 EnJen Gaes [email protected] Mountain Stagefright Detector 3.3 Lookout Mobile Security [email protected] Allone 3.5 Allone AB [email protected] Extree Car Driving Pudlus Gaes peter.jobbagy.play@gail. co Funny Photo Effects 3.9 Dexati [email protected] Best Fiends 3.5 Digital studios [email protected] Warhaer 40,000: Space Wolf 3.9 HeroCraft Ltd [email protected] VEGA Conflict 3.9 KIXEYE [email protected] Pocket Mine Roofdog Gaes [email protected] Heroes of Order & Chaos 3.3 Gaeloft [email protected] Grand Escape 3.5 Goblin LLC [email protected] Furious Fast Taxi Driver TricoGaes [email protected] Helicopter Flight Siulator 3D 3.9 i6 Gaes [email protected] Keypad Lock Screen 3.6 WoW Lock Screen ChristopherRitchiert58@g ail.co MobiTV - Watch TV Live 3.4 Undertap [email protected] Splash Colour Effects 3.9 Swiss Codeonkeys [email protected] Open Caera 3.8 Mark Haran [email protected] PhotoWonder 3.4 Baidu HK [email protected] InstaMag 3.3 Fotoable,Inc. [email protected] Sart AudioBook Player 3.6 Alex Kravchenko [email protected] Hugo Troll Race 3.8 Hugo Gaes ApS [email protected] Caller Nae Announcer 3.9 Onex Softech [email protected] o wifi free 3.8 Ge Cheng [email protected] Solar Battery Charger 3.8 Enjensol [email protected] Prank Video Frae - Collage 3.4 Leyi App [email protected] Maker App Lock (Scanner Siulator) 3.9 softwego [email protected] Ruler 3.5 gryala [email protected] Mobile Nuber Locator 3.9 Sriapps [email protected] Photo Recovery 3.3 Tasty Blueberry PI [email protected] 70

71 Night Vision Siulator 3.6 Fun4Everyone co FREE WIFI PASSWORD KEYGEN 3.9 DENISEALBESCUAPPS Unblock website- proxy browser 3.8 Sart Surfer Browser & Proxy il.co VPN Browser 3.6 Noble Download Manager 3.9 Diewland Fontasy - Google Fonts Browser 3.7 youthhr [email protected] o Autoatic Call Recorder 3.9 Prissoft [email protected] FlashLight 3.9 Zerone Mobile Inc. [email protected] Indian Caller Detail 3.9 free app anishpathak.android@g ail.co GetTheAll Any File 3.8 Nibus Web Inc [email protected] Downloader Lock Phone Lite 3.5 WizSoft4Android [email protected] Free Swipe - Boost,Wallpaper 3.9 Neverland Group [email protected] Faily Guy The Quest for Stuff 3.9 Tinyco [email protected] Fars & Castles 3.9 Square Enix Ltd [email protected] Disney Junior Play 3.7 Disney Publishing [email protected] Worldwide Tyrant Unleashed 3.9 Kongregate droidsupport@tunleashed. zendesk.co HeroesRunner 3.6 PuttoEntertainent Inc. [email protected] Wakfu Raiders 3.8 gui inc [email protected] Mini Monster Mania 3.8 Reliance Big [email protected] Cookie Star 3.9 ASQ TEAM [email protected] My O No 3.9 Zepolab [email protected] Party of Heroes 3.9 Kongregate [email protected] Episode feat. Dei Lovato 3.9 Episode Interactive episode.app+support@g ail.co Dexter: Hidden Darkness 3.7 bloobuzz dexter.support@bloobuzz. co Mind The Arrow: Match The Dots 3.6 Thubspire [email protected] DOWNTOWN MAFIA 3.3 DYNAMICNEXT [email protected] (RPG) Forces of War 3.3 Ukengaes [email protected] Can You Escape - Adventure 3.6 Mobiobs [email protected] Escape The Ghost Town 3.9 A-S-G [email protected] Pool Live Tour 3.4 Geewa [email protected] k.co DoiNations 3.9 Nexon [email protected] Funny Photo Effects 3.8 Dexati [email protected] Best Fiends 3.5 Digital studios [email protected] 71

72 Arcane Legends 3.4 Spacetie Gaes Nitro Nation Online Racing 3.3 Creative Mobile Don't get fired! 3.9 QuickTurtle MARVEL Contest of Chapions 3.5 Kaba Top Developer 3.8 TACOTY JP adc Fast & Furious: Legacy o Onefootball - Pure Soccer! 3.6 Onefootball [email protected] This Means WAR! 3.8 kaba [email protected] Super realis Clock 3.6 Weather Widget Tea [email protected] Weather Words Crush! 3.4 BitMango [email protected] Balloons Pop Peppa Kids Gaes 3.8 Peppa pig gaes [email protected] Lazys Clean & Wipe 3.5 Lazys Austra [email protected] PlayTube HD Free Mp3 Music 3.8 aoaibio [email protected] PRO PDF Reader 3.4 Ivan Ivanenko [email protected] Crie Town Police Car Driver 3.8 Tapinator, Inc. (Ticker: TAPM) [email protected] Hovercraft - Build Fly Retry 3.6 High Score Hero LLC [email protected] Google Handwriting Input 3.6 Google Inc. [email protected] Epires and Allies 3.8 Zynga [email protected] Truck Driver 3D: Offroad 3.2 Rooster Gaes [email protected] Candy Sugar Splash 3.8 Fat Face Photo Frae [email protected] Unblock Ball 3.3 igold Technologies [email protected] Dragon Hills 3.7 Rebel Twins [email protected] Police Moto Driver 3.8 nullapp [email protected] Cruise Kids - Ride the Waves 3.4 Tabtale [email protected] Perfect Pitch HighSchool Girls 3.9 Ipro [email protected] Peppa in the Superarket 3.1 Peppa pig gaes [email protected] Secret Passages:Hidden Objects 3.8 Pocket Ges [email protected] Barbie Magical Fashion 3.6 Budge Studios [email protected] SoundCloud - Music & 3.4 SoundCloud [email protected] Audio Torch - Tiny Flashlight 3.8 Nikolay Ananiev [email protected] Zalando Shopping & 3.9 Zalando SE [email protected] Fashion Tango: Free Video Calls & 3.8 Tango TangoSupportMarketPlace LINE: Free Calls & Messages 3.2 LINE Corporation [email protected] GO Keyboard - Eoji, Eoticons 3.9 GO Keyboard Dev Tea [email protected] Frozen Free Fall 3.8 Disney [email protected] Unofficial Subway Surfer Guide 3.8 Bibby [email protected] 72

73 Anatoy Guide (Pocket Book) 3.9 Android Fr33k Best Books 3.2 Alk3y Free books to download & read 3.3 Unwrapped Apps s.co Psychology Books 3.8 Zebra Groups co Vehicles (Scandinavia) 3.9 Rools FREE Ebooks 3.8 GB Technology Mohabbat Rog hoti Hai Novel 3.9 Eye Developers AudioBooks Free 3.9 Hau Nguyen Cuu Free ebooks for Kindle 3.6 Neo Nghia Tran Free Books For Kindle 3.8 GenreBooks Audiobooks 3.7 Traveling Classics co Marathi 3.9 Ashlesha Apps India Horror & Scary stories 3.8 catwill BajaLibros Reader 3.7 VI-DA Digital SA Story Rhyes Volue Fisher-Price, Inc. MattelConsuerService@ Mattel.co GratiZone 3.9 Banaalon OG [email protected] Mekia ebook 3.1 ops [email protected] et MeeGenius Children's Books 3.7 MeeGenius Inc. [email protected] sk.co Photo Blur Magnify 3.9 Roans [email protected] Photo Collage Fraes 3.9 Photo Fraes Studio [email protected] PicTune-Photo Editor 3.9 ANDROID PIXELS [email protected] Photo Collage Art 3.9 SeaSoft [email protected] Clone Yourself - Split Pic 3.9 Lyrrebid [email protected] Blur Caera 3.8 RedZone wallpaperzones49999@g ail.co Pic Frae Effects 3.8 ANDROID PIXELS [email protected] KlipMix 3.9 FunMedia Studio [email protected] PicMix 3.5 Inovidea Magna Global [email protected] Kids Fraes 3.1 Soft Cent [email protected] Square Maker 3.9 Caeser [email protected] Flower Photo Collage Art Free 3.7 Studio Apps [email protected] o EDIT PHOTO WITH SQUARE FRAME 3.9 Southern Studio [email protected] o Pixelator 3.6 Alago [email protected] Asteroids 3D live 3.9 SkyDivers [email protected] wallpaper Iron Man 3 Live 3.9 Cellfish Studios [email protected] Wallpaper 050 plus 3.1 NTT Counications Corporation [email protected] Fantasy Preier League 2015/ All Apped Up Liited [email protected] ierleague.co TubeMote 3.6 TubeMote [email protected] 73

74 Monster Truck Havoc 3.9 Cahoona Gaes M Ar wrestling 3.3 acro.si Body Scanner Free Prank 3.4 Kar Mobile Apps Make Me Bald 3.4 Swiss Codeonkeys International Cricket Manager 3.6 Phonato Studios Pvt. Ltd. My Lovely Horse Care 3.3 TutoTOONS Kids Gaes Paulie and Fiona Movie App 3.6 Ruta Ett DVD AB Voice Changer 3.9 e3gaes M Burger Shop 3.8 GoBit Gaes School of Dragons 3.9 Knowledge Adventure, Inc. co Star Tracker - Mobile Sky 3.9 PYOPYO Studio [email protected] Map Sweet Baby Girl Newborn Baby 3.9 TutoTOONS Kids Gaes [email protected] Let's deal 2.9 Lets deal [email protected] Out of Milk Pro 3.9 Capigai, Inc. [email protected] Miss Fix It 3.4 SwedLabs [email protected] IKEA Store 3.2 IKEA [email protected] 74