SOA Solutions & Middleware Testing: White Paper
|
|
- Lesley Montgomery
- 8 years ago
- Views:
Transcription
1 SOA Solutions & Middleware Testing: White Paper Version 1.1 (December 06, 2013)
2 Table of Contents Introduction Solutions Testing (Beta Testing) Solutions Testing Methods End-to-End Scenario Testing Volume Testing Performance Testing Endurance Testing Security Testing Test Planning and Design Types of data transferred Usage of the system Consumer applications and Integration points Message exchange patterns (MEPs) Important Testing Tools Testing tools Apache JMeter SoapUI curl Monitoring tools JConsole JProfiler Debugging Tools Bug Reporting Tools Continuous Integration Tools for Continuous Integration Source code management System Build Management System and Automated Tests Continuous Integration Servers Summary
3 Introduction Testing is a critical step before end solutions go into production. It ensures that the system performs as expected in the live environment without any errors. A well performing system gains the trust of end users, ultimately resulting in business improvements. This white paper discusses how to test solutions built using SOA. This is also known as Beta testing, which usually involves live data. Brief descriptions on test planning and designing is provided along with other important testing tools such as debugging and monitoring tools. Continuous integration testing procedure is also described giving you a complete picture of the areas involved in SOA solutions and middleware testing. Solutions Testing (Beta Testing) Testing on a developed solution in deployment is an important and a difficult task depending on the technologies used, mainly if the solution is service oriented. Alpha testing happens at the early stages before the product is released where the developers and testers perform component level, integration and system level testing. Once the product is released, solutions testing is done on the actual deployment at the customer environment with live data. This takes place however, before the solution goes live. For solutions testing; verifying response times, testing with large volumes, large files etc. are performed. Solution testing methods include performing end-to-end, volume, performance, endurance and security testing. It is important to plan and design the tests to be performed properly, and that the relevant testing tools are used for accuracy and to increase the testing performance standards. 1. Solutions Testing Methods As a part of solution testing, there are several testing methods that can be performed such as end-to-end, volume, performance, endurance, and security testing scenario testing, to make sure the solution is tested in each of the aspects for best performance. Volume Testing Security Testing Solutions Testing Methods Performance Testing End-to-End Testing Endurance Testing Figure 1 3
4 1.1 End-to-End Scenario Testing Once the deployment is in place, end-to-end testing is performed to determine if the requirements of the contract are met and everything works as expected. This type of testing is similar to user acceptance testing. While doing end-to-end testing, one should clearly have an idea about all the combinations of user stories that the application is provided with. The following examples can be listed down for end-to-end scenario testing:- Online shopping site User tries to login Searches for items Adds them to a shopping cart Pays for the items purchased Receives confirmation Healthcare system Registering a patient Feed the system with diagnosed illness and symptoms Monitor medicine intake Monitor patient condition Discharge the patient An API store Registering a user Login to the store Subscribing to an API Retrieve specific keys Use it within an application created for a mobile device Trying out the API 4
5 1.2 Volume Testing Volume testing is generally done to find out how your application behaves with large amounts of data, and how the system behaves when excessive processing is done. This can be done either with a large number of users in the system, with larger databases or with millions of artifacts in the system. When the end solution is connected to a staging database with live data, one can ensure that the solution is working well under the expected load, and real world artifacts, etc. Through volume testing, we can figure out how large volumes of data can affect throughput/latency, and what issues the users might come across in data access. With large volumes of data in the system, one can find out whether there are any inefficiencies in the system such as slowness in message processing, and whether it would affect other functionalities of the solution. Usually, volume testing is performed for a buffer of around 30% - 50% than the actual peak load. The following scenarios can be performed as volume testing on the end solution depending on the type of the application: Verification of user login when thousands/millions of users exists in the system. When solution is connected to a large database with large amount of data verify message processing time and whether latency increases and throughput decreases. In a banking solution, if the database consists of large volumes of data, monitor the time taken to search customer information. If the solution is an API store, and it consists of thousands of APIs, measure the time taken to load APIs when a search is done. 1.3 Performance Testing Performance testing should always be done based on business needs. As the first step, one should identify what type of usage will take place once the solution is in production; Banking solution - how many accounts will be there in the system Healthcare system - the rate of patients being admitted daily, monthly, etc. Online shopping site - the number of transactions that occur during peak times of the year. Results of the performance tests are used to identify the benchmarks for the solution. It is recommended that the system is tuned properly before a performance test is done. Examples include: Increase the number of open connections Increase memory Disable debug logs 5
6 Performance testing can be done on areas mentioned below (scenarios can vary depending on the type of your solution. You should have a prior idea about the maximum usage it would have to handle): Online shopping site Verify user login functionality with millions of users. Verify message performance by measuring throughput and latency when millions of transactions happen, i.e. simulate the load during the peak season, such as holidays and festive sales. Healthcare system Simulate patient registration, discharging functionality that might happen in case of situations, such as when a tsunami, earthquake, or explosion takes place. Banking system Simulate the performance of transactions that would occur during peak seasons. To measure performance, different matrices are used. Figure 2 The above-mentioned matrices can be read through tools such as JProfiler and JConsole. To execute performance testing, tools like JMeter and SoapUI can be used. For security related load testing, SoapUI is the best option. JMeter and ApacheBench are tools that can be used to measure metrics like throughput and latency. 6
7 1.4 Endurance Testing Endurance testing is performed with a significant load to determine how the solution performs over a given period of time with respect to the nature of the solution. Tests are run continuously for an extended time duration, and the system is monitored. Through endurance testing, it can be found whether there are any memory leaks, unusual thread usage or any other weird behaviours in the SOA solution. When a solution is running continuously over a long period of time, i.e. over a year or two, it may hit periods where the usage would reach its peak depending on the type of the solution. Festive seasons and natural disasters are some examples of peak times. Following are steps that can be performed for endurance testing: 1. In case of an online shopping site, a long running test can be setup where the concurrency and frequency of usage can be simulated to match the actual usage during peak times. This can be done using tools like JMeter, Apache Bench or soapui. 2. While these tests are being executed, JConsole can be connected to the running servers, and CPU can be monitored for the usage of memory, threads etc. 3. By executing these tests for months, it can be observed and concluded whether the servers continue to run smoothly without any issues 1.5 Security Testing In any solution, even though the functionalities are working as expected, the application will be useless if any security issues occur, and this will lead to losing the trust of the customers on the solution. Therefore, it is really important that security is thoroughly tested, once the solution is deployed and running flawlessly. When it comes to any solution, you should ensure the following are satisfied with regard to security. Confidentiality - Making sure that the information within the system is only available to the intended parties. Integrity - Ensure that the information is not changed in transit by unauthorized people. Authentication - This is the process of making sure that all parties involved in the process are in fact who they say they are. Authentication can be verified by Username, X.509, SAML assertions, Kerberos tickets, or LTPA binary tokens Authorization - Providing people access to resources in the system, based on their identity. Non-repudiation - Ensuring that the messages have been sent and received by the people who are claiming to have sent and received them. 7
8 Once the system is up and running, the following steps can be performed to ensure the above: Verification of sensitive information disclosed in the URL. This can be verified by paying attention to the browser caches and in case of Windows, under C:\Documents and Settings\user\Local settings\temporary Internet Files. Verifying that Cross-site scripting (XSS) can be done to ensure authentication and session cookies cannot be stolen, and the accounts cannot be taken over by hackers. To verify this, tools such as WebScarab, XSSer and SoapUI can be used. By verifying possible XSS attacks, integrity and confidentiality can be ensured. Verification of the solution allowing to upload viruses and malware. A validation should be added to check whether only files types with extensions.pdf,.txt,.doc etc are allowed to be uploaded and.exe file uploading is restricted. 2. Test Planning and Design Test scenarios should be constructed based on the related user story. Following aspects should be considered in the process of test planning: Types of data transferred Usage of the system Consumer applications and Integration points Message exchange patterns 2.1 Types of data transferred As the first step, it is needed to identify what type of data is transferred through the SOA solution. This means determining what type of messages come into the system as requests, and what type of responses are sent back from the backend services to the system. For example, if the solution deals with JSON messages, then the test plan should include different types of JSON messages, such as simple JSON messages, and multi-rooted JSON messages. 2.2 Usage of the system When a production system is in place, depending on the user story, one can determine the number of requests that comes into the system and how often they come. Once this number is detected, the test environment can be stress tested with similar numbers. Therefore, in test planning, the identification of the aspects. such as the number of requests received per minute, and concurrency of requests, are needed. 8
9 2.3 Consumer applications and Integration points The SOA solution might be connected to many third-party applications/servers and different consumer applications. Depending on the type of application, the type of messages and the number of messages being transferred, may vary. Following are the steps that can be performed for endurance testing :- 2.4 Message exchange patterns (MEPs) The SOA solution may support different types of Message Exchange Patterns (MEPs) such as In-Only, In-Out, and Out-Only. Depending on the MEP that is used, test scenarios can be varied. RESTful scenarios can be planned with different types of MEPs. 3. Important Testing Tools There are many testing tools that are useful while working with an SOA solution. Some are used to invoke web services, some are useful for security testing, some to debug the solution and others to monitor the SOA solution. 3.1 Testing tools Apache JMeter JMeter is an open source tool that can be used for analyzing and measuring performance, and performing REST/SOAP invocations. This tool can be used to automate most user stories, and has the ability for parameterization, allowing one to run the same test from different users. One of the drawbacks of this tools is that it cannot be used to automate security related scenarios SoapUI SoapUI is also an open source tool that can be used for web services testing. In addition to functional testing, SoapUI can also be used for performance testing. One of the advantages of using SoapUI is that you can perform security testing using this tool curl This is a command line tool used to send or retrieve information with the use of URL syntax. This too is a free tool. This tool supports many internet protocols such as HTTP, HTTPS, FTP, IMAP and many more. curl is not heavily used for load testing and is mainly used for functional testing. 9
10 3.2 Monitoring tools When the SOA solution is in use, it is important to monitor if it is properly utilizing resources of the server its running on; if the CPU usage is increased when the application is serving requests, and if the program is not overusing threads or memory when it s running in the long run. Some examples of such tools are JConsole and Jprofiler JConsole This is a graphical monitoring tool to monitor Java Virtual Machine (JVM) and java applications running on a local or on a remote machine. When the Java based solution and JConsole starts, it will list the application in JConsole. Once connected to the selected java process, CPU usage, memory usage, thread usage, etc., of the application can be monitored. Long running tests can be executed and its behaviour can be monitored using this tool JProfiler This tools is a powerful Java profiler that allows to find performance bottlenecks, memory leaks as well as threading issues. With JProfiler, applications that run on the local machine or on remote machines can be profiled. While testing the SOA solution, if you suddenly notice that the CPU usage is increasing and is not responding, you can plug a JProfiler and monitor where it has gone wrong. Which process has caused the issue, and memory leaks if any can be revealed. From the various options available through JProfiler, the exact method that is causing a memory leak, thread leak, and so on, can be determined. 3.3 Debugging Tools There are many ways to debug an SOA solution. One way is to enable DEBUG logs. By enabling debug logs at certain levels, what happens while the message flows through the system can be monitored. Therefore, in such situations, the message body, its properties, and many other information can be monitored. This makes it easier to identify the cause of the issue. If HTTPS traffic needs to be monitored, wire level logs can be enabled for WSO2 products. If the SOA solution deals with SOAP messages, TCPMon can be used to monitor the HTTP traffic that passes through the SOA solution to the backend. Through TCPMon, the message can be captured and the message body, HTTP headers, etc. can be viewed. In addition to these tools, Wireshark can also be used to capture the messages passing through the SOA solution. 3.4 Bug Reporting Tools Once a bug is identified in the solution, there should be a way to record them. When a solution is given for a bug that is reported, a record can be kept for future references as to the actual cause for the bug and the solution. There are some open source bug reporting tools out there that can be used. Some examples are Bugzilla and JIRA. 10
11 4. Continuous Integration Continuous Integration is a software development practice, which requires developers to integrate code into a shared repository frequently. Each code check-in is verified by an automated build, which allows teams to detect errors quickly and easily. This approach reduces integration problems and allows development teams to work more collaboratively, and build software rapidly. Continuous Integration provides self-sustaining builds, which can be used to get most recent executables. Maintaining a single version control repository enables everyone to check-in the code, find out any clashes between commits, and enable to detect any integration failures early. Dashboards provided by Continuous Integration servers help to keep everyone aware of what is happening. Adhering to Continuous Integration builds leads to a stable solution that works properly and contains few bugs. Figure Tools for Continuous Integration Any Continuous Integration system requires three types of tools. Source code management system. Build management system and automated tests. Continuous Integration server. 11
12 4.1.1 Source code management System There are many tools that can be used for source code management. Subversion is the most widely used open source version control system available now. Once the source management system is available, make sure it is available for everyone to check-in or check-out source code Build Management System and Automated Tests Maven or Ant can be used as a build management tool. Both tools are open source and available under the Apache licence. To make the build self testing, a suite of automated tests are required to check large parts of the code base. Any Unit framework can be used to write integration or unit tests for SOA solutions. Unit testing frameworks are the starting point for self testing builds. There are quite a number of open source tools available for end-to-testing, such as TestNG, Junit, Selenium, Watir, and HTTPUnit. Maven Surefire plugin or Ant test executor tasks can be used for test triggering. For example, when automating WSO2 products, backend admin services can be used to simulate the artifact deployment, service invocation, and functionalities that can be done through the management console. UI test frameworks can also be used to automate UI oriented admin console functionalities. Selenium has proven to be compatible with WSO2 product user interfaces. If an SOA solution is automated using Jmeter or SoapUI script then integration with maven or Ant can be done by using relevant maven plugins and Ant task libraries. Continuous Integration servers will automatically execute integrated scripts in each build cycle Continuous Integration Servers Continuous Integration servers facilitate automation of the software build process. Some of the open source Continuous Integration servers are Jenkins, Cruisecontrol, Apache Continuum and Janky. Continuous Integration servers build executables, and runs automated tests periodically or even after every commit, and reports the result. It s not only for running automated tests but also allows organizations to implement continuous processes of applying quality control. 12
13 Summary Testing solutions built on SOA is an important and a difficult task. Therefore, it is important how you approach planning and executing the tests for these solutions. As part of solution testing, there are several testing methods that can be performed such as end-to-end, volume, performance, endurance and security testing. These make sure the solution is tested in each of the aspects for best performance. For each of these tests, different testing tools are used, and ApacheBench, JProfiler, JMeter, SoapUI can be named as the most popular. Test scenarios should be constructed based on the related user story. Types of data transferred, usage of the system, consumer applications & integration points, and message exchange patterns should be considered relating to each user stories when planning the tests. Continuous Integration is also an important aspect in SOA solution testing, where it allows to integrate code into a shared repository frequently. Any Continuous Integration system requires three types of tools that can be named as a source code management system, build management system, and automated tests continuous integration server. This approach reduces integration problems and allows development teams to work more collaboratively, and build software rapidly. About WSO2 WSO2 is the lean enterprise middleware company. It delivers the only complete open source enterprise SOA middleware stack purpose-built as an integrated platform to support today s heterogeneous enterprise environments internally and in the cloud. WSO2 s service and support team is led by technical experts who have proven success in deploying enterprise SOAs and contribute to the technology standards that enable them. Check out more WSO2 Whitepapers and WSO2 Case Studies. For more information about WSO2 products and services, please visit or bizdev@wso2.com
Performance Testing Process A Whitepaper
Process A Whitepaper Copyright 2006. Technologies Pvt. Ltd. All Rights Reserved. is a registered trademark of, Inc. All other trademarks are owned by the respective owners. Proprietary Table of Contents
More informationLoad Testing with JMeter
Load Testing with JMeter Presented by Matthew Stout - mat@ucsc.edu JMeter Overview Java application for load testing and measuring performance Originally for web applications but has grown to support lots
More informationPerformance Testing and Optimization in Web-Service Based Applications
Performance Testing and Optimization in Web-Service Based Applications Mesfin Mulugeta mesfin.mulugeta@blackboard.com Sr. Software Performance Engineer Goals of the Presentation Brief introduction to software
More informationPerformance Analysis of webmethods Integrations using Apache JMeter Information Guide for JMeter Adoption
TORRY HARRIS BUSINESS SOLUTIONS Performance Analysis of webmethods Integrations using Apache JMeter Information Guide for JMeter Adoption Ganapathi Nanjappa 4/28/2010 2010 Torry Harris Business Solutions.
More informationBest Practices for Web Application Load Testing
Best Practices for Web Application Load Testing This paper presents load testing best practices based on 20 years of work with customers and partners. They will help you make a quick start on the road
More informationClient Overview. Engagement Situation. Key Requirements
Client Overview Our client is the leading provider of health insurance related solutions for providing online and easy access to health insurance. Our client offers these services to a range of consumers
More informationHow To Test A Web Server
Performance and Load Testing Part 1 Performance & Load Testing Basics Performance & Load Testing Basics Introduction to Performance Testing Difference between Performance, Load and Stress Testing Why Performance
More informationE-vote 2011 Version: 1.0 Testing and Approval Date: 26/10/2009. E-vote 2011. SSA-U Appendix 5 Testing and Approval Project: E-vote 2011
E-vote 2011 SSA-U Appendix 5 Testing and Approval Project: E-vote 2011 Change log Version Date Author Description/changes 0.1 26.10.09 First version Page 1 CONTENT 1. INTRODUCTION 3 2. TESTING PROCESS
More informationGUI Test Automation How-To Tips
www. routinebot.com AKS-Labs - Page 2 - It s often said that First Impression is the last impression and software applications are no exception to that rule. There is little doubt that the user interface
More informationOpen Source and Commercial Performance Testing Tools
Open Source and Commercial Performance Testing Tools Palla Vinod Kumar Accenture Delivery Center for Technology in India Accenture, its logo, and High Performance Delivered are trademarks of Accenture.
More information1 How to Monitor Performance
1 How to Monitor Performance Contents 1.1. Introduction... 1 1.1.1. Purpose of this How To... 1 1.1.2. Target Audience... 1 1.2. Performance - some theory... 1 1.3. Performance - basic rules... 3 1.4.
More information1 How to Monitor Performance
1 How to Monitor Performance Contents 1.1. Introduction... 1 1.2. Performance - some theory... 1 1.3. Performance - basic rules... 3 1.4. Recognizing some common performance problems... 3 1.5. Monitoring,
More informationSummer Internship 2013 Group No.4-Enhancement of JMeter Week 1-Report-1 27/5/2013 Naman Choudhary
Summer Internship 2013 Group No.4-Enhancement of JMeter Week 1-Report-1 27/5/2013 Naman Choudhary For the first week I was given two papers to study. The first one was Web Service Testing Tools: A Comparative
More informationSensitivity Analysis and Patterns Implementation on Load Testing Software Systems
Sensitivity Analysis and Patterns Implementation on Load Testing Software Systems Alexandra Nagy*, George Sebastian Chiş Babeş-Bolyai University, Faculty of Economics and Business Administration, Computer
More informationPerfect Your Mobile App with Load Testing and Test Automation
Wipro & Experitest Co-webinar: Perfect Your Mobile App with Load Testing and Test Automation June 2015 Speakers Guy Arieli CTO Experitest Sudheer Mohan Director - Mobility Certification & Automation Wipro
More informationMike Chyi, Micro Focus Solution Consultant May 12, 2010
Mike Chyi, Micro Focus Solution Consultant May 12, 2010 Agenda Load Testing Overview, Best Practice: Performance Testing with Diagnostics Demo (?), Q&A Load Testing Overview What is load testing? Type
More informationChapter 1: Web Services Testing and soapui
Chapter 1: Web Services Testing and soapui SOA and web services Service-oriented solutions Case study Building blocks of SOA Simple Object Access Protocol Alternatives to SOAP REST Java Script Object Notation
More informationFeatures of The Grinder 3
Table of contents 1 Capabilities of The Grinder...2 2 Open Source... 2 3 Standards... 2 4 The Grinder Architecture... 3 5 Console...3 6 Statistics, Reports, Charts...4 7 Script... 4 8 The Grinder Plug-ins...
More information5 Mistakes to Avoid on Your Drupal Website
5 Mistakes to Avoid on Your Drupal Website Table of Contents Introduction.... 3 Architecture: Content.... 4 Architecture: Display... 5 Architecture: Site or Functionality.... 6 Security.... 8 Performance...
More informationApplication Performance Testing Basics
Application Performance Testing Basics ABSTRACT Todays the web is playing a critical role in all the business domains such as entertainment, finance, healthcare etc. It is much important to ensure hassle-free
More informationComparative Study of Load Testing Tools
Comparative Study of Load Testing Tools Sandeep Bhatti, Raj Kumari Student (ME), Department of Information Technology, University Institute of Engineering & Technology, Punjab University, Chandigarh (U.T.),
More informationSAIP 2012 Performance Engineering
SAIP 2012 Performance Engineering Author: Jens Edlef Møller (jem@cs.au.dk) Instructions for installation, setup and use of tools. Introduction For the project assignment a number of tools will be used.
More informationWeb Application s Performance Testing
Web Application s Performance Testing B. Election Reddy (07305054) Guided by N. L. Sarda April 13, 2008 1 Contents 1 Introduction 4 2 Objectives 4 3 Performance Indicators 5 4 Types of Performance Testing
More informationTable of Contents INTRODUCTION... 3. Prerequisites... 3 Audience... 3 Report Metrics... 3
Table of Contents INTRODUCTION... 3 Prerequisites... 3 Audience... 3 Report Metrics... 3 IS MY TEST CONFIGURATION (DURATION / ITERATIONS SETTING ) APPROPRIATE?... 4 Request / Response Status Summary...
More informationTesting Tools Content (Manual with Selenium) Levels of Testing
Course Objectives: This course is designed to train the fresher's, intermediate and professionals on testing with the concepts of manual testing and Automation with Selenium. The main focus is, once the
More informationPerformance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering
Delivering Excellence in Software Engineering Performance Testing An introduction. Why is important? Why is important? 2 1 https://www.youtube.com/watch?v=8y8vqjqbqdc 3 4 2 Introduction Why is important?
More informationSoftware Quality Analysis with Cloud Challenges and Approaches. Progress Software, Hyderabad, India
Software Quality Analysis with Cloud Challenges and Approaches Dr Ganesh Iyer, PhD, Santhosh Kumar Soma, Kiran Kumar Angara, Principal QA Engineer Senior QA Engineer QA Engineer, Progress Software, Hyderabad,
More informationPerformance Testing. Slow data transfer rate may be inherent in hardware but can also result from software-related problems, such as:
Performance Testing Definition: Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program or device. This process can involve
More informationBringing Value to the Organization with Performance Testing
Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of
More informationWEBAPP PATTERN FOR APACHE TOMCAT - USER GUIDE
WEBAPP PATTERN FOR APACHE TOMCAT - USER GUIDE Contents 1. Pattern Overview... 3 Features 3 Getting started with the Web Application Pattern... 3 Accepting the Web Application Pattern license agreement...
More informationLevels of Software Testing. Functional Testing
Levels of Software Testing There are different levels during the process of Testing. In this chapter a brief description is provided about these levels. Levels of testing include the different methodologies
More informationTitle: Continuous Delivery and Continuous Integration. Conference: 13 th Annual Software Testing Conference 2013
1 Title: Continuous Delivery and Continuous Integration Conference: 13 th Annual Software Testing Conference 2013 Author: Tanvi Dharmarha Email: tbajajdh@adobe.com Organization Name: Adobe Systems Inc
More informationUsing JMeter for Testing a Data Center. Siegfried Goeschl
Using JMeter for Testing a Data Center Siegfried Goeschl 1 Siegfried, do you want to do some performance testing? Well, what would you like to test? 2 Some Data Centers with 300 servers, MSSQL clusters,
More informationPerformance Analysis and Capacity Planning Whitepaper
Performance Analysis and Capacity Planning Whitepaper Contents P E R F O R M A N C E A N A L Y S I S & Executive Summary... 3 Overview... 3 Product Architecture... 4 Test Environment... 6 Performance Test
More informationSoftware infrastructure for Java development projects
Tools that can optimize your development process Software infrastructure for Java development projects Presentation plan Software Development Lifecycle Tools What tools exist? Where can tools help? Practical
More informationEvaluation of Load/Stress tools for Web Applications testing
May 14, 2008 Whitepaper Evaluation of Load/Stress tools for Web Applications testing CONTACT INFORMATION: phone: +1.301.527.1629 fax: +1.301.527.1690 email: whitepaper@hsc.com web: www.hsc.com PROPRIETARY
More informationRTI Quick Start Guide for JBoss Operations Network Users
RTI Quick Start Guide for JBoss Operations Network Users This is the RTI Quick Start guide for JBoss Operations Network Users. It will help you get RTI installed and collecting data on your application
More informationBusiness Application Services Testing
Business Application Services Testing Curriculum Structure Course name Duration(days) Express 2 Testing Concept and methodologies 3 Introduction to Performance Testing 3 Web Testing 2 QTP 5 SQL 5 Load
More informationArcGIS for Server: Administrative Scripting and Automation
ArcGIS for Server: Administrative Scripting and Automation Shreyas Shinde Ranjit Iyer Esri UC 2014 Technical Workshop Agenda Introduction to server administration Command line tools ArcGIS Server Manager
More informationLoad and Performance Load Testing. RadView Software October 2015 www.radview.com
Load and Performance Load Testing RadView Software October 2015 www.radview.com Contents Introduction... 3 Key Components and Architecture... 4 Creating Load Tests... 5 Mobile Load Testing... 9 Test Execution...
More informationPerformance Testing Percy Pari Salas
Performance Testing Percy Pari Salas Presented by : Percy Pari Salas Agenda What is performance testing? Types of performance testing What does performance testing measure? Where does performance testing
More informationPerformance Testing Process
Delivering Excellence in Software Engineering Performance Testing An introduction. 1 2 3 4 5 6 Introduction Performance Testing Process Performance Test Types Tools JMeter Questions 2 1 Introduction This
More informationWhite paper: Unlocking the potential of load testing to maximise ROI and reduce risk.
White paper: Unlocking the potential of load testing to maximise ROI and reduce risk. Executive Summary Load testing can be used in a range of business scenarios to deliver numerous benefits. At its core,
More informationhttp://www.wakaleo.com john.smart@wakaleo.com Java Software Quality Tools and techniques
Wakaleo Consulting O p t i m i z i n g y o u r s o f t w a r e d e v e l o p m e n t http://www.wakaleo.com john.smart@wakaleo.com Java Software Quality Tools and techniques 1 Introduction Agenda tools
More informationHow To Test For Performance
: Roles, Activities, and QA Inclusion Michael Lawler NueVista Group 1 Today s Agenda Outline the components of a performance test and considerations Discuss various roles, tasks, and activities Review
More informationMEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM?
MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? Ashutosh Shinde Performance Architect ashutosh_shinde@hotmail.com Validating if the workload generated by the load generating tools is applied
More informationWhat Is Specific in Load Testing?
What Is Specific in Load Testing? Testing of multi-user applications under realistic and stress loads is really the only way to ensure appropriate performance and reliability in production. Load testing
More information10 Best Practices for Application Performance Testing
Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table
More informationIBM WebSphere Server Administration
IBM WebSphere Server Administration This course teaches the administration and deployment of web applications in the IBM WebSphere Application Server. Duration 24 hours Course Objectives Upon completion
More informationWHAT WE NEED TO START THE PERFORMANCE TESTING?
ABSTRACT Crystal clear requirements before starting an activity are always helpful in achieving the desired goals. Achieving desired results are quite difficult when there is vague or incomplete information
More information<Insert Picture Here> Introducing Hudson. Winston Prakash. Click to edit Master subtitle style
Introducing Hudson Click to edit Master subtitle style Winston Prakash What is Hudson? Hudson is an open source continuous integration (CI) server. A CI server can do various tasks
More informationWhat s New in WebLOAD 10.1
What s New in WebLOAD 10.1 Version Compatibility Information WebLOAD 10.1 is compatible with all load testing scripts (Agendas) that were created using WebLOAD version 8.0 or higher. Version 10.1 highlights
More informationA Talk ForApacheCon Europe 2008
a talk for ApacheCon Europe 2008 by Jeremy Quinn Break My Site practical stress testing and tuning photo credit: Môsieur J This is designed as a beginner s talk. I am the beginner. 1 I will present two
More informationGuideline for stresstest Page 1 of 6. Stress test
Guideline for stresstest Page 1 of 6 Stress test Objective: Show unacceptable problems with high parallel load. Crash, wrong processing, slow processing. Test Procedure: Run test cases with maximum number
More informationCrawl Proxy Installation and Configuration Guide
Crawl Proxy Installation and Configuration Guide Google Enterprise EMEA Google Search Appliance is able to natively crawl secure content coming from multiple sources using for instance the following main
More informationPerformance Analysis of Web based Applications on Single and Multi Core Servers
Performance Analysis of Web based Applications on Single and Multi Core Servers Gitika Khare, Diptikant Pathy, Alpana Rajan, Alok Jain, Anil Rawat Raja Ramanna Centre for Advanced Technology Department
More informationWeb Application Testing. Web Performance Testing
Web Application Testing Web Performance Testing Objectives of Performance Testing Evaluate runtime compliance to performance requirements Check different properties such as throughput (bits/sec, packets/sec)
More informationGLOBAL JOURNAL OF ENGINEERING SCIENCE AND RESEARCHES
GLOBAL JOURNAL OF ENGINEERING SCIENCE AND RESEARCHES A LITERATURE SURVEY ON DESIGN AND ANALYSIS OF WEB AUTOMATION TESTING FRAMEWORK - SELENIUM Revathi. K *1 and Prof. Janani.V 2 PG Scholar, Dept of CSE,
More informationCopyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh),
Content of 6 Months Software Testing Training at EH1-Infotech Module 1: Introduction to Software Testing Basics of S/W testing Module 2: SQA Basics Testing introduction and terminology Verification and
More informationProcess of Performance Testing a Banking Application
Process of Performance Testing a Banking Application The Need One of the largest banks in India offers Online and Mobile Banking application to its customers. Several online services are hassle-free services
More informationAutomated performance testing using Maven & JMeter. George Barnett, Atlassian Software Systems @georgebarnett
Automated performance testing using Maven & JMeter George Barnett, Atlassian Software Systems @georgebarnett Create controllable JMeter tests Configure Maven to create a repeatable cycle Run this build
More informationBuilding a Modular Server Platform with OSGi. Dileepa Jayakody Software Engineer SSWSO2 Inc.
Building a Modular Server Platform with OSGi Dileepa Jayakody Software Engineer SSWSO2 Inc. Outline Complex Systems OSGi for Modular Systems OSGi in SOA middleware Carbon : A modular server platform for
More informationTest Run Analysis Interpretation (AI) Made Easy with OpenLoad
Test Run Analysis Interpretation (AI) Made Easy with OpenLoad OpenDemand Systems, Inc. Abstract / Executive Summary As Web applications and services become more complex, it becomes increasingly difficult
More informationApplication Code Development Standards
Application Code Development Standards Overview This document is intended to provide guidance to campus system owners and software developers regarding secure software engineering practices. These standards
More informationThe Monitis Monitoring Agent ver. 1.2
The Monitis Monitoring Agent ver. 1.2 General principles, Security and Performance Monitis provides a server and network monitoring agent that can check the health of servers, networks and applications
More informationSoftware Testing Automation
nareng9@gmail.com +91-7760999789 Software Testing Automation Extensive experience in executing full STLC; ramping-up projects within time, budget & quality parameters, as per project management & best
More informationJVA-122. Secure Java Web Development
JVA-122. Secure Java Web Development Version 7.0 This comprehensive course shows experienced developers of Java EE applications how to secure those applications and to apply best practices with regard
More information1. Introduction. 2. Web Application. 3. Components. 4. Common Vulnerabilities. 5. Improving security in Web applications
1. Introduction 2. Web Application 3. Components 4. Common Vulnerabilities 5. Improving security in Web applications 2 What does World Wide Web security mean? Webmasters=> confidence that their site won
More informationWeb Load Stress Testing
Web Load Stress Testing Overview A Web load stress test is a diagnostic tool that helps predict how a website will respond to various traffic levels. This test can answer critical questions such as: How
More informationTIBCO Spotfire Platform IT Brief
Platform IT Brief This IT brief outlines features of the system: Communication security, load balancing and failover, authentication options, and recommended practices for licenses and access. It primarily
More informationJava Power Tools. John Ferguson Smart. ULB Darmstadt 1 PI. O'REILLY 4 Beijing Cambridge Farnham Koln Paris Sebastopol Taipei Tokyo
Java Power Tools John Ferguson Smart ULB Darmstadt 1 PI O'REILLY 4 Beijing Cambridge Farnham Koln Paris Sebastopol Taipei Tokyo Table of Contents Foreword Preface Introduction xvii xix xxxiii Parti. Build
More informationIERG 4080 Building Scalable Internet-based Services
Department of Information Engineering, CUHK Term 1, 2015/16 IERG 4080 Building Scalable Internet-based Services Lecture 10 Load Testing Lecturer: Albert C. M. Au Yeung 18 th November, 2015 Software Performance
More informationCe document a été téléchargé depuis le site de Precilog. - Services de test SOA, - Intégration de solutions de test.
Ce document a été téléchargé depuis le site de Precilog. - Services de test SOA, - Intégration de solutions de test. 01 39 20 13 55 info@precilog.com www.precilog.com End to End Process Testing & Validation:
More informationTest Challenges and Approaches With SaaS and PaaS. Dr. Ganesh Neelakanta Iyer Principal QA Engineer Progress Software
Test Challenges and Approaches With SaaS and PaaS Dr. Ganesh Neelakanta Iyer Principal QA Engineer Progress Software About Me Completed B.Tech. in Computer Science and Engineering from Mahatma Gandhi University,
More informationPerformance Testing of Java Enterprise Systems
Performance Testing of Java Enterprise Systems Katerina Antonova, Plamen Koychev Musala Soft Why Performance Testing? Recent studies by leading USA consultancy companies showed that over 80% of large corporations
More informationTh3 - Open Source Tools for Test Management
Th3 - Open Source Tools for Test Management Narayanan C. V., Vice President, Sonata Software Limited www.sonata-software.com Agenda Introduction Methodology Architectural View Test Management Best Practices
More informationUser and Programmer Guide for the FI- STAR Monitoring Service SE
User and Programmer Guide for the FI- STAR Monitoring Service SE FI-STAR Beta Release Copyright 2014 - Yahya Al-Hazmi, Technische Universität Berlin This document gives a short guide on how to use the
More informationMonitoring HP OO 10. Overview. Available Tools. HP OO Community Guides
HP OO Community Guides Monitoring HP OO 10 This document describes the specifications of components we want to monitor, and the means to monitor them, in order to achieve effective monitoring of HP Operations
More informationWhitepaper Performance Testing and Monitoring of Mobile Applications
M eux Test Whitepaper Performance Testing and Monitoring of Mobile Applications Abstract The testing of a mobile application does not stop when the application passes all functional tests. Testing the
More informationSonatype CLM Enforcement Points - Continuous Integration (CI) Sonatype CLM Enforcement Points - Continuous Integration (CI)
Sonatype CLM Enforcement Points - Continuous Integration (CI) i Sonatype CLM Enforcement Points - Continuous Integration (CI) Sonatype CLM Enforcement Points - Continuous Integration (CI) ii Contents 1
More informationTool - 1: Health Center
Tool - 1: Health Center Joseph Amrith Raj http://facebook.com/webspherelibrary 2 Tool - 1: Health Center Table of Contents WebSphere Application Server Troubleshooting... Error! Bookmark not defined. About
More informationEXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1.
CONTENTS 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix EXECUTIVE SUMMARY Tenzing Managed IT services has recently partnered with Amazon Web Services
More informationContinuous Performance Testing
Continuous Performance Testing Confoo.ca Kore Nordmann (@koredn) 27. Feb 2013 Continuous Performance Testing 1 / 30 About me Degree in computer sience Professional PHP since 2000 Open source enthusiast
More informationA Tool for Evaluation and Optimization of Web Application Performance
A Tool for Evaluation and Optimization of Web Application Performance Tomáš Černý 1 cernyto3@fel.cvut.cz Michael J. Donahoo 2 jeff_donahoo@baylor.edu Abstract: One of the main goals of web application
More informationJava Mission Control
Java Mission Control Harald Bräuning Resources Main Resource: Java Mission Control Tutorial by Marcus Hirt http://hirt.se/downloads/oracle/jmc_tutorial.zip includes sample projects! Local copy: /common/fesa/jmcexamples/jmc_tutorial.zip
More informationTRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes
TRACE PERFORMANCE TESTING APPROACH Overview Approach Flow Attributes INTRODUCTION Software Testing Testing is not just finding out the defects. Testing is not just seeing the requirements are satisfied.
More informationVERIFICATION AND VALIDATION AUTOMATED TESTING TOOLS CLAUDIU ADAM
VERIFICATION AND VALIDATION AUTOMATED TESTING TOOLS CLAUDIU ADAM ABOUT ISDC ISDC... in a nutshell: - founded in 1990 in the Netherlands (Hilversum), 1999 in Romania (Cluj) - with a current pool more than
More informationHow To Set Up Wiremock In Anhtml.Com On A Testnet On A Linux Server On A Microsoft Powerbook 2.5 (Powerbook) On A Powerbook 1.5 On A Macbook 2 (Powerbooks)
The Journey of Testing with Stubs and Proxies in AWS Lucy Chang lucy_chang@intuit.com Abstract Intuit, a leader in small business and accountants software, is a strong AWS(Amazon Web Services) partner
More informationJérôme Lepage - CFCamp 2013. Mondadori France
Jérôme Lepage - CFCamp 2013 Mondadori France French press magazine group (#3) Subsidiary of Mondadori Italia ~ 30 magazines 10,6% market in 2011 381,6 million in 2012 In Web Development since 1999 Php
More informationHow To Monitor A Server With Zabbix
& JavaEE Platform Monitoring A Good Match? Company Facts Jesta Digital is a leading global provider of next generation entertainment content and services for the digital consumer. subsidiary of Jesta Group,
More informationGetting started with OWASP WebGoat 4.0 and SOAPUI.
Getting started with OWASP WebGoat 4.0 and SOAPUI. Hacking web services, an introduction. Version 1.0 by Philippe Bogaerts Philippe.Bogaerts@radarhack.com www.radarhack.com Reviewed by Erwin Geirnaert
More informationThe Association of System Performance Professionals
The Association of System Performance Professionals The Computer Measurement Group, commonly called CMG, is a not for profit, worldwide organization of data processing professionals committed to the measurement
More informationApplication and Web Load Testing. Datasheet. Plan Create Load Analyse Respond
Application and Web Load Testing Datasheet Plan Create Load Analyse Respond Product Overview JAR:load is an innovative web load testing solution delivered from the Cloud* for optimising the performance
More informationWebSphere Server Administration Course
WebSphere Server Administration Course Chapter 1. Java EE and WebSphere Overview Goals of Enterprise Applications What is Java? What is Java EE? The Java EE Specifications Role of Application Server What
More informationWEBLOGIC ADMINISTRATION
WEBLOGIC ADMINISTRATION Session 1: Introduction Oracle Weblogic Server Components Java SDK and Java Enterprise Edition Application Servers & Web Servers Documentation Session 2: Installation System Configuration
More informationWhite Paper. CCRM Services on Cloud Benefits of Private Cloud for CCRM Services. Abstract. - Krishna Vaddadi
White Paper CCRM Services on Cloud Benefits of Private Cloud for CCRM Services - Krishna Vaddadi Abstract Configuration, Change and Release Management (CCRM) activities are the primary deliverables in
More informationNetwork Management and Monitoring Software
Page 1 of 7 Network Management and Monitoring Software Many products on the market today provide analytical information to those who are responsible for the management of networked systems or what the
More informationThe HTTP Plug-in. Table of contents
Table of contents 1 What's it for?... 2 2 Controlling the HTTPPlugin... 2 2.1 Levels of Control... 2 2.2 Importing the HTTPPluginControl...3 2.3 Setting HTTPClient Authorization Module... 3 2.4 Setting
More informationHow To Test A Web Based System
Testing Web-Based Systems-Checklists Testing Web-Based Systems -Checklist Overview-: Web-based testing should be RISK ORIENTED. This article describes the risks, presents the types of testing that can
More informationPerformance TesTing expertise in case studies a Q & ing T es T
testing & QA Performance Testing Expertise in Case Studies Case 1 ELEKS team has developed a custom test framework designed to accommodate numerous types of testing and measurements: Accuracy testing during
More information