SCALING USER-SESSIONS FOR LOAD TESTING OF INTERNET APPLICATIONS

Transcription

1 SCALING USER-SESSIONS FOR LOAD TESTING OF INTERNET APPLICATIONS Benjamin Houdeshell IS809 5/14/2014

2 Background/Motivation Performance/load testing research concerned with the simulation of users behavior models Script recorders Manual case creation Most performance/load testing tools Simulate requests (Blazemeter.com) Manual creation ( 1 JMeter & LoadStorm.com) Desktop or single Server configuration 1 JMeter can perforem both functions script recorder & manual case creation

3 Development & Research Project The goal is to conduct a case study to evaluating the effectiveness of the load testing method using User-Sessions - simulate of users behavior Test suite reduction Test prioritization Parallel framework state-of-the-art framework Using a replay mechanism with a parallel processing framework to replay user sessions concurrently to imitate realistic web traffic load. For creating a realistic load testing environment I will use Amazon Web Services(AWS).

4 Evaluation To evaluate the effectiveness of User-Sessions & parallel framework, I plan to compare it to compare it with existing load testing tools. Apache JMeter Desktop web load testing tool

5 Development Development Web Application Schoolmate 1 Open Source administration tool for elementary & middle schools C++ OpenMP Parallel framework Hosting on: AWS EC2 HPC instance Memory Optimized HPC Instance 32 vcpu & 244 GB of memory Small, Medium, and Large Server instances Executes external process Logs client and server metrics 1

6 Development - Schoolmate

7 Development Platform 1 OpenMP is an API that supports shared memory multiprocessing development in C, C++, and Fortran. OpenMP Code example 1

8 Development Platform OpenMP Threading

9 Development - OpenMP OpenMP facilitates making data structures thread-safe and that is the biggest part of parallelizing an application typically. Other features in OpenMP allow the application developer to avoid rewriting tricky threading synchronization. 1 OpenMP quicksort example pthread quicksort example

10 Development OpenMP 1 Results from a study evaluating OpenMP and Threads: OpenMP facilitates making data structures thread-safe and that is the biggest part of parallelizing an application typically. Other features in OpenMP allow the application developer to avoid rewriting tricky threading synchronization. 1 Bob Kuhn, Paul Petersen, and Eamonn O Toole. Openmp versus threading in c/c++. Concurrency - Practice and Experience, 12: , 2000.

11 Development Cloud Configuration Parallel Code Replay-tool Test Cases Log Script Application & Log Script

12 Creation and Execution of User-Sessions

13 Creation and Execution of User-Sessions in Parallel

14 Apache JMeter Tool

15 Apache JMeter Tool Converted current Schoolmate test cases to JMeter format Very time consuming! Will execute the test cases against the same AWS Setup as the parallel test: JMeter Log Script Application & Log Script

16 Research Questions How does user-sessions benefit over traditional methods? How effective are User-Sessions with a Parallel processing compared with Commercial tools?

17 Results How does user-sessions benefit over traditional methods? Remove the need for: Script Recorders Manual test case creation Regression suite Increases productivity

18 Results How effective are User-Sessions with a Parallel processing compared with tools? Results need to be graphed