W10 HOW TO TEST YOUR NEW.NET APPLICATIONS. Dan Koloski Empirix Software BIO PRESENTATION. May 19, :45PM

Transcription

1 BIO PRESENTATION W10 May 19, :45PM HOW TO TEST YOUR NEW.NET APPLICATIONS Dan Koloski Empirix Software International Conference On Software Testing Analysis and Review May 17-21, 2004 Orlando, Florida USA

2 Dan Koloski Dan Koloski is the Director of Empirix s Application Test Group. He has extensive experience designing, building, deploying and testing mission-critical applications centered around e-commerce, content management, CRM and data warehousing. During the past several years, he has also served as a certified ColdFusion instructor and has authored numerous papers and articles on application development and testing. Dan is a graduate of Yale University and holds an MBA from Harvard Business School.

3 Quality Assurance and.net How to Effectively Test Your New.NET Applications Dan Koloski Director, Application Test Group, Empirix STAREAST 2004

4 Agenda Introduction What is.net? What are the Challenges in Testing.NET? How do you Systematically Test.NET Applications? Q & A 2

5 Quality of Experience (QoE): Quality from the Customer s Perspective Empirix s core purpose is to deliver comprehensive, end-to-end test and monitoring solutions that ensure the quality, performance and reliability of critical customerfacing networked applications and infrastructure. Web Applications Contact Center Communications Infrastructure 3

6 Empirix Web Solutions Overview Empirix Web test and monitoring solutions span the entire application life-cycle Activity Requirements / Architecture Definition Component / Web Development Initial Integration System Testing Final Integration Deployment T e s t i n g Test Process Management Functional & Regression System-level Load e-test suite e-manager Enterprise e-load e-tester Performance Tuning & Benchmarking e-loadexpert M o n i t o r i n g 24x7 Monitoring Hosted Monitoring OneScript Family of Products OneSight FarSight 4

7 What is.net? Microsoft s Implementation of an Open Standard A Managed Application Framework Enterprise Web applications XML Web Services Desktop applications Over one million developers are using.net 5

8 What s in.net? Client-facing technologies Web Forms XML Web Services Windows Forms Underlying Infrastructure Base, Data, XML Classes Common Language Runtime (CLR) 6

9 What are Web Forms? Rich UI controls Hosted on.net servers Render to HTML and customizable JavaScript Easier to implement complex UI State of the application can be offloaded to other servers Reduces cost of application downtime Rapid Development Driven by ASP.NET Technology More scalable than ASP 7

10 Testing Issues: Web Forms Web Forms make use of new technologies that have their own tradeoffs Your job is to ensure that the tradeoffs made were appropriate! ViewState Post Backs Automatically Generated Client-Side Code IE5 HTML Components and Web Controls 8

11 ViewState and PostBacks ViewState = caches state info Post Backs = roundtrip for subtle application changes <form name="default" method="post" action="default.aspx" id="default"> <input type="hidden" name=" EVENTTARGET" value="" /> <input type="hidden" name=" EVENTARGUMENT" value="" /> <! Most of this ViewState has been cut out for brevity --> <input type="hidden" name=" VIEWSTATE" value="ddw2mjcwnjk2mje7ddw7bdxppde+oz47bdx0pdtspgk8mt47atwzpjtppdu+o2k8nz47atwxmt47a TwxMz47aTwxNT47aTwxNz47PjtsPHQ8dDxwPHA8bDxEYXRhVGV4dEZpZWxkO0RhdGFWYWx1ZUZpZWxk Oz47bDxDYXRlZ29yeU5hbWU7Q2F0ZWdvcnlJRDs" /> <script language="javascript"> <! // --> </script> function dopostback(eventtarget, eventargument) { } var theform = document.default; theform. EVENTTARGET.value = eventtarget; theform. EVENTARGUMENT.value = eventargument; theform.submit(); 9

12 Example: Potential ViewState Issues ViewState can quickly become a HUGE amount of data, which will negatively impact performance the size of ViewState can be managed, but developers have to proactively do it Testers must test for ViewState size and performance impact and communicate that back to developers ViewState Size Tests Server Response Tests See an example 10

13 Potential ViewState Issues Continued Example 1: ViewState Example Additional Thoughts Use Trace to help determine the offending controls <trace enabled= true Evaluate the trade off between performance and complexity of code Use Server Response Tests and ViewState Tests It is Essential to Test and Evaluate the impact! 11

14 Potential Web Controls Issues Web Controls automatically generate client-side code, and as such are subject to browser compilation errors You MUST test for these compilation errors However, these same compilation errors make test automation difficult, particularly for legacy tools 12

15 Potential Web Controls Issues Continued Legacy (GUI) testing tools default to coordinate-based (X,Y) testing, which has implications for accuracy and maintenance.net-aware tools (such as e-test suite) natively drive navigation and validate automatically See an example 13

16 XML Web Services Open standard of exposing an application Communicate via ubiquitous protocols SOAP/XML HTTP Self-describing WSDL Document Typically no user interface Used for integration of disparate systems and new applications Web Services in.net Rapid Development and Deployment Hosted in an ASP.NET Environment 14

17 Testing Issues: Web Services Testing with a user interface Traditional GUI tools useless Difficult Isolation of Web Services Transactions XML validation Embedded SOAP Requests XMLHttp and SOAPInvoke 15

18 Testing Challenge for Web Services If there s no User Interface, how do I Generate Tests? Validate Responses With e-test you ve got quick ways Instrument WSDL file Record SOAP request and flexibility if you need it. 16

19 Windows Forms Designed to enable rich-client applications Web-deployed, browser-hosted applications Legacy desktop and client server applications Interoperates with legacy Win32/ActiveX systems Mostly Win32-specific 17

20 Potential Windows Forms Issues Web-Deployed Windows Forms Testing Like a Web Application, are rendered on-the-fly, so need SIMULTANEOUS Functional and Load Testing (a.k.a., functional tests under load) The next generation of ActiveX See an example Desktop and C/S Functional and Load Testing Can test with most legacy GUI and Protocol testing tools, with all of their tradeoffs 18

21 Conclusion & Final Thoughts.NET offers substantial benefits: Open Standard Rich web and client application framework Integration with next-generation Web Services BUT,.NET introduces new technologies that have their own tradeoffs, and your job as a tester is to highlight those tradeoffs and ensure that they were appropriate! 19

22 Questions and Answers