Resource-Efficiency Testing. Introduction to Resource Efficiency Testing

Transcription

1 Introduction to Resource Efficiency Testing

2 Contents Introduction Metrics Acquisition - Windows Performance Monitor OPC Server test plan model OPC Client test plan model Network Failure Simulation Batch File Test Reports Next Steps

3 Introduction (1 of 3) What is it? More info? 36-hour stress-test to verify no resource leaks exist in your product, e.g. CPU, memory, threads etc. Windows Performance Monitor is used in the lab; the performance counter details are available online: technet.microsoft.com/en-us/library/cc aspx What is tested? UA Servers/Clients, OPC Classic Servers/Clients Easy to test? Yes, but several other OPC products are required to generate a load on the product being tested. You 3

4 Introduction (2 of 3) How it works: Test authors? UA and Classic products are tested the same way: Servers: - multiple device (PLC) connections; 1 is intermittent - 5 or more OPC Client connections, 1 is intermittent Clients: - 5 or more OPC Server connections, 1 is intermittent Load is placed on the product for stress-testing. Resources are measured over 36-hours. Compliance Working Group 4

5 Introduction (3 of 3) How do I pass? Am I Certified? Lab tools used? Test when? No resource leaks or performance degradation. No. It means that your product is a good candidate for certification testing in a Test Lab. Windows Performance Monitor, network fault simulation BAT file, also: Servers: 2 or more PLCs; 5 or more OPC Clients. Clients: 5 or more OPC Servers. As frequently as possible, and on any official build whether it is alpha, beta, or release etc. 5

6 NP4 Resource-Efficiency Testing Windows Performance Monitor (1 of 6) Configure the Windows Performance monitor to record the performance counters for 36 hour duration Click Start, click in the Search box, type perfmon.msc, and then press ENTER. Perfmon.msc 6

7 Windows Performance Monitor (2 of 6) Create a Data Collector Set to store the data values recorded for the 36 hour test. Specify the directory you want to store the file Create a new Data collector set to record the data Click finish to create the Data collector set 7

8 Windows Performance Monitor (4 of 6) Configure the Process, Processor, Threads, Handles, and other counters for the instances of your product: Step 1: Double click Performance Counter to select the counters Step 4: Choose the performance counters from the list Step 2: Click Add to specify the resources to monitor Step 5: Select the log format. Test lab uses comma separated format to record the values for the counters selected. Step 3: Pick the Client/Server Process (must be running to appear in the this list) 8

9 Windows Performance Monitor (5 of 6) Setup a 36 hour stop condition in the Data Collector Set properties to stop recording: Setup the duration to 36 hours Click OK to apply the changes 9

10 Windows Performance Monitor (6 of 6) Setup the stop condition in the Data Collector Set properties to stop recording the data values after 36 hours. Click the Triangle icon to start monitoring Measurements can be displayed in a chart, as well as being logged to a file (as previously configured). 10

11 NP5 Resource-Efficiency Testing Test Plan Model Server (1 of 2) An OPC Server is configured with 2 devices (PLCs) Typically, 5 Clients are connected, with approx items each Make 1 Device and 1 Client go online/offline every 2 minutes Remote PC1 Classic/UA Client Remote PC2 Classic/UA Client Remote PC3 Classic/UA Client Remote PC4 Classic/UA Client Remote PC5 Classic/UA Client UA/Classic Server Local Client (if available) Device 1 (e.g. PLC) Device 2 (e.g. PLC) 11

12 NP5 Resource-Efficiency Testing Test Plan Model Server (1 of 2) An OPC Client is connected to 5 or more OPC Servers, each approx items Make 1 Server go online/offline every 2 minutes Remote PC1 Classic/UA Server Remote PC2 Classic/UA Server Remote PC3 Classic/UA Server Remote PC4 Classic/UA Server Remote PC5 Classic/UA Server UA/Classic Client Local Server (if available) 12

13 NP6 Resource-Efficiency Testing Batch File To toggle the enabled state of the Local Area Connection network adapter in a windows environment use the below batch file. Replicate the following text into file NIC.BAT and run it using Administrator/elevated off SET DTIME=120 CLS ECHO Delay time is: %DTIME% ECHO Network Connection Enabler/Disabler started at: %date% %time% :start ECHO Disabling network adapter at %time% netsh interface set interface "Local Area Connection" DISABLED timeout /t %DTIME% ECHO Enabling network adapter at %date% %time% netsh interface set interface "Local Area Connection" ENABLED choice /c:yn /m "Repeat network adapter recycle (y/n)?" /t %DTIME% /d y ECHO %ERRORLEVEL% IF ERRORLEVEL 2 GOTO end IF ERRORLEVEL 1 GOTO start :end ECHO. ECHO Network adapter recycle complete at %date% %time% 13

14 NP7 Resource-Efficiency Testing Reports In Certification testing, the Test Lab will generate a resource Data report that is generated from the data collected by the Windows Performance Monitor: 14

15 Next Steps If no growth is detected in your Classic/UA product then you are ready for Lab Certification: Request Certification in the Test Lab: 15

16 The End! Certification: Lab Testing: Bug Tracker: Contact: