Document: 2013 Consumer Security Products Performance Benchmarks (Edition 4) Authors: M. Baquiran, D. Wren Company: PassMark Software Date: 26 April

Transcription

1 Document: 2013 Consumer Security Products Performance Benchmarks () Authors: M. Baquiran, D. Wren Company: PassMark Software Date: Edition: 4 File: totalprotectionsuites-may2013.docx

2 TABLE OF CONTENTS... 2 REVISION HISTORY... 4 REFERENCES... 4 EXECUTIVE SUMMARY... 5 OVERALL SCORE... 6 PRODUCTS AND VERSIONS... 9 INTERNET SECURITY SOFTWARE... 9 ANTIVIRUS SOFTWARE TOTAL SECURITY SOFTWARE PERFORMANCE METRICS SUMMARY INTERNET SECURITY SOFTWARE (HDD) TEST RESULTS BENCHMARK 1 BOOT TIME BENCHMARK 2 SCAN TIME BENCHMARK 3 USER INTERFACE LAUNCH TIME BENCHMARK 4 MEMORY USAGE DURING SYSTEM IDLE BENCHMARK 5 BROWSE TIME BENCHMARK 6 INTERNET EXPLORER LAUNCH TIME BENCHMARK 7 INSTALLATION TIME BENCHMARK 8 INSTALLATION SIZE BENCHMARK 9 REGISTRY KEYS ADDED BENCHMARK 10 FILE COPY, MOVE AND DELETE BENCHMARK 11 INSTALLATION OF THIRD PARTY APPLICATIONS BENCHMARK 12 NETWORK THROUGHPUT BENCHMARK 13 FILE FORMAT CONVERSION BENCHMARK 14 FILE COMPRESSION AND DECOMPRESSION BENCHMARK 15 FILE WRITE, OPEN AND CLOSE BENCHMARK 16 PE SCAN TIME BENCHMARK 17 FILE COPY DISK TO DISK ANTIVIRUS SOFTWARE (HDD) TEST RESULTS BENCHMARK 1 BOOT TIME BENCHMARK 2 SCAN TIME BENCHMARK 3 USER INTERFACE LAUNCH TIME BENCHMARK 4 MEMORY USAGE DURING SYSTEM IDLE BENCHMARK 5 BROWSE TIME BENCHMARK 6 INTERNET EXPLORER LAUNCH TIME BENCHMARK 7 INSTALLATION TIME BENCHMARK 8 INSTALLATION SIZE BENCHMARK 9 REGISTRY KEYS ADDED BENCHMARK 10 FILE COPY, MOVE AND DELETE BENCHMARK 11 INSTALLATION OF THIRD PARTY APPLICATIONS Performance Benchmark Page 2 of 70

3 BENCHMARK 12 NETWORK THROUGHPUT BENCHMARK 13 FILE FORMAT CONVERSION BENCHMARK 14 FILE COMPRESSION AND DECOMPRESSION BENCHMARK 15 FILE WRITE, OPEN AND CLOSE BENCHMARK 16 PE SCAN TIME BENCHMARK 17 FILE COPY DISK TO DISK TOTAL SECURITY SOFTWARE (HDD) TEST RESULTS BENCHMARK 1 BOOT TIME BENCHMARK 2 SCAN TIME BENCHMARK 3 USER INTERFACE LAUNCH TIME BENCHMARK 4 MEMORY USAGE DURING SYSTEM IDLE BENCHMARK 5 BROWSE TIME BENCHMARK 6 INTERNET EXPLORER LAUNCH TIME BENCHMARK 7 INSTALLATION TIME BENCHMARK 8 INSTALLATION SIZE BENCHMARK 9 REGISTRY KEYS ADDED BENCHMARK 10 FILE COPY, MOVE AND DELETE BENCHMARK 11 INSTALLATION OF THIRD PARTY APPLICATIONS BENCHMARK 12 NETWORK THROUGHPUT BENCHMARK 13 FILE FORMAT CONVERSION BENCHMARK 14 FILE COMPRESSION AND DECOMPRESSION BENCHMARK 15 FILE WRITE, OPEN AND CLOSE BENCHMARK 16 PE SCAN TIME BENCHMARK 17 FILE COPY DISK TO DISK INTERNET SECURITY SOFTWARE (SSD) TEST RESULTS BENCHMARK 1 BOOT TIME BENCHMARK 2 SCAN TIME BENCHMARK 10 FILE COPY, MOVE AND DELETE BENCHMARK 17 FILE COPY DISK TO DISK DISCLAIMER AND DISCLOSURE CONTACT DETAILS APPENDIX 1 TEST ENVIRONMENT APPENDIX 2 METHODOLOGY DESCRIPTION Performance Benchmark Page 3 of 70

4 Rev Revision History Date Edition 1 Initial version of this report. 31 August 2012 Edition 2 Added newly tested products. 2 November 2012 Edition 3 Added newly tested products. 15 January 2013 Added newly tested products. 24 April 2013 Ref # Document Author Date 1 What Really Slows Windows Down (URL) O. Warner, The PC Spy Performance Benchmark Page 4 of 70

5 PassMark Software conducted objective performance testing on fourteen (14) Internet Security software products, sixteen (16) Antivirus software products, and five (5) Total Security software products on Windows 7 Ultimate Edition (64-bit) SP1 between July 2012 and February This report presents our results and findings as a result of performance benchmark testing conducted for these consumer security products. Subsequent editions of this report will include new products released for 2013 as they are made available. For more details on which versions were tested, please see the section Products and Versions. Note that throughout this report, categories marked with (HDD) and (SSD) were tested with a Hard Disk Drive and a Solid State Drive used as the main boot drive respectively. Testing was performed on all products using seventeen (17) performance metrics. These performance metrics are as follows: Boot Time; Scan Time; User Interface Launch Time; Memory Usage during System Idle; Browse Time; Internet Explorer Launch Time; Installation Time; Installation Size; Registry Keys Added; File Copy, Move and Delete; Installation of Third Party Applications; Network Throughput (previously named Binary Download Test ) File Format Conversion; File Compression and Decompression; File Write, Open and Close; PE Scan Time and; and File Copy Disk to Disk. Testing in the SSD configuration was performed on five (5) Internet Security products using four (4) of the above metrics. These performance metrics are as follows: Boot Time; Scan Time; File Copy, Move and Delete; and File Copy Disk to Disk. Performance Benchmark Page 5 of 70

6 PassMark Software assigned every product a score depending on its ranking in each metric compared to other products in the same category. In the following table the highest possible score attainable is 238; in a hypothetical situation where a product has attained first place all 17 metrics. Internet Security products have been ranked by their overall scores: Product Name Overall Score Webroot SecureAnywhere Internet Security Norton Internet Security Kaspersky Internet Security SourceNext Virus Security 157 AVG Internet Security Trend Micro Titanium Internet Security Trend Micro Virus Buster ESET Smart Security Avast! Internet Security G Data InternetSecurity F-Secure Internet Security Panda Internet Security BitDefender Internet Security McAfee Internet Security Performance Benchmark Page 6 of 70

7 In the following table the highest possible score attainable is 272; in a hypothetical situation where a product has attained first place in all 17 metrics. Antivirus products have been ranked by their overall scores: Product Name Overall Score Webroot SecureAnywhere AntiVirus Kaspersky Anti-Virus Norton AntiVirus AVG Anti-Virus Free Microsoft Security Essentials 155 avast! Pro Antivirus AVG Anti-Virus Panda Antivirus Pro Panda Cloud Antivirus FREE 141 Quick Heal Pro Antivirus Avira Antivirus Free G Data AntiVirus Trend Micro Titanium ESET NOD32 Antivirus Avast! Free Antivirus McAfee Antivirus Plus Performance Benchmark Page 7 of 70

8 In the following table the highest possible score attainable is 85; in a hypothetical situation where a product has attained first place in all 17 metrics. Total Security products have been ranked by their overall scores: Product Name Overall Score Norton Kaspersky PURE Trend Micro Maximum Security Bitdefender Total Security McAfee Total Protection In the following table the highest possible score attainable is 20; in a hypothetical situation where a product has attained first place in all 5 (SSD) metrics. Internet Security products have been ranked by their overall scores: Product Name Overall Score Norton Internet Security Bitdefender Internet Security Trend Micro Internet Security Kaspersky Internet Security McAfee Internet Security Performance Benchmark Page 8 of 70

9 Unless otherwise specified, we have tested the full, retail release of the newest generation (2013 versions) of security products. The names and versions of products which were tested can be found below from each category table: Manufacturer Product Name Release Year Product Version Date Tested Symantec Corporation Norton Internet Security Dec 2012 G Data Software AG G Data InternetSecurity Jul 2012 Avast Software a.s. Avast! Internet Security Aug 2012 SOFTWIN Bitdefender Internet Security Aug 2012 Kaspersky Lab Kaspersky Internet Security Aug 2012 Panda Security SL Panda Internet Security Sep 2012 McAfee, Inc. McAfee Internet Security Sep 2012 AVG Technologies AVG Internet Security Sep 2012 Trend Micro Inc. Webroot Inc. Trend Micro Titanium Internet Security 2013 Webroot SecureAnywhere Internet Security Oct Oct 2012 F-Secure Corporation F-Secure Internet Security Build 102 Dec 2012 ESET, spol. s r.o. ESET Smart Security Feb 2013 Trend Micro Inc. Trend Micro Virus Buster Cloud Feb 2013 SourceNext SourceNext Virus Security Zero Feb 2013 Performance Benchmark Page 9 of 70

10 Manufacturer Product Name Release Year Product Version Date Tested Symantec Corporation Norton AntiVirus Dec 2012 G Data Software AG G Data Antivirus Aug 2012 Avast Software a.s. avast! Pro Antivirus Aug 2012 Microsoft Corporation Microsoft Security Essentials Aug 2012 Kaspersky Lab Kaspersky Anti-Virus Aug 2012 McAfee, Inc. McAfee Antivirus Plus Oct 2012 AVG Anti-Virus Oct 2012 Panda Security SL Panda Antivirus Pro Oct 2012 Trend Micro Inc. Trend Micro Titanium Oct 2012 Quick Heal Quick Heal Pro Antivirus Oct 2012 Avast Software a.s. avast! Free Antivirus Oct 2012 Panda Security SL Panda Clout Antivirus FREE Oct 2012 Avira Operations GmbH & Co. KG Avira Antivirus Free Nov 2012 Webroot Inc. Webroot SecureAnywhere AntiVirus Oct 2012 ESET, spol. s r.o. ESET NOD32 Antivirus Feb 2013 AVG Technologies AVG Free Nov 2012 Manufacturer Product Name Release Year Product Version Date Tested Symantec Corporation Norton Dec 2012 Trend Micro Inc. Trend Micro Maximum Security Oct 2012 Kaspersky Lab Kaspersky PURE Aug 2012 BitDefender BitDefender Total Security Aug 2012 McAfee, Inc McAfee Total Protection Dec 2012 Performance Benchmark Page 10 of 70

11 We have selected a set of objective metrics which provide a comprehensive and realistic indication of the areas in which an antivirus may impact system performance for end users. Our metrics test the impact of the antivirus software on common tasks that end-users would perform on a daily basis. All of PassMark Software s test methods can be replicated by third parties using the same environment to obtain similar benchmark results. Detailed descriptions of the methodologies used in our tests are available as Appendix 2 Methodology Description of this report. This metric measures the amount of time taken for the machine to boot into the operating system. Security software is generally launched at Windows startup, adding an additional amount of time and delaying the startup of the operating system. Shorter boot times indicate that the application has had less impact on the normal operation of the machine. All antivirus solutions have functionality designed to detect viruses and various other forms of malware by scanning files on the system. This metric measured the amount of time required to scan a set of clean files. Our sample file set comprised a total file size of 982 MB and was made up of files that would typically be found on end-user machines, such as media files, system files and Microsoft Office documents. This metric provides an objective indication as to how responsive a security product appears to the user, by measuring the amount of time it takes for the user interface of the antivirus software to launch from Windows. To allow for caching effects by the operating system, both the initial launch time and the subsequent launch times were measured. Our final result is an average of these two measurements. This metric measures the amount of memory (RAM) used by the product while the machine and antivirus software are in an idle state. The total memory usage was calculated by identifying all antivirus software processes and the amount of memory used by each process. The amount of memory used while the machine is idle provides a good indication of the amount of system resources being consumed by the antivirus software on a permanent basis. Better performing products occupy less memory while the machine is idle. It is common behavior for security products to scan data for malware as it is downloaded from the internet or intranet. This behavior may negatively impact browsing speed as products scan web content for malware. This metric measures the time taken to browse a set of popular internet sites to consecutively load from a local server in a user s browser window. Performance Benchmark Page 11 of 70

12 This metric is one of many methods to objectively measure how much a security product impacts on the responsiveness of the system. This metric measures the amount of time it takes to launch the user interface of Internet Explorer 8. To allow for caching effects by the operating system, both the initial launch time and the subsequent launch times were measured. Our final result is an average of these two measurements. The speed and ease of the installation process will strongly influence the user s first impression of the antivirus software. This test measures the minimum installation time required by the antivirus software to be fully functional and ready for use by the end user. Lower installation times represent antivirus products which are quicker for a user to install. In offering new features and functionality to users, antivirus software products tend to increase in size with each new release. Although new technologies push the size limits of hard drives each year, the growing disk space requirements of common applications and the increasing popularity of large media files (such as movies, photos and music) ensure that a product's installation size will remain of interest to home users. This metric aims to measure a product s total installation size. This metric is defined as the total disk space consumed by all new files added during a product's installation. A large registry increases a machine s use of resources. This may negatively impact system performance, especially on much older machines. This test measures the amount of keys and values added to registry, after rebooting the test machines, following a successful product installation. Lower numbers mean that a product has added fewer keys during installation and had less impact on the registry. This metric measures the amount of time taken to move, copy and delete a sample set of files. The sample file set contains several types of file formats that a Windows user would encounter in daily use. These formats include documents (e.g. Microsoft Office documents, Adobe PDF, Zip files, etc), media formats (e.g. images, movies and music) and system files (e.g. executables, libraries, etc). This metric measures the amount of time taken to install and uninstall third party programs. The installation speed of third party applications may be impacted by antivirus behavior such as heuristics or real time malware scanning. The metric measures the amount of time taken to download a variety of files from a local server using the HyperText Transfer Protocol (HTTP), which is the main protocol used on the web for browsing, linking and data transfer. Files used in this test include file formats that users would typically download from the web, such as images, archives, music files and movie files. Performance Benchmark Page 12 of 70

13 This test measures the amount of time taken to convert an MP3 file to a WAV and subsequently, convert the same MP3 file to a WMA format. This metric measures the amount of time taken to compress and decompress different types of files. Files formats used in this test included documents, movies and images. This benchmark was derived from Oli Warner s File I/O test at (please see Reference #1: What Really Slows Windows Down). This metric measures the amount of time taken to write a file, then open and close that file. All antivirus solutions have functionality designed to detect viruses and various other forms of malware by scanning files on the system. This metric measured the amount of time required to scan a set of PE (Portable Executable) files. Our sample file set comprised a total file size of 2.03GB and consisted of.exe (329MB),.dll (920MB) and.sys files (827MB). This test measures the amount of time taken to copy files between two local drives. The data set comprised a total file size of 5.44GB, and the formats used included documents, movies, images and executables. Performance Benchmark Page 13 of 70

14 In the following charts, we have highlighted the results we obtained for Norton Internet Security in yellow. The average has also been highlighted in blue for ease of comparison. The following chart compares the average time taken for the system to boot (from a sample of five boots) for each Internet Security product tested. Products with lower boot times are considered better performing products in this category. Trend Micro Internet Security Trend Micro Virus Buster Webroot Internet Security McAfee Internet Security Norton Internet Security ESET Smart Security Kaspersky Internet Security Avast! Internet Security Panda Internet Security SourceNext Virus Security 39.7 Bitdefender Internet Security G Data Internet Security F-Secure Internet Security AVG Internet Security s 5 s 10 s 15 s 20 s 25 s 30 s 35 s 40 s 45 s 50 s Performance Benchmark Page 14 of 70

15 The following chart compares the average time taken to scan a set of 6159 files (totaling 982 MB) for each Internet Security product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category. Norton Internet Security Webroot Internet Security G Data Internet Security Kaspersky Internet Security McAfee Internet Security Bitdefender Internet Security Trend Micro Internet Security Trend Micro Virus Buster ESET Smart Security AVG Internet Security SourceNext Virus Security 58.0 Avast! IS Panda Internet Security F-Secure Internet Security s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s 90 s Performance Benchmark Page 15 of 70

16 The following chart compares the average time taken to launch a product s user interface. Products with lower launch times are considered better performing products in this category. SourceNext Virus Security 120 Webroot Internet Security Norton Internet Security AVG Internet Security Trend Micro Internet Security Avast! Internet Security Trend Micro Virus Buster F-Secure Internet Security G Data Internet Security ESET Smart Security Bitdefender Internet Security McAfee Internet Security Kaspersky Internet Security Panda Internet Security ms 500 ms 1,000 ms 1,500 ms 2,000 ms 2,500 ms 3,000 ms Performance Benchmark Page 16 of 70

17 The following chart compares the average amount of RAM in use by an Internet Security product during a period of system idle. This average is taken from a sample of ten memory snapshots taken at roughly 60 seconds apart after reboot. Products with lower idle RAM usage are considered better performing products in this category. Webroot Internet Security Panda Internet Security Norton Internet Security Avast! Internet Security Bitdefender Internet Security SourceNext Virus Security 39.6 Kaspersky Internet Security Trend Micro Internet Security G Data Internet Security F-Secure Internet Security Trend Micro Virus Buster AVG Internet Security McAfee Internet Security ESET Smart Security MB 20 MB 40 MB 60 MB 80 MB 100 MB 120 MB 140 MB Performance Benchmark Page 17 of 70

18 The following chart compares the average time taken for Internet Explorer to successively load a set of popular websites through the local area network from a local server machine. Products with lower browse times are considered better performing products in this category. Webroot Internet Security SourceNext Virus Security 41.2 Kaspersky Internet Security Trend Micro Internet Security ESET Smart Security Norton Internet Security Avast! Internet Security Panda Internet Security Trend Micro Virus Buster G Data Internet Security F-Secure Internet Security AVG Internet Security McAfee Internet Security Bitdefender Internet Security s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s Performance Benchmark Page 18 of 70

19 The following chart compares the average launch times of Internet Explorer after rebooting the machine for each Internet Security product we tested. Products with lower launch times are considered better performing products in this category. SourceNext Virus Security 994 AVG Internet Security G Data Internet Security Kaspersky Internet Security ESET Smart Security F-Secure Internet Security Norton Internet Security Webroot Internet Security McAfee Internet Security Bitdefender Internet Security Trend Micro Virus Buster Avast! Internet Security Panda Internet Security Trend Micro Internet Security ms 500 ms 1,000 ms 1,500 ms 2,000 ms 2,500 ms 3,000 ms 3,500 ms 4,000 ms 4,500 ms Performance Benchmark Page 19 of 70

20 The following chart compares the minimum installation time it takes for Internet Security products to be fully functional and ready for use by the end user. Products with lower installation times are considered better performing products in this category. Webroot Internet Security Norton Internet Security SourceNext Virus Security 66.4 Trend Micro Internet Security Kaspersky Internet Security F-Secure Internet Security Trend Micro Virus Buster AVG Internet Security G Data Internet Security ESET Smart Security Bitdefender Internet Security Panda Internet Security Avast! Internet Security McAfee Internet Security s 100 s 200 s 300 s 400 s 500 s 600 s 700 s 800 s Performance Benchmark Page 20 of 70

21 The following chart compares the total size of files added during the installation of Internet Security products. Products with lower installation sizes are considered better performing products in this category. Webroot Internet Security F-Secure Internet Security Panda Internet Security McAfee Internet Security ESET Smart Security Kaspersky Internet Security SourceNext Virus Security AVG Internet Security Trend Micro Internet Security Norton Internet Security Trend Micro Virus Buster G Data Internet Security Avast! Internet Security Bitdefender Internet Security MB 200 MB 400 MB 600 MB 800 MB 1,000 MB 1,200 MB Performance Benchmark Page 21 of 70

22 The following chart compares the amount of Registry Keys created during product installation for each Internet Security product tested. Products with lower key counts are considered better performing products in this category. Webroot Internet Security SourceNext Virus Security 3600 F-Secure Internet Security Trend Micro Internet Security Norton Internet Security Trend Micro Virus Buster Avast! Internet Security AVG Internet Security ESET Smart Security Bitdefender Internet Security Kaspersky Internet Security Panda Internet Security G Data Internet Security McAfee Internet Security Performance Benchmark Page 22 of 70

23 The following chart compares the average time taken to copy, move and delete several sets of sample files for each Internet Security product tested. Products with lower times are considered better performing products in this category. Webroot Internet Security Kaspersky Internet Security Norton Internet Security SourceNext Virus Security 26.0 Avast! Internet Security G Data Internet Security AVG Internet Security Panda Internet Security Bitdefender Internet Security Trend Micro Virus Buster ESET Smart Security Trend Micro Internet Security F-Secure Internet Security McAfee Internet Security s 10 s 20 s 30 s 40 s 50 s 60 s Performance Benchmark Page 23 of 70

24 The following chart compares the average time taken to install 3 different third party applications for each Internet Security product tested. Products with lower times are considered better performing products in this category. Trend Micro Virus Buster SourceNext Virus Security 97.0 Webroot Internet Security Panda Internet Security AVG Internet Security ESET Smart Security Kaspersky Internet Security Norton Internet Security Avast! Internet Security F-Secure Internet Security Trend Micro Internet Security McAfee Internet Security G Data Internet Security Bitdefender Internet Security s 20 s 40 s 60 s 80 s 100 s 120 s 140 s 160 s Performance Benchmark Page 24 of 70

25 The following chart compares the average time to download a sample set of common file types for each Internet Security product tested. Products with lower times are considered better performing products in this category. SourceNext Virus Security 10.3 Webroot Internet Security Trend Micro Virus Buster Trend Micro Internet Security Kaspersky Internet Security Avast! Internet Security Norton Internet Security AVG Internet Security Bitdefender Internet Security McAfee Internet Security ESET Smart Security F-Secure Internet Security G Data Internet Security Panda Internet Security s 50 s 100 s 150 s 200 s 250 s Performance Benchmark Page 25 of 70

26 The following chart compares the average time it takes for five sample files to be converted from one file format to another (MP3 WMA, MP3 WAV) for each Internet Security product tested. Products with lower times are considered better performing products in this category. AVG Internet Security SourceNext Virus Security 75.9 ESET Smart Security Webroot Internet Security Kaspersky Internet Security Bitdefender Internet Security Norton Internet Security McAfee Internet Security G Data Internet Security Panda Internet Security Trend Micro Internet Security F-Secure Internet Security Trend Micro Virus Buster Avast! Internet Security s 75 s 75 s 76 s 76 s 77 s 77 s 78 s 78 s 79 s Performance Benchmark Page 26 of 70

27 The following chart compares the average time it takes for sample files to be compressed and decompressed for each Internet Security product tested. Products with lower times are considered better performing products in this category. AVG Internet Security Webroot Internet Security Norton Internet Security Kaspersky Internet Security Panda Internet Security Bitdefender Internet Security Avast! Internet Security SourceNext Virus Security 85.8 F-Secure Internet Security G Data Internet Security ESET Smart Security McAfee Internet Security Trend Micro Virus Buster Trend Micro Internet Security s 20 s 40 s 60 s 80 s 100 s 120 s Performance Benchmark Page 27 of 70

28 The following chart compares the average time it takes for a file to be written to the hard drive then opened and closed 180,000 times, for each Internet Security product tested. Products with lower times are considered better performing products in this category. Webroot Internet Security AVG Internet Security Kaspersky Internet Security Panda Internet Security Norton Internet Security Avast! Internet Security Trend Micro Virus Buster Trend Micro Internet Security McAfee Internet Security F-Secure Internet Security ESET Smart Security G Data Internet Security Bitdefender Internet Security SourceNext Virus Security s 200 s 400 s 600 s 800 s 1,000 s 1,200 s Performance Benchmark Page 28 of 70

29 The following chart compares the average time taken to scan a set of 6351 portable executable files (totaling 2076 MB) for each Internet Security product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category. Kaspersky Internet Security G Data Internet Security Webroot Internet Security AVG Internet Security McAfee Internet Security Trend Micro Virus Buster Norton Internet Security Bitdefender Internet Security ESET Smart Security Avast! Internet Security SourceNext Virus Security F-Secure Internet Security Panda Internet Security Trend Micro Internet Security s 50 s 100 s 150 s 200 s 250 s Performance Benchmark Page 29 of 70

30 The following chart compares the average time taken to copy a total of 8,501 files, with a total file size of 5.44GB files, from one local drive to another local drive for each Internet Security product tested. The test was performed 5 times, and the average of all 5 runs was taken as the result. Products with lower times are considered better performing products in this category. Trend Micro Internet Security F-Secure Internet Security AVG Internet Security Webroot Internet Security Norton Internet Security Bitdefender Internet Security Kaspersky Internet Security G Data Internet Security Avast! Internet Security Trend Micro Virus Buster Panda Internet Security ESET Smart Security SourceNext Virus Security McAfee Internet Security s 50 s 100 s 150 s 200 s 250 s 300 s Performance Benchmark Page 30 of 70

31 In the following charts, we have highlighted the results we obtained for Norton AntiVirus in yellow. The average has also been highlighted in blue for ease of comparison. The following chart compares the average time taken for the system to boot (from a sample of five boots) for each Antivirus product tested. Products with lower boot times are considered better performing products in this category. Trend Micro Antivirus ESET Antivirus avast! Antivirus Webroot AntiVirus Norton AntiVirus McAfee AntiVirus Microsoft Security Essentials Avira Antivirus Free Kaspersky Anti-Virus Panda Cloud Antivirus FREE avast! Free Antivirus Panda Antivirus Quick Heal Antivirus AVG AntiVirus Free AVG Anti-Virus G Data AntiVirus s 10 s 20 s 30 s 40 s 50 s 60 s Performance Benchmark Page 31 of 70

32 The following chart compares the average time taken to scan a set of 6159 files (totaling 982 MB) for each Antivirus product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category. G Data AntiVirus Norton AntiVirus Webroot AntiVirus McAfee AntiVirus AVG AntiVirus Free Quick Heal Antivirus Microsoft Security Essentials Trend Micro Antivirus Kaspersky Anti-Virus Panda Antivirus AVG Anti-Virus Avira Antivirus Free avast! Antivirus avast! Free Antivirus ESET Antivirus Panda Cloud Antivirus FREE s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s 90 s Performance Benchmark Page 32 of 70

33 The following chart compares the average time taken to launch a product s user interface. Products with lower launch times are considered better performing products in this category. Microsoft Security Essentials ESET Antivirus 6 92 Webroot AntiVirus Norton AntiVirus AVG AntiVirus Free avast! Free Antivirus AVG Anti-Virus avast! Antivirus Quick Heal Antivirus Trend Micro Antivirus Panda Cloud Antivirus FREE McAfee AntiVirus Kaspersky Anti-Virus Avira Antivirus Free G Data AntiVirus Panda Antivirus ms 500 ms 1,000 ms 1,500 ms 2,000 ms 2,500 ms 3,000 ms 3,500 ms Performance Benchmark Page 33 of 70

34 The following chart compares the average amount of RAM in use by an Antivirus product during a period of system idle. This average is taken from a sample of ten memory snapshots taken at roughly 60 seconds apart after reboot. Products with lower idle RAM usage are considered better performing products in this category. Webroot AntiVirus avast! Free Antivirus avast! Antivirus Panda Cloud Antivirus FREE AVG AntiVirus Free Panda Antivirus G Data AntiVirus Avira Antivirus Free Norton AntiVirus Kaspersky Anti-Virus Trend Micro Antivirus Microsoft Security Essentials AVG Anti-Virus ESET Antivirus Quick Heal Antivirus McAfee AntiVirus MB 50 MB 100 MB 150 MB 200 MB 250 MB Performance Benchmark Page 34 of 70

35 The following chart compares the average time taken for Internet Explorer to successively load a set of popular websites through the local area network from a local server machine. Products with lower browse times are considered better performing products in this category. Webroot AntiVirus AVG AntiVirus Free Panda Antivirus McAfee AntiVirus Microsoft Security Essentials Kaspersky Anti-Virus ESET Antivirus Panda Cloud Antivirus FREE avast! Antivirus Norton AntiVirus avast! Free Antivirus G Data AntiVirus Trend Micro Antivirus AVG Anti-Virus Quick Heal Antivirus Avira Antivirus Free s 50 s 100 s 150 s 200 s 250 s Performance Benchmark Page 35 of 70

36 The following chart compares the average launch times of Internet Explorer after rebooting the machine for each Antivirus product we tested. Products with lower launch times are considered better performing products in this category. AVG Anti-Virus AVG AntiVirus Free ESET Antivirus Kaspersky Anti-Virus Panda Cloud Antivirus FREE Avira Antivirus Free Webroot AntiVirus Quick Heal Antivirus Panda Antivirus G Data AntiVirus avast! Antivirus Norton AntiVirus McAfee AntiVirus Microsoft Security Essentials avast! Free Antivirus Trend Micro Antivirus ms 500 ms 1,000 ms 1,500 ms 2,000 ms 2,500 ms 3,000 ms Performance Benchmark Page 36 of 70

37 The following chart compares the minimum installation time it takes for Antivirus products to be fully functional and ready for use by the end user. Products with lower installation times are considered better performing products in this category. Webroot AntiVirus Norton AntiVirus Panda Cloud Antivirus FREE avast! Antivirus Kaspersky Anti-Virus Panda Antivirus Trend Micro Antivirus Avira Antivirus Free AVG AntiVirus Free AVG Anti-Virus Microsoft Security Essentials G Data AntiVirus avast! Free Antivirus Quick Heal Antivirus ESET Antivirus McAfee AntiVirus s 100 s 200 s 300 s 400 s 500 s 600 s Performance Benchmark Page 37 of 70

38 The following chart compares the total size of files added during the installation of Antivirus products. Products with lower installation sizes are considered better performing products in this category. Webroot AntiVirus Microsoft Security Essentials Avira Antivirus Free McAfee AntiVirus ESET Antivirus Panda Antivirus Kaspersky Anti-Virus Panda Cloud Antivirus FREE AVG Anti-Virus avast! Antivirus AVG AntiVirus Free Norton AntiVirus avast! Free Antivirus Trend Micro Antivirus G Data AntiVirus Quick Heal Antivirus MB 200 MB 400 MB 600 MB 800 MB 1,000 MB 1,200 MB 1,400 MB 1,600 MB Performance Benchmark Page 38 of 70

39 The following chart compares the amount of Registry Keys created during product installation for each Antivirus product tested. Products with lower key counts are considered better performing products in this category. Webroot AntiVirus avast! Antivirus Quick Heal Antivirus ESET Antivirus Panda Cloud Antivirus FREE Trend Micro Antivirus avast! Free Antivirus AVG Anti-Virus Avira Antivirus Free AVG AntiVirus Free Norton AntiVirus Microsoft Security Essentials Panda Antivirus Kaspersky Anti-Virus G Data AntiVirus McAfee AntiVirus Performance Benchmark Page 39 of 70

40 The following chart compares the average time taken to copy, move and delete several sets of sample files for each Antivirus product tested. Products with lower times are considered better performing products in this category. Webroot AntiVirus Norton AntiVirus G Data AntiVirus Kaspersky Anti-Virus avast! Antivirus avast! Free Antivirus Quick Heal Antivirus AVG Anti-Virus Panda Antivirus AVG AntiVirus Free Panda Cloud Antivirus FREE Trend Micro Antivirus Microsoft Security Essentials McAfee AntiVirus Avira Antivirus Free ESET Antivirus s 5 s 10 s 15 s 20 s 25 s 30 s 35 s 40 s 45 s 50 s Performance Benchmark Page 40 of 70

41 The following chart compares the average time taken to install a third party application for each Antivirus product tested. Products with lower times are considered better performing products in this category. Panda Antivirus G Data AntiVirus Webroot AntiVirus Kaspersky Anti-Virus Avira Antivirus Free avast! Antivirus Microsoft Security Essentials AVG Anti-Virus AVG AntiVirus Free avast! Free Antivirus Norton AntiVirus Quick Heal Antivirus Panda Cloud Antivirus FREE McAfee AntiVirus ESET Antivirus Trend Micro Antivirus s 95 s 100 s 105 s 110 s 115 s 120 s 125 s Performance Benchmark Page 41 of 70

42 The following chart compares the average time to download a sample set of common file types for each Antivirus product tested. Products with lower times are considered better performing products in this category. Panda Cloud Antivirus FREE Microsoft Security Essentials Webroot AntiVirus Quick Heal Antivirus Panda Antivirus Kaspersky Anti-Virus Trend Micro Antivirus Norton AntiVirus avast! Antivirus Avira Antivirus Free AVG AntiVirus Free AVG Anti-Virus avast! Free Antivirus McAfee AntiVirus ESET Antivirus G Data AntiVirus s 20 s 40 s 60 s 80 s 100 s 120 s 140 s 160 s Performance Benchmark Page 42 of 70

43 The following chart compares the average time it takes for five sample files to be converted from one file format to another (MP3 WMA, MP3 WAV) for each Antivirus product tested. Products with lower times are considered better performing products in this category. Avira Antivirus Free Microsoft Security Essentials AVG Anti-Virus Webroot AntiVirus Quick Heal Antivirus Panda Cloud Antivirus FREE Kaspersky Anti-Virus Panda Antivirus Norton AntiVirus G Data AntiVirus ESET Antivirus Trend Micro Antivirus AVG AntiVirus Free avast! Antivirus McAfee AntiVirus avast! Free Antivirus s 75 s 75 s 76 s 76 s 77 s 77 s 78 s 78 s 79 s Performance Benchmark Page 43 of 70

44 The following chart compares the average time it takes for sample files to be compressed and decompressed for each Antivirus product tested. Products with lower times are considered better performing products in this category. G Data AntiVirus Webroot AntiVirus Norton AntiVirus Kaspersky Anti-Virus AVG Anti-Virus AVG AntiVirus Free Quick Heal Antivirus avast! Free Antivirus Panda Antivirus ESET Antivirus Panda Cloud Antivirus FREE Microsoft Security Essentials avast! Antivirus Avira Antivirus Free McAfee AntiVirus Trend Micro Antivirus s 20 s 40 s 60 s 80 s 100 s 120 s Performance Benchmark Page 44 of 70

45 The following chart compares the average time it takes for a file to be written to the hard drive then opened and closed 180,000 times, for each Antivirus product tested. Products with lower times are considered better performing products in this category. Webroot AntiVirus AVG Anti-Virus Kaspersky Anti-Virus AVG AntiVirus Free Quick Heal Antivirus Panda Antivirus avast! Free Antivirus Avira Antivirus Free Norton AntiVirus Panda Cloud Antivirus FREE avast! Antivirus McAfee AntiVirus Trend Micro Antivirus ESET Antivirus Microsoft Security Essentials G Data AntiVirus s 50 s 100 s 150 s 200 s 250 s 300 s 350 s 400 s 450 s Performance Benchmark Page 45 of 70

46 The following chart compares the average time taken to scan a set of 6351 portable executable files (totaling 2076 MB) for each Antivirus product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category Kaspersky Anti-Virus Quick Heal Antivirus McAfee AntiVirus G Data AntiVirus AVG AntiVirus Free Webroot AntiVirus Trend Micro Antivirus Norton AntiVirus Avira Antivirus Free Panda Cloud Antivirus FREE Microsoft Security Essentials avast! Antivirus ESET Antivirus avast! Free Antivirus AVG Anti-Virus Panda Antivirus s 50 s 100 s 150 s 200 s 250 s Performance Benchmark Page 46 of 70

47 The following chart compares the average time taken to copy a set of files from one local drive to another local drive for each Antivirus product tested. The test was performed 5 times, and the average of all 5 runs was taken as the result. Products with lower times are considered better performing products in this category. Microsoft Security Essentials G Data AntiVirus Trend Micro Antivirus Kaspersky Anti-Virus AVG Anti-Virus Webroot AntiVirus Norton AntiVirus Avira Antivirus Free avast! Free Antivirus AVG AntiVirus Free avast! Antivirus Panda Antivirus Quick Heal Antivirus ESET Antivirus McAfee AntiVirus Panda Cloud Antivirus FREE s 50 s 100 s 150 s 200 s 250 s Performance Benchmark Page 47 of 70

48 In the following charts, we have highlighted the results we obtained for Norton 360 in yellow. The average has also been highlighted in blue for ease of comparison. The following chart compares the average time taken for the system to boot (from a sample of five boots) for each Total Security product tested. Products with lower boot times are considered better performing products in this category. McAfee Total Protection Norton Trend Micro Maximum Security Kaspersky PURE 35.0 Bitdefender Total Security s 33 s 33 s 34 s 34 s 35 s 35 s 36 s 36 s 37 s The following chart compares the average time taken to scan a set of 6159 files (totaling 982 MB) for each Total Security product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category Norton Bitdefender Total Security Trend Micro Maximum Security McAfee Total Protection Kaspersky PURE 89 0 s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s 90 s 100 s Performance Benchmark Page 48 of 70

49 The following chart compares the average time taken to launch a product s user interface. Products with lower launch times are considered better performing products in this category. Norton McAfee Total Protection Trend Micro Maximum Security Bitdefender Total Security Kaspersky PURE ms 100 ms 200 ms 300 ms 400 ms 500 ms 600 ms 700 ms 800 ms 900 ms The following chart compares the average amount of RAM in use by a Total Security product during a period of system idle. This average is taken from a sample of ten memory snapshots taken at roughly 60 seconds apart after reboot. Products with lower idle RAM usage are considered better performing products in this category. Norton Kaspersky PURE 62.9 Trend Micro Maximum Security Bitdefender Total Security McAfee Total Protection MB 50 MB 100 MB 150 MB 200 MB 250 MB 300 MB Performance Benchmark Page 49 of 70

50 The following chart compares the average time taken for Internet Explorer to successively load a set of popular websites through the local area network from a local server machine. Products with lower browse times are considered better performing products in this category. Norton Kaspersky PURE 50.5 Trend Micro Maximum Security McAfee Total Protection Bitdefender Total Security s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s The following chart compares the average launch times of Internet Explorer after rebooting the machine for each Total Security product we tested. Products with lower launch times are considered better performing products in this category. McAfee Total Protection Norton Kaspersky PURE Bitdefender Total Security Trend Micro Maximum Security ms 500 ms 1,000 ms 1,500 ms 2,000 ms 2,500 ms 3,000 ms 3,500 ms Performance Benchmark Page 50 of 70

51 The following chart compares the minimum installation time it takes for Total Security products to be fully functional and ready for use by the end user. Products with lower installation times are considered better performing products in this category. Norton Kaspersky PURE 194 Trend Micro Maximum Security Bitdefender Total Security McAfee Total Protection s 100 s 200 s 300 s 400 s 500 s 600 s 700 s 800 s The following chart compares the total size of files added during the installation of Total Security products. Products with lower installation sizes are considered better performing products in this category. Kaspersky PURE McAfee Total Protection Norton Trend Micro Maximum Security Bitdefender Total Security MB 200 MB 400 MB 600 MB 800 MB 1,000 MB 1,200 MB 1,400 MB Performance Benchmark Page 51 of 70

52 The following chart compares the amount of Registry Keys created during product installation for each Total Security product tested. Products with lower key counts are considered better performing products in this category. Trend Micro Maximum Security Norton Bitdefender Total Security Kaspersky PURE McAfee Total Protection The following chart compares the average time taken to copy, move and delete several sets of sample files for each Total Security product tested. Products with lower times are considered better performing products in this category. Norton Bitdefender Total Security Kaspersky PURE 28.8 Trend Micro Maximum Security McAfee Total Protection s 10 s 20 s 30 s 40 s 50 s 60 s Performance Benchmark Page 52 of 70

53 The following chart compares the average time taken to install a third party application for each Total Security product tested. Products with lower times are considered better performing products in this category. Norton Bitdefender Total Security Kaspersky PURE Trend Micro Maximum Security McAfee Total Protection s 20 s 40 s 60 s 80 s 100 s 120 s 140 s The following chart compares the average time to download a sample set of common file types for each Total Security product tested. Products with lower times are considered better performing products in this category. Trend Micro Maximum Security Bitdefender Total Security Norton Kaspersky PURE 15.2 McAfee Total Protection s 5 s 10 s 15 s 20 s 25 s Performance Benchmark Page 53 of 70

54 The following chart compares the average time it takes for five sample files to be converted from one file format to another (MP3 WMA, MP3 WAV) for each Total Security product tested. Products with lower times are considered better performing products in this category. Bitdefender Total Security Kaspersky PURE McAfee Total Protection Norton Trend Micro Maximum Security s 10 s 20 s 30 s 40 s 50 s 60 s 70 s 80 s 90 s The following chart compares the average time it takes for sample files to be compressed and decompressed for each Total Security product tested. Products with lower times are considered better performing products in this category. Kaspersky PURE 80.5 Norton Bitdefender Total Security Trend Micro Maximum Security McAfee Total Protection s 20 s 40 s 60 s 80 s 100 s 120 s Performance Benchmark Page 54 of 70

55 The following chart compares the average time it takes for a file to be written to the hard drive then opened and closed 180,000 times, for each Total Security product tested. Products with lower times are considered better performing products in this category. Kaspersky PURE 25.1 Norton Trend Micro Maximum Security McAfee Total Protection Bitdefender Total Security s 100 s 200 s 300 s 400 s 500 s 600 s 700 s 800 s 900 s 1,000 s The following chart compares the average time taken to scan a set of 6351 portable executable files (totaling 2076 MB) for each Total Security product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category Kaspersky PURE 68 McAfee Total Protection Norton Trend Micro Maximum Security Bitdefender Total Security s 20 s 40 s 60 s 80 s 100 s 120 s Performance Benchmark Page 55 of 70

56 The following chart compares the average time taken to copy a set of files from one local drive to another local drive for each Total Security product tested. The test was performed 5 times, and the average of all 5 runs was taken as the result. Products with lower times are considered better performing products in this category. Trend Micro Maximum Security Kaspersky PURE 116 Bitdefender Total Security Norton McAfee Total Protection s 50 s 100 s 150 s 200 s 250 s 300 s Performance Benchmark Page 56 of 70

57 In the following charts, we have highlighted the results we obtained for Norton Internet Security 2013 in yellow. The average has also been highlighted in blue for ease of comparison. The following chart compares the average time taken for the system to boot (from a sample of five boots)for each Internet Security product tested. Products with lower boot times are considered better performing products in this category. Trend Micro Internet Security Norton Internet Security Kaspersky Internet Security BitDefender Internet Security McAfee Internet Security s 2 s 4 s 6 s 8 s 10 s 12 s The following chart compares the average time taken to scan a set of 6159 files (totaling 982 MB) for each Internet Security product tested. This time is calculated by averaging the initial (Run 1) and subsequent (Runs 2-5) scan times. Products with lower scan times are considered better performing products in this category Norton Internet Security BitDefender Internet Security McAfee Internet Security Trend Micro Internet Security Kaspersky Internet Security s 5 s 10 s 15 s 20 s 25 s 30 s 35 s 40 s 45 s Performance Benchmark Page 57 of 70