Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

Microsoft Security Essentials struggles in new antivirus tests

Zero-day detection mediocre, finds AV-Test.org

Article comments

Microsoft’s popular free antivirus program Security Essentials has put in a mediocre showing in the latest quarterly tests from German test outfit AV-Test.org, finishing second bottom out of 22 products.

In Q1 2011 Security Essentials 2.0 (MSE) performed well at the least demanding test, that of spotting malware drawn from the industry-agreed Wildlist selection, scoring 100 percent. It also put in a good performance against a large group of recent malware samples selected by AV-Test itself, with a creditable score of 97 percent detection.

However, the product’s performance deteriorated sharply when pitted against 107 recent zero-day malware web and email malware attacks, described by AV-Test as ‘real-world’ testing’, spotting only half. The product’s performance in ‘dynamic detection testing’ – noticing malware on or post-execution – was also modest at only 45 percent.

For context, the test average for real-world and dynamic testing was 84 percent and 62 percent respectively.

The top-scoring product in the tests was BitDefender’s Internet Security Suite 2011, with a maximum weighted score of 6.0 across all tests, ahead of BullGuard Internet Security 10, F-Secure Internet Security 2011, and Kaspersky Internet Security 2011, all on 5.5. MSE scored 2.5, ahead of only one product, CA Internet Security Suite 2011.

AV-Test also looked at the impact of antivirus software on the performance of the PC. By this measure, often rated as important for many consumer users, MSE did relatively well, scoring 162 (lower being better) against the average of 171. This test showed a surprising degree of performance difference between suites, with BitDefender against doing well with a score of 111 against BullGuard’s dismal 539.

Security Essentials was in the end awarded a ‘pass’ certification under the AV-Test assessment for making the grade in at least 11 of the 18 tests, putting it ahead of five products that failed altogether. In addition to CA’s suite, these were Norman Security Suite Pro 8.0, McAfee Total Protection 2011, PC Tools Internet Security 2011, and Comodo Internet Security Premium 5.0/5.3.

Do the zero-day tests matter in everyday conditions? Arguably, yes. A common attack method is to hit users with zero-day exploits and so the ability to spot this challenging category of malware is crucial. According to AV-Test’s quarterly results, MSE’s performance in this test has also deteriorated quarter-on-quarter, dropping from around 75 percent to Q1's 50 percent.

"Microsoft is offering a free of charge virus scanner: MSE. The product is missing effective email and web protection and also dynamic detection/protection technologies, so the product performs worse when compared with other free or paid AV/ISS offering," said Andreas Marx of AV-Test by email to Techworld.

"That's the big problem with this tool - the majority of the other products tested includes such protection features, so they are performing better in our tests. And we expect that they are performing better in the 'real world' as well, which is the focus of our tests."

An individual user’s exposure to a zero-day attack will depend on a number of factors, including the range of applications used and how assiduously a PC is patched.

As Marx noted, MSE is a free product – many of the rival suites charge upwards of £20 ($33) a year for a license. However, the dividing line isn't necessarily whether a product is free or not; several rival products offered in free versions did better than MSE. It is possible that free programs now need to include a wider range of detection features than they might have done in the past.

Version 2.0 of MSE was launched in December 2010 and anecdotal evidence suggests it has only enhanced the program’s huge popularity. By September 2010, the software was said by Microsoft to have been installed on 31 million PCs globally, including 1.7 million in the UK.

The most interesting message of these tests is that a product can drop in effectiveness quite quickly, before in all likelihood rising again as a new version appears that adds new security elements.



Share:

More from Techworld

More relevant IT news

Comments

perknh said: Hi Skiiter what about Panda Cloud AV Does MSE do better than Panda Cloud Free in your view

Bipolar said: I agree I have helped people with issues I had one MSE problem with a guy but he did not tell me that he was going to a lot of porn sites I spend 5 hours cleaning his computer and cleaned off all but one problem But I had a work round What ever he got turned of the MSE But to he honest its an OLD computer and it was not not possible to put much more in the way of security on the computer He now runs Linux and while he had a problem once and I had to real load he is doing betterBut you are right some of the more well know paid AV are not any better then the free ones in most cases They have a few things they have that the free ones do not have But if you are set up right you can work around that problem IS Banking in the internet

Skiiter said: Ill keep it simple I have my own PC repair shop People dont come in with computers infected with virusesthat are runningMSE They usually have Norton or MCaffee or AVG or Avast or Avira Usually Norton Those are my real world tests

Toamstorr said: definitely its not a software for teenage morons checking every suspicious e-mail attachment and spending whole days on porn sites



Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *