topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday March 28, 2024, 5:31 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: The False Positive and Improperly Rated Site Epidemic  (Read 44135 times)

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
The False Positive and Improperly Rated Site Epidemic
« on: September 23, 2011, 04:41 AM »
I have been a member of a malware working group at the IEEE of which almost ALL security vendors participate. I've therefore been in a position to create and propose this new Forum: http://falsepositivereport.com . This is only hours old, but one security vendor has agreed to take part. As the others wake, we'll see who will voluntarily take part in it. As long as Software Vendors take part, security vendors will eventually be forced to take part in order to respond.

OFFICIAL SITE:  http://falsepositivereport.com

I would like to congratulate Microsoft as the one company who takes the conservative approach, making their false positive rate the lowest in the industry. Kudos to them. All security companies should act that way! Causing collateral damage to innocent businesses/families is simply unacceptable. It will sometimes accidentally occur, but clearly not enough is being done to prevent this problem, as it has only gotten worse.

---------------------------------

Accountability. Transparency. Communication. Prevention.
Helping to prevent false positives and mis-rating of web sites, instead of merely retroactively addressing them

This is a new effort to help slow (and expose) the plague of false positives and mis-rated web sites that are destroying hundreds or thousands of small businesses every year. Some security companies do better than others, but never before has there been a place where false positives and mis-rated sites can be publicly reported. The security companies can then respond, fix the issue, then determine why it happened and work with the vendor to avoid it in the future. After all, once a false positive happens, the damage is already done. Some security companies will not even respond to reports of false positives and mis-rated sites, much less work to avoid them in the future. Other companies DO act much more responsibly.

This is NOT about crucifying security companies. They do have a terribly hard job. Still, many of them can and should do better. This site is about showing which companies are doing the best to avoid collateral damage. It is also intended to facilitate the mitigation of collateral damage when it occurs, and, through communication, help prevent collateral damage (FPs) from recurring. For instance, why did the FP or misrating occur? What can be done to avoid it in the future?

Ironically, malware authors are hardly affected by these aggressive tactics. After all, if these tactics really worked, why would there be so many malware infestations?

Also remember, public transparency and accountability will let consumers know which security companies care about the collateral damage they inflict. Is this not important in your purchasing decision? If not, it should be ;). By choosing carefully with whom you spend your money, YOU can force companies to start behaving ethically.

As always, the power is in the hands of the consumer. Choose carefully who you spend your money with and you can force these corporations to act ethically and responsibly.

At this site you can:

1. Report false positives and mis-rated sites in REAL TIME to a CENTRAL LOCATION. At this central location, companies will know where to find false positives and mis-rated sites, if they care to look.
2. You can then see which companies care to fix these issues, and how fast. You can also see which companies are interested in AVOIDING them in the future.
3. Communicate with security companies to fix these issues, and help avoid these problems from recurring.
4. Provide historical stories about damage inflicted to your innocent business and/or family.
5. Communicate with other software vendors with similar concerns and troubles.

http://falsepositivereport.com
« Last Edit: September 26, 2011, 08:54 PM by db90h »

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #1 on: September 23, 2011, 04:54 AM »
AMEN~!

I bought a few domain names a number of years ago because I wanted to try to draw attention to this problem, but never got around to it. (false-positive.com, scareware.net/org)

It's a tough job to detect real malware, but like you said:

Causing collateral damage to innocent businesses/families is simply unacceptable. It will sometimes accidentally occur, but clearly not enough is being done to prevent this problem, as it has only gotten worse.

I sort of see it like being hired to cut the grass in the park, but also mowing down the children. Y'know... Like who cares if a few patches of grass are red? :P

Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #2 on: September 23, 2011, 04:57 AM »
Thank you for your support ;).
« Last Edit: September 26, 2011, 08:53 PM by db90h »

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #3 on: September 23, 2011, 05:01 AM »
If you're an ASP member, post it there -- also -- post it in the JoS forums too.

There are more software forums like those (I've kind of stopped reading/visiting them as so many tech people there just seem to be looking for a fight) -- if anyone can remember some of those, post them as well -- it might help. I know a lot of people have been burned by false positives. Actually, thinking about it, if you've been around for long, it's almost impossible that you haven't... Just about everyone complains about it.
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #4 on: September 23, 2011, 05:12 AM »
Good idea! I'm not a member of the ASP anymore, I quit years ago and never joined back. However, since I author developer tools, I know a lot of vendors personally, so will start contacting them. Please do spread the word. It is important. We must make a stand. The major security companies will be waking up in a few hours and reading this, so let's show them how much interest there is ASAP.

My personal story of FPs and misratings you wouldn't believe.. and I do NOT compress my software or use any protector. That is why I got so fed up. I finally was able to fix problems only through my direct contacts, because so many of these companies simply don't respond to their false positive or mis-rating reporting systems. They just ignore you, its absurd. Some others DO respond well, but the damage is done, and they don't make an effort to PREVENT it from happening in the future.

Let's change the world! ;)

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #5 on: September 23, 2011, 05:39 AM »
Yeah... It can take MAJOR effort to get a false positive removed. I've done it before, but I also know other people that have major fights with the AV vendors trying to get their software delisted.

It's not just the damage, but the additional damage of also having to take out all that time and effort from real productivity and funnel it into what shouldn't be an issue in the first place.

FWIW - MS is pretty good, but they do have some false positives as well... Even with their own partners... :( But that's typical MS - the left hand doesn't know what the right hand is doing.
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #6 on: September 23, 2011, 06:38 AM »
I did not make it clear.. if you want your comments to be seen by people who MATTER, then please post them at the thread I linked above. They will be waking soon, and visiting that thread. If it is just me, I look like a crazy person. If there is some user support, they realize users are fed up.

I have a real fear now that users, in general, don't care (not you guys, but others.. the average user).

tomos

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 11,959
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #7 on: September 23, 2011, 06:56 AM »
I did not make it clear.. if you want your comments to be seen by people who MATTER, then please post them at the thread I linked above. They will be waking soon, and visiting that thread. If it is just me, I look like a crazy person. If there is some user support, they realize users are fed up.

I have a real fear now that users, in general, don't care (not you guys, but others.. the average user).

I'm not fully clear - you want false positives posted there.
Do you want "dissatisfaction with the way thing are in general" posted there as well?
Tom

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #8 on: September 23, 2011, 07:05 AM »
Sorry for the confusion ... Just in the Sticky Topic, to get the ball rolling... I just want them to understand that USERS CARE ... that helps to then get the ball rolling on the whole project. If they realize their CUSTOMERS care, then they care 10x more. Sorry

EDIT: A big part of this is USER TRANSPARENCY, so users know what is happening to small businesses, and which security vendors are causing the most harm (like donationcoder, though it isn't a traditional business, it is still a form of business).

I would not be surprised to suddenly find my web site rated RED/DANGEROUS and all my software false positive'd on .. as paranoid as that sounds. To challenge some of the corporations is, risky...

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #9 on: September 23, 2011, 07:15 AM »
What I meant was... if you have anything to say, now is your chance. Rarely do users get a chance to have their comments read by anyone who matters at these giant corps (sadly). I guess that was clear though. Oh well. I just get enthused, and hope for change. Apathy will kill us all.

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #10 on: September 23, 2011, 07:18 AM »
It's great to see you moving on this front db -- the software world needs something like this badly.

We've discussed on this forum the abysmal and almost-criminal behavior of antivirus companies when it comes to false positives.

And i've made my own proposal for what I think would help move things forward here -- namely a set of standards to live up to and a kind of award/certification that would give security companies a positive incentive to do better -- which i think they crucially lack right now.

If you can make some progress in this effort you'd be doing us all a great service.  Go for it!

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #11 on: September 23, 2011, 07:19 AM »
I will add that link to the forum post now, thanks mouser

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #12 on: September 23, 2011, 07:39 AM »
I just want to reiterate what I think is an essential point: Fixing the incentive structure for the security companies.

There is huge competition in the security/antivirus world to build the best and most popular scanner.  These companies have very skilled coders working day in and day out, 365 days a year to improve their software.

Why then is every company doing such a horrible job with false positives and how they present alert information to the user?

Laziness, yes -- but at its core I believe the reason is simply that their does not exist an meaningful incentive for them to do better.

When comparisons of antivirus software is written -- no review puts much emphasis or effort into discussing false positives or the way heuristic/false alerts are presented and explained to the user.

And users don't seem to be aware of how important this issue is when choosing an antivirus engine.

So to me, the absolutely key part of reforming/rehabilitating the antivirus software industry in this respect is by creating both positive and negative incentives around this issue -- a carrot and stick approach.

The stick is the traditional one -- bring attention to the bad actors and provide a site where people can learn to avoid them.  The fear of damage to their reputation will cause them to do better.

But this is also a case where a VERY attractive positive incentive can be created to encourage the good companies -- allowing them an opportunity to set themselves ahead of the pack.  By creating a kind of certification/award that people recognize as the gold standard in security software.

Such a thing, if it could come to be seen as having some weight behind it, would be welcomed by the good security software vendors as a way for them to set themselves apart from their competitors -- and a way for them to get attention for their efforts at doing things the right way.  It would be a way to reward the good guys and help build the reputations of the companies that are doing the right thing.  And such an effort -- if done right, would be welcomed by the better antivirus companies as a way to separate the serious companies from the unserious ones.

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #13 on: September 23, 2011, 08:10 AM »
I did not make it clear.. if you want your comments to be seen by people who MATTER, then please post them at the thread I linked above. They will be waking soon, and visiting that thread. If it is just me, I look like a crazy person. If there is some user support, they realize users are fed up.

I have a real fear now that users, in general, don't care (not you guys, but others.. the average user).

Side note: If you could turn the CAPTCHA level down a bit, it would be much easier to post. I had to try 3 times. :(
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

tomos

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 11,959
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #14 on: September 23, 2011, 08:29 AM »
I did not make it clear.. if you want your comments to be seen by people who MATTER, then please post them at the thread I linked above. They will be waking soon, and visiting that thread. If it is just me, I look like a crazy person. If there is some user support, they realize users are fed up.

I have a real fear now that users, in general, don't care (not you guys, but others.. the average user).

Side note: If you could turn the CAPTCHA level down a bit, it would be much easier to post. I had to try 3 times. :(

+1 (well twice here)
Tom

KynloStephen66515

  • Animated Giffer in Chief
  • Honorary Member
  • Joined in 2010
  • **
  • Posts: 3,741
    • View Profile
    • Donate to Member

Renegade

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,288
  • Tell me something you don't know...
    • View Profile
    • Renegade Minds
    • Donate to Member
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

KynloStephen66515

  • Animated Giffer in Chief
  • Honorary Member
  • Joined in 2010
  • **
  • Posts: 3,741
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #17 on: September 23, 2011, 09:17 AM »
Forgot about NOD32 tbh :P - The bigger we can get this list, the better!

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #18 on: September 23, 2011, 02:54 PM »
Remember, it is about showing how bad the problem is - reporting them AFTER they occur directly to the company is fine, but we must also PUBLICLY report them in a CENTRALIZED location. We must remove their vested interest in generating FPs to start with, by embarrassing them, and showing which companies care about determining WHY it happened, and avoiding it in the future...and which do not.

The forum must be moved to a dedicated site soon. I also don't know if I have the time to maintain it (nor if I can stand being angry all the time).
« Last Edit: September 23, 2011, 06:21 PM by db90h »

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #19 on: September 23, 2011, 03:16 PM »
@Renegade: CAPTCHA turned down, thanks for letting me know .. I had 'upped' it just the other day because I got sick of those 'SEO' (yea right) people ... ;o.

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,739
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #20 on: September 23, 2011, 04:03 PM »
It's great to see someone finally tackling this. I hope the effort is successful. It sounds like you have some connections that will help. I'll do what I can to spread the word, though my networks are not necessarily large.

I also wanted to mention that I still think mouser's idea of a test and badge system rewarding good (low false positive) software/software publishers has a lot of potential. I think a combination of shaming the bad and rewarding the good could be most effective. Hopefully this effort can develop toward that long-term. But you have a good place to start.

- Oshyan

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #21 on: September 23, 2011, 04:04 PM »
I also wanted to mention that I still think mouser's idea of a test and badge system rewarding good (low false positive) software/software publishers has a lot of potential. I think a combination of shaming the bad and rewarding the good could be most effective. Hopefully this effort can develop toward that long-term. But you have a good place to start.

I agree, and we should include that as well (already I linked to his post about it). One thing at a time though. FIRST, we must expose the problem, then we can work on solutions.

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,739
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #22 on: September 23, 2011, 04:11 PM »
Yes, I agree. That's why I said I hope this effort can develop toward that. This is a good way to start, getting people to post their experiences and getting pledges from devs/publishers for support of the idea.

- Oshyan

db90h

  • Coding Snacks Author
  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 481
  • Software Engineer
    • View Profile
    • Bitsum - Take control of your PC
    • Read more about this member.
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #23 on: September 23, 2011, 06:51 PM »
Thanks to all of you, and please forgive me when I repeat myself. I move at 1000 miles an hour, so sometimes it is accidental --- but other times it is purposeful. In this day and age, everyone skims, so it is important to repeat things in order to get the point across ;).

I am happy to say that this effort has some major supporters already and is spreading like wildfire! Thanks to those of you who have volunteered your time or other services. I may very well be taking you up on that, as I have a business to run. Not spending half my time dealing with FPs and site rating issues will sure make that job easier.

I am now trying to get security vendors to publicly commit. They are scared publicly to do so at this time, but as it grows, they will .. I believe ;). Some have expressed their private willingness to participate, which is a great first step!

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: The False Positive and Improperly Rated Site Epidemic
« Reply #24 on: September 24, 2011, 05:00 AM »
I sure hope this anti-FP action will go well.  :up:

However, already been told that the thread will move to another domain, I am not inclined to register at Bitsum's, in order to upload a post or two. I think more people than me may have had a similar thought.