Did you miss your activation email?

• October 19, 2019, 04:25 AM
• Proudly celebrating 13 years online.
• Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.

### Author Topic: How NOT to Sort by Average Rating  (Read 3006 times)

#### Deozaan

• Charter Member
• Joined in 2006
• Points: 1
• Posts: 8,835
##### How NOT to Sort by Average Rating
« on: April 16, 2014, 04:58 PM »
I came across an article today that explains some flaws in commonly used sorting methods, with examples of why they're wrong, and then proposes a nice solution for more accurately sorting the truly higher rated stuff on top.

PROBLEM: You are a web programmer. You have users. Your users rate stuff on your site. You want to put the highest-rated stuff at the top and lowest-rated at the bottom. You need some sort of "score" to sort by.

WRONG SOLUTION #1: Score = (Positive ratings) - (Negative ratings)

Why it is wrong: Suppose one item has 600 positive ratings and 400 negative ratings: 60% positive. Suppose item two has 5,500 positive ratings and 4,500 negative ratings: 55% positive. This algorithm puts item two (score = 1000, but only 55% positive) above item one (score = 200, and 60% positive). WRONG.

Sites that make this mistake: Urban Dictionary

WRONG SOLUTION #2: Score = Average rating = (Positive ratings) / (Total ratings)

Why it is wrong: Average rating works fine if you always have a ton of ratings, but suppose item 1 has 2 positive ratings and 0 negative ratings. Suppose item 2 has 100 positive ratings and 1 negative rating. This algorithm puts item two (tons of positive ratings) below item one (very few positive ratings). WRONG.

Sites that make this mistake: Amazon.com

The article goes on to propose a better method of sorting things by their rating. A method which has even been endorsed by Randall Munroe of xkcd fame, so you know it's good.

http://www.evanmiller.org/how-not-to-sort-by-average-rating.html
« Last Edit: November 12, 2017, 04:22 PM by Deozaan »

#### mouser

• First Author
• Joined in 2005
• Posts: 39,478
##### Re: How NOT to Sort by Average Rating
« Reply #1 on: April 16, 2014, 05:03 PM »