Page 1 of 1

Yet another update to the popularity score algorithm

Posted: Mon Dec 19, 2011 8:14 pm
by Andrew Lee
The last update to the popularity scoring algorithm solicited a lot of comments. After working with Lupo73, here's another attempt at the algorithm (version 3).

To recall, V1 of the algorithm accumulates the activity and votes over the entire lifespan of each entry. Some of you complained that it was too static.

V2 of the algorithm accumulates the activity and votes of each entry over the past 30 days. Some of you complained that it was too dynamic and random

V3 of the algorithm computes the popularity score based on two components: activity over the past 30 days, and votes over the entire lifespan of each entry.

Activity is defined as clicks to the "website" and "download" links. "download" clicks are weighted 3 times more than "website" links. Recent clicks are weighted more than aged clicks using an exponential window.

Votes are weighted based on the ranks of the user. The final score is computed using the Wilson Popularity Formula.

The two components are combined together using a 25% (activity) / 75% (votes) ratio to form a final figure that is between 0 to 100. The idea is that votes are more important that activity for the final score, but to compare between apps with few votes, the activity will give an indication of its popularity.

The TPFC website has been updated with the new scoring algorithm. The five-star image on the right of each entry gives a graphical overview of its popularity. Mousing over the image will give you the actual score (rounded to 1-decimal place).

We hope this new formula will bring a better balance for the popularity score. I am sure we can work together to refine it even further. Meanwhile, have fun!

PS: Many thanks to Lupo73 for his fantastic work on this update.

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 5:17 am
by joby_toss
Looks really good!

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 11:36 am
by guinness
On a side note the overall database interface is more 'clean' or is it just my eyes and Opera?

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 1:02 pm
by freakazoid
Cool! :)

A minor aesthetic thing, but I'd like to see a better star graphic than the puke-green colored star that's currently in use.

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 2:58 pm
by dany
puke-green? I'm guessing it's already changed because it's a plain yellow on my side...
Like the update though, should work great!

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 3:29 pm
by webfork
dany wrote:puke-green? I'm guessing it's already changed because it's a plain yellow on my side...
Like the update though, should work great!
It depends on your monitor. Sometimes grey-yellow colors can look greenish. Assuming there are color options within whatever code your'e using for this, I would go with a subdued grey. Additionally, I think its important we somehow let people know this isn't like Softpedia's rating system: e.g. 1/2 star doesn't reflect on the program's quality. One possible way to demonstrate this is just put "popularity" next to the stars.

Here's how those two elements might look together (made using PhotoFiltre):


Image

Re: Yet another update to the popularity score algorithm

Posted: Tue Dec 20, 2011 3:53 pm
by guinness
I just realised that's a 'tick box image' next to the number of members who have voted for the application. It wasn't very clear in the browser (Opera) so for me it looked like an HTML parsing error of some description, but in the image it's more clear.

Re: Yet another update to the popularity score algorithm

Posted: Wed Dec 21, 2011 12:53 pm
by Andrew Lee
On a side note the overall database interface is more 'clean' or is it just my eyes and Opera?
I have rearranged the various data fields so that there is less tendency to wraparound on smaller screens. Could that be it?
Additionally, I think its important we somehow let people know this isn't like Softpedia's rating system: e.g. 1/2 star doesn't reflect on the program's quality. One possible way to demonstrate this is just put "popularity" next to the stars.
I have changed the tooltip to read (Popularity: XXX/100). Also, putting the stars close to the rating links should make it clear they are correlated with user ratings.
I just realised that's a 'tick box image' next to the number of members who have voted for the application.
Yup, that's actually a Unicode wingding (&#9745). But I just changed that to a "heart" (&#9829) 'cos I thought that more closely relates how we feel about the app. :mrgreen: If you mouse over the link, it should say "xxx member points".

Re: Yet another update to the popularity score algorithm

Posted: Wed Dec 21, 2011 2:54 pm
by guinness
OK, thanks Andrew for the changes.

Re: Yet another update to the popularity score algorithm

Posted: Thu Dec 22, 2011 6:31 am
by Lupo73
Good update :wink: ..I'm considering to write an article about the new algorithm used, to allow other websites to test and use it.. anyway I'll wait few weeks to test it here and verify its quality..