Yet another update to the popularity score algorithm

Changes, updates etc. related to this website will be posted here.
Post Reply
Message
Author
User avatar
Andrew Lee
Posts: 2229
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Yet another update to the popularity score algorithm

#1 Post by Andrew Lee » Mon Dec 19, 2011 8:14 pm

The last update to the popularity scoring algorithm solicited a lot of comments. After working with Lupo73, here's another attempt at the algorithm (version 3).

To recall, V1 of the algorithm accumulates the activity and votes over the entire lifespan of each entry. Some of you complained that it was too static.

V2 of the algorithm accumulates the activity and votes of each entry over the past 30 days. Some of you complained that it was too dynamic and random

V3 of the algorithm computes the popularity score based on two components: activity over the past 30 days, and votes over the entire lifespan of each entry.

Activity is defined as clicks to the "website" and "download" links. "download" clicks are weighted 3 times more than "website" links. Recent clicks are weighted more than aged clicks using an exponential window.

Votes are weighted based on the ranks of the user. The final score is computed using the Wilson Popularity Formula.

The two components are combined together using a 25% (activity) / 75% (votes) ratio to form a final figure that is between 0 to 100. The idea is that votes are more important that activity for the final score, but to compare between apps with few votes, the activity will give an indication of its popularity.

The TPFC website has been updated with the new scoring algorithm. The five-star image on the right of each entry gives a graphical overview of its popularity. Mousing over the image will give you the actual score (rounded to 1-decimal place).

We hope this new formula will bring a better balance for the popularity score. I am sure we can work together to refine it even further. Meanwhile, have fun!

PS: Many thanks to Lupo73 for his fantastic work on this update.

User avatar
joby_toss
Posts: 2902
Joined: Sat Feb 09, 2008 9:57 am
Location: Romania
Contact:

Re: Yet another update to the popularity score algorithm

#2 Post by joby_toss » Tue Dec 20, 2011 5:17 am

Looks really good!

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: Yet another update to the popularity score algorithm

#3 Post by guinness » Tue Dec 20, 2011 11:36 am

On a side note the overall database interface is more 'clean' or is it just my eyes and Opera?
Added 179 Applications: Portable

freakazoid
Posts: 934
Joined: Wed Jul 18, 2007 5:45 pm

Re: Yet another update to the popularity score algorithm

#4 Post by freakazoid » Tue Dec 20, 2011 1:02 pm

Cool! :)

A minor aesthetic thing, but I'd like to see a better star graphic than the puke-green colored star that's currently in use.
is it stealth? ;)

User avatar
dany
Posts: 70
Joined: Fri Jun 17, 2011 10:26 pm
Location: netherlands

Re: Yet another update to the popularity score algorithm

#5 Post by dany » Tue Dec 20, 2011 2:58 pm

puke-green? I'm guessing it's already changed because it's a plain yellow on my side...
Like the update though, should work great!
GFA/P/S/SS$/O d- s: a>? C++ UL++++ P++@ L++ !E W+++ N++@ o K+ w O M V- PS+++ PE Y+ PGP++>+++ t++ 5+ X++@ R !tv b+>++ DI++ D+ G e+++ h-->- r% y+

User avatar
webfork
Posts: 7992
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Yet another update to the popularity score algorithm

#6 Post by webfork » Tue Dec 20, 2011 3:29 pm

dany wrote:puke-green? I'm guessing it's already changed because it's a plain yellow on my side...
Like the update though, should work great!
It depends on your monitor. Sometimes grey-yellow colors can look greenish. Assuming there are color options within whatever code your'e using for this, I would go with a subdued grey. Additionally, I think its important we somehow let people know this isn't like Softpedia's rating system: e.g. 1/2 star doesn't reflect on the program's quality. One possible way to demonstrate this is just put "popularity" next to the stars.

Here's how those two elements might look together (made using PhotoFiltre):


Image

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: Yet another update to the popularity score algorithm

#7 Post by guinness » Tue Dec 20, 2011 3:53 pm

I just realised that's a 'tick box image' next to the number of members who have voted for the application. It wasn't very clear in the browser (Opera) so for me it looked like an HTML parsing error of some description, but in the image it's more clear.
Added 179 Applications: Portable

User avatar
Andrew Lee
Posts: 2229
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: Yet another update to the popularity score algorithm

#8 Post by Andrew Lee » Wed Dec 21, 2011 12:53 pm

On a side note the overall database interface is more 'clean' or is it just my eyes and Opera?
I have rearranged the various data fields so that there is less tendency to wraparound on smaller screens. Could that be it?
Additionally, I think its important we somehow let people know this isn't like Softpedia's rating system: e.g. 1/2 star doesn't reflect on the program's quality. One possible way to demonstrate this is just put "popularity" next to the stars.
I have changed the tooltip to read (Popularity: XXX/100). Also, putting the stars close to the rating links should make it clear they are correlated with user ratings.
I just realised that's a 'tick box image' next to the number of members who have voted for the application.
Yup, that's actually a Unicode wingding (&#9745). But I just changed that to a "heart" (&#9829) 'cos I thought that more closely relates how we feel about the app. :mrgreen: If you mouse over the link, it should say "xxx member points".

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: Yet another update to the popularity score algorithm

#9 Post by guinness » Wed Dec 21, 2011 2:54 pm

OK, thanks Andrew for the changes.
Added 179 Applications: Portable

User avatar
Lupo73
Posts: 1011
Joined: Mon Mar 19, 2007 8:55 am
Location: Italy
Contact:

Re: Yet another update to the popularity score algorithm

#10 Post by Lupo73 » Thu Dec 22, 2011 6:31 am

Good update :wink: ..I'm considering to write an article about the new algorithm used, to allow other websites to test and use it.. anyway I'll wait few weeks to test it here and verify its quality..
Lupo PenSuite: all-in-one and completely free selection of portable programs and games.
DropIt: personal assistant to automatically manage your files.
ArcThemALL!: application to multi-archive your files and folders.

Post Reply