Update to popularity score algorithm

Changes, updates etc. related to this website will be posted here.
Message
Author
User avatar
Andrew Lee
Posts: 3048
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Update to popularity score algorithm

#1 Post by Andrew Lee »

I have updated the algorithm for calculating the popularity score, which will now take the sum of activity score over the past 30 days for each app (instead of over its entire lifetime).

The impact will only be seen after 30 days, because the current score is used as the baseline for "day 1". This means that after 30 days, the baseline will be dropped and we will see the full impact of this change.

Expect to see some shakeup in the "Popular titles" listing, which will hopefully reflect the popularity of apps in a more dynamic manner.

User avatar
SYSTEM
Posts: 2041
Joined: Sat Jul 31, 2010 1:19 am
Location: Helsinki, Finland

Re: Update to popularity score algorithm

#2 Post by SYSTEM »

Thank you! :)
My YouTube channel | Release date of my 13th playlist: August 24, 2020

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Update to popularity score algorithm

#3 Post by webfork »

Sounds good -- thanks for working on that.

User avatar
m^(2)
Posts: 890
Joined: Sat Mar 31, 2007 2:38 am
Location: Kce,PL
Contact:

Re: Update to popularity score algorithm

#4 Post by m^(2) »

Sounds good. Though I would use something that doesn't ignore old downloads but instead treats them with lower score. This would be even more dynamic and react when there's some boom yet wouldn't ignore booms that dropped just over month before.

Hydaral
Posts: 194
Joined: Tue Mar 09, 2010 7:36 pm

Re: Update to popularity score algorithm

#5 Post by Hydaral »

I don't know about this change. What if there is a app that is extremely popular, but has been around for a while, everyone would have voted for it, but all those votes would be older than 30 days.

You would need new people constantly voting for apps. Are there that many new members voting each month?

Universal Extractor for example, it's basically a one-of-a-kind app, how many people voted for it over the last 6 months, by month. Would it still be highly ranked with this new system?

User avatar
chadross
Posts: 39
Joined: Fri Jun 29, 2007 6:37 pm
Location: Canada
Contact:

Re: Update to popularity score algorithm

#6 Post by chadross »

I think this is a great change and look forward to seeing the results...

TP109
Posts: 571
Joined: Sat Apr 08, 2006 7:12 pm
Location: Midwestern US

Re: Update to popularity score algorithm

#7 Post by TP109 »

Should be interesting.

User avatar
Andrew Lee
Posts: 3048
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: Update to popularity score algorithm

#8 Post by Andrew Lee »

Sounds good. Though I would use something that doesn't ignore old downloads but instead treats them with lower score. This would be even more dynamic and react when there's some boom yet wouldn't ignore booms that dropped just over month before.
That's an interesting idea. We will see how it goes, and make adjustments as we go along.

One potential problem is some old apps have such huge scores, if we position a decreasing window over the data points, the old scores will still cast a huge shadow over the more current scores.
I don't know about this change. What if there is a app that is extremely popular, but has been around for a while, everyone would have voted for it, but all those votes would be older than 30 days.
The popularity score is not based on members' votes, but activity from anonymous Internet browsers. Hence the whole idea of this change is to find out which apps are more popular on a more recent basis, rather than in its totality.

User avatar
Firewrath
Posts: 321
Joined: Mon Aug 28, 2006 2:36 pm

Re: Update to popularity score algorithm

#9 Post by Firewrath »

hrm. Maybe im misunderstanding this, but im a little iffy on it also.

i think that the 'Popularity score' of each app, as voted by registered users should remain unchanged,
to me, this is like what the community likes and feels is worth having,
plus, itd be annoying if you have to like revote for your favorite apps to keep the score up. :P

now as for the 'Popular titles' list on the site, im All for that changing based on like monthly activity,
(though, i like numbers, so i wouldnt mind a 'weekly' and 'yearly' list either, ;))

i think where im getting confused, or have been confused is this:
Andrew Lee wrote: The popularity score is not based on members' votes, but activity from anonymous Internet browsers.
Sooo. Why do we vote for apps again? O_o
i mean, i know it can add them to our fav apps list, but i though the whole voting bit was to publicly show how much we as a community liked each app? O_o

i can see changing the 'Popular titles' list to track like clicks on the 'Website - Screenshot - Download - Comments - Post comment - Permalink' links to track how popular something is, (though i must say whatever you do, apps might get a slight boost from just being on the front page, :P)

But. Yeeeah. I think im confused here. ^-^;
...im also rather Ticked Off at HP right now, so that might be playing into it, But im posting anyways, :P


Disclaimer: I honestly dont vote for stuff, as im sure Andy can tell, :P
i mean theres stuff i like, alot, and use, but its just not my thing, unless i somehow feel its important, ^-^;;
So im just posting this in the interest of figuring out how this all works...

User avatar
SYSTEM
Posts: 2041
Joined: Sat Jul 31, 2010 1:19 am
Location: Helsinki, Finland

Re: Update to popularity score algorithm

#10 Post by SYSTEM »

Firewrath wrote:hrm. Maybe im misunderstanding this, but im a little iffy on it also.

i think that the 'Popularity score' of each app, as voted by registered users should remain unchanged,
to me, this is like what the community likes and feels is worth having,
plus, itd be annoying if you have to like revote for your favorite apps to keep the score up. :P

now as for the 'Popular titles' list on the site, im All for that changing based on like monthly activity,
(though, i like numbers, so i wouldnt mind a 'weekly' and 'yearly' list either, ;))

i think where im getting confused, or have been confused is this:
Andrew Lee wrote: The popularity score is not based on members' votes, but activity from anonymous Internet browsers.
Sooo. Why do we vote for apps again? O_o
i mean, i know it can add them to our fav apps list, but i though the whole voting bit was to publicly show how much we as a community liked each app? O_o

i can see changing the 'Popular titles' list to track like clicks on the 'Website - Screenshot - Download - Comments - Post comment - Permalink' links to track how popular something is, (though i must say whatever you do, apps might get a slight boost from just being on the front page, :P)

But. Yeeeah. I think im confused here. ^-^;
...im also rather Ticked Off at HP right now, so that might be playing into it, But im posting anyways, :P


Disclaimer: I honestly dont vote for stuff, as im sure Andy can tell, :P
i mean theres stuff i like, alot, and use, but its just not my thing, unless i somehow feel its important, ^-^;;
So im just posting this in the interest of figuring out how this all works...
There are two independent popularity scores.

The internal popularity score is visible only if you are logged in and determines if the application is public or private.

The public popularity score is displayed to all visitors. When the visitor clicks the "Most popular first" link, the entries are ordered by the public score. Similarly, the "Popular titles" box displays the applications which have the highest public scores. (BTW, it might be interesting to see the list of entries with highest internal scores. :) )

AFAIK, this change will affect only the public popularity score.
My YouTube channel | Release date of my 13th playlist: August 24, 2020

User avatar
m^(2)
Posts: 890
Joined: Sat Mar 31, 2007 2:38 am
Location: Kce,PL
Contact:

Re: Update to popularity score algorithm

#11 Post by m^(2) »

Andrew Lee wrote:
Sounds good. Though I would use something that doesn't ignore old downloads but instead treats them with lower score. This would be even more dynamic and react when there's some boom yet wouldn't ignore booms that dropped just over month before.
That's an interesting idea. We will see how it goes, and make adjustments as we go along.

One potential problem is some old apps have such huge scores, if we position a decreasing window over the data points, the old scores will still cast a huge shadow over the more current scores.
I don't know about this change. What if there is a app that is extremely popular, but has been around for a while, everyone would have voted for it, but all those votes would be older than 30 days.
The popularity score is not based on members' votes, but activity from anonymous Internet browsers. Hence the whole idea of this change is to find out which apps are more popular on a more recent basis, rather than in its totality.
It all depends on how do you set score reduction curve. Make it 1/exponential with halving period of one week and votes older than 2 months won't matter at all. The system is flexible.

User avatar
Checker
Posts: 1628
Joined: Wed Jun 20, 2007 1:00 pm
Location: Ingolstadt [DE]

Re: Update to popularity score algorithm

#12 Post by Checker »

Andrew Lee wrote:I have updated the algorithm for calculating the popularity score, which will now take the sum of activity score over the past 30 days for each app (instead of over its entire lifetime).
What will happen to apps like "FastStone Capture"?
It's very popular, but who has it won't download it again ... and there will be no change/update (because it's shareware now).
That means: Very less activity :!:

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Update to popularity score algorithm

#13 Post by webfork »

Checker wrote:What will happen to apps like "FastStone Capture"? It's very popular, but who has it won't download it again ... and there will be no change/update (because it's shareware now).
I suspect what's happened to this point is that FastStone Capture has gotten a great deal of attention due to the main site dropping it and PFW becoming its unofficial homepage. Its presence at #1 on the front page has only kept this going artificially, even though there are better capture tools here on the site. In essence, it really isn't the most popular program on the site anymore. It only stays in that position because it got a LOT of votes when we became its homepage.

This situation isn't unique to FastStone Capture; a program's presence as a link on any popular site will drive a lot of traffic and a lot of votes that don't really represent actual popularity. Hopefully Andrew's new method will work a bit better or at least mix up the site content.

User avatar
Andrew Lee
Posts: 3048
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: Update to popularity score algorithm

#14 Post by Andrew Lee »

Firewrath wrote:Sooo. Why do we vote for apps again?
Voting by logged in members is to help elevate private entries to public status. For logged in members, the popularity score for each entry is displayed as (ppp/nnn), where nnn is the voting score by members. Once the score is >= 10, the entry is public. Also, nnn is NOT DISPLAYED for non-members.

ppp, on the other hand, aggregates public/member activity for each entry. It is added for each entry every time a browser is interested enough to click through to the app's website, or click through to the download link (with duplicate elimination by source IP address). It does this for both public and member clicks, but the public scores will tend to overwhelm member scores thanks to redirects from search engines.

I think webfork has essentially summarized the intent for this change. It is to make the top app list more dynamically reflect recent activity because it is very difficult to unseat older apps due to time advantage.

The scores are not deleted, so we can tinker with the ranking algo any time we want. Applying a moving window to the scores is definitely possible.

I will report back on 6 Sep (20 days after the mod) the list of top apps and their scores. Then we still have 10 days to make any changes if we want.

fang-face
Posts: 41
Joined: Sat Aug 22, 2009 12:26 pm

Re: Update to popularity score algorithm

#15 Post by fang-face »

maybe 2 lists: "recent popularity" and "all-time-favourites"?

Post Reply