The Portable Freeware Collection - FTP access/Site Dump?

All suggestions about TPFC should be posted here. Discussions about changes to TPFC will also be carried out here.
Message
Author
User avatar
webfork
Posts: 10821
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#16 Post by webfork »

I actually might have a use for this so if it's not too difficult, please do. Obviously you're right about information overload, but in my spare time i go through pages and just test out software. In a Spreadsheet format I might be able to automate this process.

User avatar
Andrew Lee
Posts: 3063
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#17 Post by Andrew Lee »

Should be easy to implement. CSV format OK for you?

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#18 Post by guinness »

CSV is the easiest database-like format I can think of.

User avatar
Andrew Lee
Posts: 3063
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#19 Post by Andrew Lee »

Visit http://www.portablefreeware.com/dump.php.

It will prompt you to download a CSV file containing all the public entries in the database.

To prevent abuse, you need to be logged in and have insert/edit rights to order to download the CSV file.

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#20 Post by guinness »

Is this automated, so if someone edits an entry this will reflect in the next time I download the file?

abc
Posts: 74
Joined: Thu Aug 04, 2011 10:01 am

Re: The Portable Freeware Collection - FTP access/Site Dump?

#21 Post by abc »

Sorry if this strays too far off what the OP wanted but .. (my mind is working faster than I can type) :roll:

Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?

I know it would be make the file huge but would be really useful for an app I have planned..

Our very own Application launcher that integrates well with the PFC database. Maybe others have thought of this too? :?: :!:

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#22 Post by guinness »

abc wrote:Our very own Application launcher that integrates well with the PFC database. Maybe others have thought of this too? :?: :!:
Not really, crossed my mind of course, but was happy with what was presented.

User avatar
Midas
Posts: 6725
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: The Portable Freeware Collection - FTP access/Site Dump?

#23 Post by Midas »

abc wrote:Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?

[...] Our very own Application launcher that integrates well with the PFC database.
Just thinking that, given the pointer info, wouldn't it be easier/safer/more efficient to just scrape that info?

User avatar
Andrew Lee
Posts: 3063
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#24 Post by Andrew Lee »

Is this automated, so if someone edits an entry this will reflect in the next time I download the file?
This is automated. It's a direct SQL call to the database in real-time.

User avatar
Andrew Lee
Posts: 3063
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#25 Post by Andrew Lee »

Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?
Done.

Notes:

1) Carriage returns are translated to '\n' in the description (synopsis) field.

2) description_ver refers to the type of markup used in the description field. '0' means the old HTML, '1' means the newer BBCode.

User avatar
Midas
Posts: 6725
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: The Portable Freeware Collection - FTP access/Site Dump?

#26 Post by Midas »

Midas wrote:Wouldn't it be easier/safer/more efficient to just scrape that info?
... Obviously not... :D

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: The Portable Freeware Collection - FTP access/Site Dump?

#27 Post by Marc »

@abc What about if the scope is expanded to updater?
Links with static urls should work just fine.
Links with version numbers are partially taked care via TPFC updates.

andrew777
Posts: 4
Joined: Sat Jan 19, 2013 3:19 am

Re: The Portable Freeware Collection - FTP access/Site Dump?

#28 Post by andrew777 »

Hi Andrew et all,

Thanks for the replies.

Would it be possible to have access to the http://www.portablefreeware.com/dump.php ?? If the CSV file has links I might use something like wget to create a base download of all the apps. With the idea of only downloading specific apps individually after major updates or that are heavily used.

Any ideas welcome?

Thanks again,
Other Andrew

User avatar
Andrew Lee
Posts: 3063
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#29 Post by Andrew Lee »

@andrew777: As long as you login with edit rights, you have access to http://www.portablefreeware.com/dump.php.

lastaltoid
Posts: 20
Joined: Sun Dec 16, 2012 8:41 pm

Re: The Portable Freeware Collection - FTP access/Site Dump?

#30 Post by lastaltoid »

Andrew Lee wrote:@andrew777: As long as you login with edit rights, you have access to http://www.portablefreeware.com/dump.php.
OK I'll ask the dumb question(s).
[1] Where are "rights" enumerated or explained?
[2] Why are edit rights needed for a download (just to satisfy my curiosity)?

Post Reply