The Portable Freeware Collection - FTP access/Site Dump?

All suggestions about TPFC should be posted here. Discussions about changes to TPFC will also be carried out here.
Message
Author
User avatar
webfork
Posts: 10035
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#16 Post by webfork » Fri Feb 01, 2013 4:11 pm

I actually might have a use for this so if it's not too difficult, please do. Obviously you're right about information overload, but in my spare time i go through pages and just test out software. In a Spreadsheet format I might be able to automate this process.

User avatar
Andrew Lee
Posts: 2706
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#17 Post by Andrew Lee » Mon Feb 04, 2013 3:39 am

Should be easy to implement. CSV format OK for you?

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#18 Post by guinness » Mon Feb 04, 2013 3:53 am

CSV is the easiest database-like format I can think of.

User avatar
Andrew Lee
Posts: 2706
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#19 Post by Andrew Lee » Tue Feb 05, 2013 4:43 am

Visit http://www.portablefreeware.com/dump.php.

It will prompt you to download a CSV file containing all the public entries in the database.

To prevent abuse, you need to be logged in and have insert/edit rights to order to download the CSV file.

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#20 Post by guinness » Tue Feb 05, 2013 5:35 am

Is this automated, so if someone edits an entry this will reflect in the next time I download the file?

abc
Posts: 73
Joined: Thu Aug 04, 2011 10:01 am

Re: The Portable Freeware Collection - FTP access/Site Dump?

#21 Post by abc » Tue Feb 05, 2013 8:13 pm

Sorry if this strays too far off what the OP wanted but .. (my mind is working faster than I can type) :roll:

Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?

I know it would be make the file huge but would be really useful for an app I have planned..

Our very own Application launcher that integrates well with the PFC database. Maybe others have thought of this too? :?: :!:

User avatar
guinness
Posts: 4118
Joined: Mon Aug 27, 2007 2:00 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#22 Post by guinness » Wed Feb 06, 2013 2:02 am

abc wrote:Our very own Application launcher that integrates well with the PFC database. Maybe others have thought of this too? :?: :!:
Not really, crossed my mind of course, but was happy with what was presented.

User avatar
Midas
Posts: 6004
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: The Portable Freeware Collection - FTP access/Site Dump?

#23 Post by Midas » Wed Feb 06, 2013 7:15 am

abc wrote:Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?

[...] Our very own Application launcher that integrates well with the PFC database.
Just thinking that, given the pointer info, wouldn't it be easier/safer/more efficient to just scrape that info?

User avatar
Andrew Lee
Posts: 2706
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#24 Post by Andrew Lee » Thu Feb 07, 2013 5:29 pm

Is this automated, so if someone edits an entry this will reflect in the next time I download the file?
This is automated. It's a direct SQL call to the database in real-time.

User avatar
Andrew Lee
Posts: 2706
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#25 Post by Andrew Lee » Thu Feb 07, 2013 6:29 pm

Can you also include 'Synopsis, Categories, System Requirements, License, etc'. in the CVS file?
Done.

Notes:

1) Carriage returns are translated to '\n' in the description (synopsis) field.

2) description_ver refers to the type of markup used in the description field. '0' means the old HTML, '1' means the newer BBCode.

User avatar
Midas
Posts: 6004
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: The Portable Freeware Collection - FTP access/Site Dump?

#26 Post by Midas » Fri Feb 08, 2013 3:41 am

Midas wrote:Wouldn't it be easier/safer/more efficient to just scrape that info?
... Obviously not... :D

Marc
Posts: 157
Joined: Sun May 15, 2011 6:06 pm

Re: The Portable Freeware Collection - FTP access/Site Dump?

#27 Post by Marc » Mon Feb 11, 2013 9:56 pm

@abc What about if the scope is expanded to updater?
Links with static urls should work just fine.
Links with version numbers are partially taked care via TPFC updates.

andrew777
Posts: 4
Joined: Sat Jan 19, 2013 3:19 am

Re: The Portable Freeware Collection - FTP access/Site Dump?

#28 Post by andrew777 » Fri Feb 15, 2013 10:06 pm

Hi Andrew et all,

Thanks for the replies.

Would it be possible to have access to the http://www.portablefreeware.com/dump.php ?? If the CSV file has links I might use something like wget to create a base download of all the apps. With the idea of only downloading specific apps individually after major updates or that are heavily used.

Any ideas welcome?

Thanks again,
Other Andrew

User avatar
Andrew Lee
Posts: 2706
Joined: Sat Feb 04, 2006 9:19 am
Contact:

Re: The Portable Freeware Collection - FTP access/Site Dump?

#29 Post by Andrew Lee » Tue Feb 19, 2013 5:14 pm

@andrew777: As long as you login with edit rights, you have access to http://www.portablefreeware.com/dump.php.

lastaltoid
Posts: 18
Joined: Sun Dec 16, 2012 8:41 pm

Re: The Portable Freeware Collection - FTP access/Site Dump?

#30 Post by lastaltoid » Tue Feb 19, 2013 7:22 pm

Andrew Lee wrote:@andrew777: As long as you login with edit rights, you have access to http://www.portablefreeware.com/dump.php.
OK I'll ask the dumb question(s).
[1] Where are "rights" enumerated or explained?
[2] Why are edit rights needed for a download (just to satisfy my curiosity)?

Post Reply