Wget [& Curl] for Windows

Submit command line tools that you find here.
Message
Author
bitcoin
Posts: 260
Joined: Sun Dec 31, 2017 6:32 pm

Re: Wget for Windows

#31 Post by bitcoin » Tue Apr 09, 2019 8:29 pm

billon wrote:
Mon Jan 07, 2019 4:20 pm
elGUI4Wget

Image

nice GUI

User avatar
webfork
Posts: 9983
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget for Windows

#32 Post by webfork » Fri Apr 12, 2019 6:12 am

bitcoin wrote:
Tue Apr 09, 2019 8:29 pm
nice GUI
Yeah the image was broken for me, not sure why. The direct link fixes whatever issue: http://guerilla.bplaced.net/elGUI4Wget.png

Also, it's worth checking out even if you don't care about WGET. This is some great frontend functionality that's easy to follow and remains connected to the fundamental command line functions. I can see uses for everyone from beginners to experts.

Whoever came up with this is doing something that I hope others mimic.

bitcoin
Posts: 260
Joined: Sun Dec 31, 2017 6:32 pm

Re: Wget for Windows

#33 Post by bitcoin » Sun Apr 21, 2019 9:34 am

webfork wrote:
Fri Apr 12, 2019 6:12 am
bitcoin wrote:
Tue Apr 09, 2019 8:29 pm
nice GUI
Yeah the image was broken for me, not sure why. The direct link fixes whatever issue: http://guerilla.bplaced.net/elGUI4Wget.png

Also, it's worth checking out even if you don't care about WGET. This is some great frontend functionality that's easy to follow and remains connected to the fundamental command line functions. I can see uses for everyone from beginners to experts.

Whoever came up with this is doing something that I hope others mimic.
there's also a GUI for FFmpeg there but maybe there are other programs that already serve this purpose

User avatar
Midas
Posts: 5960
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Curl for Windows

#34 Post by Midas » Sun Jun 02, 2019 4:17 am

Curl v7.65.0 released, dated 22 2019-05-22 (changelog and downloads at https://curl.haxx.se/changes.html).

EDIT: relevant portability snippet from Curl manual ('> curl --manual').
On windows, if there is no _curlrc file in the home dir [i.e., '%APPDATA%'], it checks for one in the same dir the curl executable is placed.

User avatar
Midas
Posts: 5960
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#35 Post by Midas » Thu Jul 18, 2019 7:28 am

:!: Jernej Simončič Wget Windows builds official repository (https://eternallybored.org/misc/wget/) is unreachable, ATM.

Alternative download locations:

User avatar
Midas
Posts: 5960
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#36 Post by Midas » Mon Feb 10, 2020 6:56 am

Curl v7.68.0 released 2020-01-08 (changelog at https://curl.haxx.se/changes.html).

Wget current Windows build is still v1.20.3 (upstream changelog appears to be obsolete; Windows repo has {mostly} been live at https://eternallybored.org/misc/wget/).

[v1.20.3:] OpenSSL 1.1.1b, ZLib 1.2.11, gpgme-1.13.0, pcre2 10.32, libpsl 0.20.2, taskbar progressbar, Windows certificate store support, manual; the binaries have been updated and now work fine with SSL connections.

User avatar
Midas
Posts: 5960
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#37 Post by Midas » Mon Jun 01, 2020 3:49 am

Quick note with a pretty straightforward recipe for creating local mirrors of online sites using wget:

www.guyrutenberg.com /2014/05/02/make-offline-mirror-of-a-site-using-wget/

In a nutshell:

Code: Select all

wget -mkEpnp http://example.org

BTW and due to the patchy update pace, it hasn't been mentioned here that the last upstream changelog for wget (v1.20 released 2018-11-30) is at http://savannah.gnu.org/forum/forum.php?forum_id=9310.

Spoiler!   
GNU Wget 1.20 Released

Item posted by Darshit Shah <darnir> on Fri 30 Nov 2018 12:14:38 AM UTC.

Noteworthy Changes in this release:
  • Add new option `--retry-on-host-error` to treat local errors as transient and hence Wget will retry to download the file after a brief waiting period.
  • Fixed multiple potential resource leaks as found by static analysis
  • Wget will now not create an empty wget-log file when running with -q and -b switches together
  • When compiled using the GnuTLS >= 3.6.3, Wget now has support for TLSv1.3
  • Now there is support for using libpcre2 for regex pattern matching
  • When downloading over FTP recursively, one can now use the --{accept,reject}-regex switches to fine-tune the downloaded files
  • Building Wget from the git sources now requires autoconf 2.63 or above. Building from the Tarballs works as it used to.

User avatar
vevy
Posts: 752
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#38 Post by vevy » Tue Nov 10, 2020 2:59 pm

I think it is high time Wget and cURL got their own separate threads. That's like having a thread for "Chrome and Firefox" or "Windows and Linux Discussions"!
Help make the comprehensive CLI database happen:
                    Vote for filters/badges!

User avatar
webfork
Posts: 9983
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#39 Post by webfork » Tue Nov 10, 2020 4:30 pm

vevy wrote:
Tue Nov 10, 2020 2:59 pm
I think it is high time Wget and cURL got their own separate threads. That's like having a thread for "Chrome and Firefox" or "Windows and Linux Discussions"!
Looking through the thread and seeing a little too much overlap between the two programs. Several posts list details on both (including the first) so I'm not sure I can separate them.

User avatar
Midas
Posts: 5960
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget & Curl for Windows

#40 Post by Midas » Wed Nov 11, 2020 6:16 am

As they are closely related, I see no issue with having a common thread for wget and curl -- let's see if there's really a need for separate threads before taking any measures...

User avatar
vevy
Posts: 752
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#41 Post by vevy » Wed Nov 11, 2020 7:07 am

They are closely related but definitely distinct with different syntax and release cycle and every other thing. I think it's better to look at it the other way around: if they already have 3 pages of content, is there a good reason to leave them to intertwine further and be even more complicated to separate?

@webfork, maybe ignore the release update posts (leave them in either topic) since they are useful as a heads up at the time of release.
Help make the comprehensive CLI database happen:
                    Vote for filters/badges!

User avatar
webfork
Posts: 9983
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#42 Post by webfork » Wed Nov 11, 2020 10:51 pm

vevy wrote:
Wed Nov 11, 2020 7:07 am
They are closely related but definitely distinct with different syntax and release cycle and every other thing. I think it's better to look at it the other way around: if they already have 3 pages of content, is there a good reason to leave them to intertwine further and be even more complicated to separate?
It's not a question of should we separate them (that would obviously be better) but can we? Generally speaking, there's a good reason to give entries their own space to aid visitors and keep things on topic, and then there's this thread with it's overlapping data and replies. For example, this post that lists both WGET and CURL, including within the referenced URL and contains a reply about another post discussing WGET:

viewtopic.php?p=75488#p75488

If you've solved this, then by all means give me the answer but keep in mind there's no functionality for duplicate entries in both threads.
Last edited by webfork on Wed Nov 11, 2020 11:27 pm, edited 1 time in total.
Reason: (better wording)

User avatar
vevy
Posts: 752
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#43 Post by vevy » Thu Nov 12, 2020 2:35 am

Leave it in Wget. Add it to the mod note: "The Wget thread includes references to a curl build by Moluccas developer TumaGonx Zakkum. For example, see here."

It was also mentioned in the update posts multiple times later. You can put on of those in the curl thread.

It is not the prettiest solution, but it would become even less so otherwise.
Help make the comprehensive CLI database happen:
                    Vote for filters/badges!

User avatar
webfork
Posts: 9983
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#44 Post by webfork » Thu Nov 12, 2020 12:31 pm

For those coming in on the tail end of this conversation, if it seems like I'm going on far too long about this, it's because I think this is a policy conversation and not limited to Wget/Curl. In other words, about how threads are handled going forward.
vevy wrote:
Thu Nov 12, 2020 2:35 am
Leave it in Wget. Add it to the mod note: "The Wget thread includes references to a curl build by Moluccas developer TumaGonx Zakkum. For example, see here."

It was also mentioned in the update posts multiple times later. You can put on of those in the curl thread.

It is not the prettiest solution, but it would become even less so otherwise.
I don't see the logic here. Even if that were the only problematic entry in the thread that had overlapping content, do you really think adding a bunch of disclaimers to the thread posts really clears up confusion? And that's assuming that topic posters actually pay attention to these notes we add. My guess is that even site regulars will just do a simple search, pick whatever thread comes up first in the search irrespective of what the topic says, and then moderators will have to again chase down and split/merge threads. Rinse and repeat.

I'm fine creating either a separate Wget or Curl separate thread and putting a note at the top of the first post of the old one, but I don't think the goal of fully separate, unique threads that stay in their own lane is achievable. If you poke around on PortableApps.com's forums, you'll see we're not the only ones with this kind of topic bleed.
Last edited by webfork on Thu Nov 12, 2020 12:33 pm, edited 1 time in total.

User avatar
vevy
Posts: 752
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#45 Post by vevy » Thu Nov 12, 2020 12:37 pm

Even if one thread is titled Wget and the other cURL? :?
Help make the comprehensive CLI database happen:
                    Vote for filters/badges!

Post Reply