Wget [& Curl] for Windows

Submit command line tools that you find here.
Message
Author
bitcoin
Posts: 285
Joined: Sun Dec 31, 2017 6:32 pm

Re: Wget for Windows

#31 Post by bitcoin »

billon wrote: Mon Jan 07, 2019 4:20 pm elGUI4Wget

Image

nice GUI

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget for Windows

#32 Post by webfork »

bitcoin wrote: Tue Apr 09, 2019 8:29 pm nice GUI
Yeah the image was broken for me, not sure why. The direct link fixes whatever issue: http://guerilla.bplaced.net/elGUI4Wget.png

Also, it's worth checking out even if you don't care about WGET. This is some great frontend functionality that's easy to follow and remains connected to the fundamental command line functions. I can see uses for everyone from beginners to experts.

Whoever came up with this is doing something that I hope others mimic.

bitcoin
Posts: 285
Joined: Sun Dec 31, 2017 6:32 pm

Re: Wget for Windows

#33 Post by bitcoin »

webfork wrote: Fri Apr 12, 2019 6:12 am
bitcoin wrote: Tue Apr 09, 2019 8:29 pm nice GUI
Yeah the image was broken for me, not sure why. The direct link fixes whatever issue: http://guerilla.bplaced.net/elGUI4Wget.png

Also, it's worth checking out even if you don't care about WGET. This is some great frontend functionality that's easy to follow and remains connected to the fundamental command line functions. I can see uses for everyone from beginners to experts.

Whoever came up with this is doing something that I hope others mimic.
there's also a GUI for FFmpeg there but maybe there are other programs that already serve this purpose

User avatar
Midas
Posts: 6705
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Curl for Windows

#34 Post by Midas »

Curl v7.65.0 released, dated 22 2019-05-22 (changelog and downloads at https://curl.haxx.se/changes.html).

EDIT: relevant portability snippet from Curl manual ('> curl --manual').
On windows, if there is no _curlrc file in the home dir [i.e., '%APPDATA%'], it checks for one in the same dir the curl executable is placed.

User avatar
Midas
Posts: 6705
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#35 Post by Midas »

:!: Jernej Simončič Wget Windows builds official repository (https://eternallybored.org/misc/wget/) is unreachable, ATM.

Alternative download locations:

User avatar
Midas
Posts: 6705
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#36 Post by Midas »

Curl v7.68.0 released 2020-01-08 (changelog at https://curl.haxx.se/changes.html).

Wget current Windows build is still v1.20.3 (upstream changelog appears to be obsolete; Windows repo has {mostly} been live at https://eternallybored.org/misc/wget/).

[v1.20.3:] OpenSSL 1.1.1b, ZLib 1.2.11, gpgme-1.13.0, pcre2 10.32, libpsl 0.20.2, taskbar progressbar, Windows certificate store support, manual; the binaries have been updated and now work fine with SSL connections.

User avatar
Midas
Posts: 6705
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget for Windows

#37 Post by Midas »

Quick note with a pretty straightforward recipe for creating local mirrors of online sites using wget:

www.guyrutenberg.com /2014/05/02/make-offline-mirror-of-a-site-using-wget/

In a nutshell:

Code: Select all

wget -mkEpnp http://example.org

BTW and due to the patchy update pace, it hasn't been mentioned here that the last upstream changelog for wget (v1.20 released 2018-11-30) is at http://savannah.gnu.org/forum/forum.php?forum_id=9310.

Spoiler!   
GNU Wget 1.20 Released

Item posted by Darshit Shah <darnir> on Fri 30 Nov 2018 12:14:38 AM UTC.

Noteworthy Changes in this release:
  • Add new option `--retry-on-host-error` to treat local errors as transient and hence Wget will retry to download the file after a brief waiting period.
  • Fixed multiple potential resource leaks as found by static analysis
  • Wget will now not create an empty wget-log file when running with -q and -b switches together
  • When compiled using the GnuTLS >= 3.6.3, Wget now has support for TLSv1.3
  • Now there is support for using libpcre2 for regex pattern matching
  • When downloading over FTP recursively, one can now use the --{accept,reject}-regex switches to fine-tune the downloaded files
  • Building Wget from the git sources now requires autoconf 2.63 or above. Building from the Tarballs works as it used to.

User avatar
vevy
Posts: 795
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#38 Post by vevy »

I think it is high time Wget and cURL got their own separate threads. That's like having a thread for "Chrome and Firefox" or "Windows and Linux Discussions"!

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#39 Post by webfork »

vevy wrote: Tue Nov 10, 2020 2:59 pm I think it is high time Wget and cURL got their own separate threads. That's like having a thread for "Chrome and Firefox" or "Windows and Linux Discussions"!
Looking through the thread and seeing a little too much overlap between the two programs. Several posts list details on both (including the first) so I'm not sure I can separate them.

User avatar
Midas
Posts: 6705
Joined: Mon Dec 07, 2009 7:09 am
Location: Sol3

Re: Wget & Curl for Windows

#40 Post by Midas »

As they are closely related, I see no issue with having a common thread for wget and curl -- let's see if there's really a need for separate threads before taking any measures...

User avatar
vevy
Posts: 795
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#41 Post by vevy »

They are closely related but definitely distinct with different syntax and release cycle and every other thing. I think it's better to look at it the other way around: if they already have 3 pages of content, is there a good reason to leave them to intertwine further and be even more complicated to separate?

@webfork, maybe ignore the release update posts (leave them in either topic) since they are useful as a heads up at the time of release.

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#42 Post by webfork »

vevy wrote: Wed Nov 11, 2020 7:07 am They are closely related but definitely distinct with different syntax and release cycle and every other thing. I think it's better to look at it the other way around: if they already have 3 pages of content, is there a good reason to leave them to intertwine further and be even more complicated to separate?
It's not a question of should we separate them (that would obviously be better) but can we? Generally speaking, there's a good reason to give entries their own space to aid visitors and keep things on topic, and then there's this thread with it's overlapping data and replies. For example, this post that lists both WGET and CURL, including within the referenced URL and contains a reply about another post discussing WGET:

viewtopic.php?p=75488#p75488

If you've solved this, then by all means give me the answer but keep in mind there's no functionality for duplicate entries in both threads.
Last edited by webfork on Wed Nov 11, 2020 11:27 pm, edited 1 time in total.
Reason: (better wording)

User avatar
vevy
Posts: 795
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#43 Post by vevy »

Leave it in Wget. Add it to the mod note: "The Wget thread includes references to a curl build by Moluccas developer TumaGonx Zakkum. For example, see here."

It was also mentioned in the update posts multiple times later. You can put on of those in the curl thread.

It is not the prettiest solution, but it would become even less so otherwise.

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Wget & Curl for Windows

#44 Post by webfork »

For those coming in on the tail end of this conversation, if it seems like I'm going on far too long about this, it's because I think this is a policy conversation and not limited to Wget/Curl. In other words, about how threads are handled going forward.
vevy wrote: Thu Nov 12, 2020 2:35 am Leave it in Wget. Add it to the mod note: "The Wget thread includes references to a curl build by Moluccas developer TumaGonx Zakkum. For example, see here."

It was also mentioned in the update posts multiple times later. You can put on of those in the curl thread.

It is not the prettiest solution, but it would become even less so otherwise.
I don't see the logic here. Even if that were the only problematic entry in the thread that had overlapping content, do you really think adding a bunch of disclaimers to the thread posts really clears up confusion? And that's assuming that topic posters actually pay attention to these notes we add. My guess is that even site regulars will just do a simple search, pick whatever thread comes up first in the search irrespective of what the topic says, and then moderators will have to again chase down and split/merge threads. Rinse and repeat.

I'm fine creating either a separate Wget or Curl separate thread and putting a note at the top of the first post of the old one, but I don't think the goal of fully separate, unique threads that stay in their own lane is achievable. If you poke around on PortableApps.com's forums, you'll see we're not the only ones with this kind of topic bleed.
Last edited by webfork on Thu Nov 12, 2020 12:33 pm, edited 1 time in total.

User avatar
vevy
Posts: 795
Joined: Tue Sep 10, 2019 11:17 am

Re: Wget & Curl for Windows

#45 Post by vevy »

Even if one thread is titled Wget and the other cURL? :?

Post Reply