Questions tagged [wget]

0 votes
1 replies
How to download links from txt files inside many folders [closed]
I have the following folder structure and every .txt file contains a link to a file. How can i download each link contained by the .txt files in...
asked 1 month ago
-4 votes
0 replies
Make --no-check-certificate default for user in Linux
How can I make wget --no-check-certificate the standard wget config for a user on a server? -4 Let me google that for you... A quick we...
asked 1 month ago
0 votes
0 replies
R download file - 'wget' call had nonzero exit status
I'm trying to download file in R from a website with login and password, but got this error message: 'wget' call had nonzero exit status I can...
asked 1 month ago
0 votes
0 replies
Why does Amazon Linux 2 have older version of wget vs. Amazon Linux 1?
We noticed that wget on Amazon Linux 2 is v1.14, but on the older version of Amazon Linux, it was v1.18. Any idea why this would be? I'm fairly...
0 votes
0 replies
How to get all the results from a web page just as the browser shows when finished scrolling down
I'm trying to get all the video results from a web page : $ curl -qs https://ok.ru/video/c335170 | pup '.video-card_lk attr{href}' | wc -l 24...
asked 1 month ago
0 votes
1 replies
Get page titles from a list of URLS
I have list of URLS where I need to get the page titles saved in another list. wget or curl seems to be the right way, but I don't know exactly h...
asked 2 months ago
0 votes
0 replies
How to use external JSON-file in Wget HTTP PUT while using Docker environment variables?
Current situation: A Dockerfile that is based on an Ubuntu image, installs Wget and declares that a bashscript will run when a container is sta...
asked 2 months ago
0 votes
1 replies
Translate a web page click to a URL for wget
I use a web page that a client uses to send me large files. It's in tha far east, so it often requires dozens of attempts to work. I'd like to...
asked 2 months ago
-1 votes
1 replies
Unable to access some websites on Amazon service
Description I'm crawling the website :bjx.com and all codes can be run in the local.Then I put the code on the Amazon service and run ,it failed...
asked 2 months ago
1 votes
1 replies
Check wget response for both status code and content
I am writing a healthcheck script for docker container using bash. It's supposed to check both URL returning status 200 and its content. Is ther...
asked 2 months ago
0 votes
0 replies
How do I fix “Can't locate Automake/Struct.pm in @INC” error when building Wget2 code?
I was trying to build Wget2 following the instruction from the link below: https://gitlab.com/gnuwget/wget2/blob/master/README.md#building-from...
asked 2 months ago
0 votes
1 replies
Downloading a working - local version of a website without js/css version names
Is there a way to wget local version of a website without its version names of js/css? What I used to get the site is below: wget --mirror --pag...
asked 2 months ago
0 votes
1 replies
Downloading a working - local version of a website without js/css version names
Is there a way to wget local version of a website without its version names of js/css? What I used to get the site is below: wget --mirror --pag...
asked 2 months ago
-1 votes
1 replies
How do I run this code in Windows/on Powershell?
I'm trying to download a collection of files, but the instructions are for the command line in Unix. Essentially, I have a .txt file that's a ve...
asked 3 months ago
-1 votes
1 replies
I used to wget the “historical” from the original coinbase api - cant find it with v2 api
I used to use a simple wget to https://api.coinbase.com/api/v1/prices/historical to get a file of past and current buy prices from coinbase on Bi...
asked 2 months ago
0 votes
1 replies
wget for windows ignores options when called with createprocess()
I am trying to use wget for windows from a c++ program to download 6 files from a website and concatenate the results as one file. This is not pr...
asked 3 months ago
-1 votes
1 replies
Download all files from a pure ftp server with a server limit
I need to download all files from a FTP server but the server has a lookup limitation on 10,000 which complicates things. I can't use wget -m ft...
asked 2 months ago
0 votes
1 replies
Is it possible to run wget using both -O and -P options together?
I wanted to download a program for example "package.zip" I wanted to download it in , for example "~/programs/downloaded" I wanted to name it,...
asked 2 months ago
1 votes
1 replies
Bash - how to escape underscore in URL
I have a little script in bash on macOS, where I use an array with dates like 19000105 in the format yyyymmdd. In that script I parse the dates...
asked 3 months ago
-1 votes
1 replies
How to recursively download specific subfolders under different folders?
I need help to download a large dataset archived under a number of subfolders, which are organized under different years and days. I could not fi...
asked 2 months ago
0 votes
0 replies
disable skipping downloaded part of file while wget is connection closed
Now I download a large file (about 1.3 GB) using wget through a FTP server. But the file is updated very frequently and I don't know when will it...
asked 2 months ago
0 votes
2 replies
wget doesn't see/download certain files?
I am trying to download all files starting with traceroute from https://data-store.ripe.net/datasets/atlas-daily-dumps/ via wget. I am running t...
asked 3 months ago
0 votes
0 replies
wget hangs on downloading a page that chrome can download
I am trying to download this url with wget: https://stats.nba.com/stats/scoreboard/?GameDate=02/14/2015&LeagueID=00&DayOffset=0 Last yea...
asked 2 months ago
0 votes
0 replies
I'm getting a schema error when I run below bash code
I am getting a schema error when I run below bash command : wget 46.101.120.157/jds_march_2019/$K -p /home/thamalee/Naveen/log2 /home/tham...
asked 2 months ago
0 votes
0 replies
wget redirect http://example.comhttp/example.com/
I'm getting a wrong redirect with wget: http://example.comhttp/example.com/ and he tries to download http://example.comhttp/example.com/index....
asked 2 months ago