Google ads Horizontal

Sunday, June 7, 2020

Using wget to recursively fetch a directory with arbitrary files in it

* remove robots.txt
* remove index.html
* check recursively (folders)
* Stop check parent folder
Command: 
wget -e robots=off --reject="index.html*" -r --no-parent http://ftp.alphamediazone.com/E-Books/

No comments:

Post a Comment