Difference between revisions of "wget directory listing"

From thelinuxwiki
Jump to: navigation, search
(Created page with "wget --spider -r --no-parent https://www.example.com/ --spider When invoked with this option, Wget will behave as a Web spider, which means that it will not download th...")

Revision as of 17:24, 6 March 2021

wget --spider -r --no-parent https://www.example.com/


--spider
   When invoked with this option, Wget will behave as a Web spider, which means that it will not download the pages, just check that they are there. For example, you can use Wget to check your bookmarks:
   wget --spider --force-html -i bookmarks.html
   This feature needs much more work for Wget to get close to the functionality of real web spiders.