Difference between revisions of "wget directory listing"
From thelinuxwiki
(Created page with "wget --spider -r --no-parent https://www.example.com/ --spider When invoked with this option, Wget will behave as a Web spider, which means that it will not download th...") |
|||
| Line 4: | Line 4: | ||
--spider | --spider | ||
When invoked with this option, Wget will behave as a Web spider, which means that it will not download the pages, just check that they are there. For example, you can use Wget to check your bookmarks: | When invoked with this option, Wget will behave as a Web spider, which means that it will not download the pages, just check that they are there. For example, you can use Wget to check your bookmarks: | ||
| − | + | i.e. | |
wget --spider --force-html -i bookmarks.html | wget --spider --force-html -i bookmarks.html | ||
| − | + | note - This feature needs much more work for Wget to get close to the functionality of real web spiders. | |
| − | This feature needs much more work for Wget to get close to the functionality of real web spiders. | + | |
Latest revision as of 17:25, 6 March 2021
wget --spider -r --no-parent https://www.example.com/
--spider When invoked with this option, Wget will behave as a Web spider, which means that it will not download the pages, just check that they are there. For example, you can use Wget to check your bookmarks: i.e. wget --spider --force-html -i bookmarks.html note - This feature needs much more work for Wget to get close to the functionality of real web spiders.
