Webcheck
<yambe:breadcrumb>Automated_web_checking|Automated web checking</yambe:breadcrumb>
webcheck
webcheck is automated web checking tool which can check a URL recursively and report important information such as broken links. It can check external URLs to verify whether they are valid. webcheck generates HTML reports which are very easy to follow and share. It creates a site-map of website checked and also creates lists of:
- All URLS
- All images
- Broken URLs
- URLs where size of page is big
- Broken URLs by author where author is determined by http-meta author tag
- Pages without title
webcheck supports fairly powerful regular expressions and options so that it can be used to check even complex websites such as wikis which have many special link. A sample command which can check a wiki is
webcheck -b http://127.0.0.1/notes_wiki/index.php -y 'title=' -y 'diff=' -y 'action=edit' -y 'Special:' -y 'Notes_Wiki:' -y 'Help:Contents' -y 'https:///' http://127.0.0.1/notes_wiki/index.php/Main_Page
webcheck seems to be a sequential program. So checking links using it can take long time.
In Cent-OS 6.4 webcheck can be installed using 'yum -y install webcheck'.