Linkchecker
From Notes_Wiki
<yambe:breadcrumb>Automated_web_checking|Automated web checking</yambe:breadcrumb>
linkchecker
linkchecker is a powerful linkchecker program which honors robots.txt and supports multi-threading. It checks various URLs and lists all the URLs which are broken with basic information such as parent URL, etc. so that we can fix the broken links. linkchecker does not seems to be present in Cent-OS 6.4 repositories. Installation via source is not straightforward and simple extraction of source does not works due to missing python libraries. linkchecker can be installed on Fedora 18 using 'yum -y install linkchecker'.