published scripts(21) / CGI & Perl / Link Checking
WebTester
WebTester is a handy site management tool, the primary purpose of which is to check your site for broken links. It will report both on missing files and on those which exist but aren't referenced. It can also check the validity of your external links. (That way, if someone moves or removes a page to which you've linked, you'll know that the link needs to be updated!) The script is fairly robust; in addition to following "straight" links, it will also parse and follow links in image maps, in text embedded via SSIs, and in CGI-generated pages. It will let you know the effective "download" file size of your pages, and will provide estimates of how long they'll take to download at various connection speeds. Finally, it can create for you a simple "site map" showing, in outline format, all of your site's pages. (The site map can be included via SSIs on other pages.)...more detail
discuss | Add this link to... | tell friends
LinkScan
LinkScan is the industrial strength link checking and website management tool. It also does HTML validation and creates two types of publication quality SiteMaps. LinkScan is offered in two versions: LinkScan Workstation is a single-user implementation designed for individual content developers in large enterprises, and for organizations having smaller websites with up to 300 documents, and LinkScan Server is the complete multi-user, enterprise LinkScan implementation including LinkScan/Dispatch and handles extremely large websites comprising up to or more than 250,000 HTML documents and/or 100,000 external links....more detail
discuss | Add this link to... | tell friends
Sarang Gupta's htmldescend.pl
This simple six-line Perl script checks for broken links in one or more of your HTML files....more detail
discuss | Add this link to... | tell friends
Checklinks
This script allows you to check the validity of all HTML links on a Web site. Most can start at one or more "seed" HTML files, and recursively test all URLs found at that site. This program doesn't follow URLs at other sites, but it does check their existence. Major features include: Local URLs are read from the filesystem when possible, Basic server-side includes (aka SSI or SHTML) are checked, Latest standards are supported-- HTML 4.0, HTTP 1.1, latest URI-parsing scheme, and Links are traversed breadth-first....more detail
discuss | Add this link to... | tell friends
META & Dead Links Check
META & Dead Links Check (mdlc) is a Perl program that checks META tags and dead links. Now, it can only check local web pages. It can create 4 result files containing: List of checked links, List of dead links, List of Web links (not local links), and That you can view if your web site was indexed by a robot....more detail
discuss | Add this link to... | tell friends
SpiderView
SpiderView is a server based program which can spider a webpage, testing the links found on the page, evaluating your server and its performance. SpiderView is available, to run, from our server at no charge, or you can purchase the program and offer it to your users as a means of generating traffic to your site....more detail
discuss | Add this link to... | tell friends
InSite
InSite is a Web site management tool written in perl. It checks link integrity and does some basic content monitoring of your site's files directly on the local disk, which gives it a huge speed advantage over similar tools....more detail
discuss | Add this link to... | tell friends
LinkController
This is a link checking system designed to minimise the amount of time spent dealing with broken links. It does not report the links as broken until some time after they are first identified (three tries over several days by default) so that there is time for links to be fixed. It then provides tools for easy and fast repair of the broken links....more detail
discuss | Add this link to... | tell friends