I spent a couple of hours tonight putting together a simple web site profiling tool. It allows you to see some useful information about a page, including it’s server IP address and location, the domain name contact, and some of the outgoing links from that site.
It’s worth noting that the tool crawls roughly five pages on the target site each time it is run, so you may notice the following user agent in server logs:
Mozilla/5.0 (compatible; SiteProfiler/1.0; +http://www.dancryer.com/site-profiler)
I thought I’d make it available on this site, so others can use it. If you like it, or you’ve got any feedback, please let me know.
[...] Original post: Site Profiler – Domain and Link Information Tool [...]