WebWatcher - The CADwire.net Web Robot

WebWatcher is CADwire.net's web indexing robot. It simply monitors specific web pages for changes.

We keep a keen eye on the companies in this sector, and WebWatcher is a part of our strategy to better facilitate research for the engineering software industry. WebWatcher is a simple robot (bot) used to monitor updates to specific web sites relevant to the industry.

WebWatcher is not a crawler or a spider. It’s an automated robot that downloads only specific web pages for updates. It does not crawl from page to page, nor does it seek out new pages to access.

Frequency of Access

WebWatcher will access individual pages on a site an average of no more than twice per day. On rare occasion upon restart of WebWatcher, it may access pages more frequently than that on a given day, but by design its average should be twice per day.
 

Accessing Missing Files

WebWatcher operates from a database of pages to be monitored. If pages in that database are removed during site updates, WebWatcher will continue to access them but record an access failure. Continued access failures of the same page will eventually exclude those page URLs from the WebWatcher database.
 

Questions or Comments

If you have questions that we have not answered here, would like to comment, or would like more information about WebWatcher, you can direct them via email to webwatcher@cadwire.net.