See Googlebot Visits with trackSpiders.cgi
Our free, open source spider tracking tool will track each Googlebot visit, displaying timestamp, HTTP status code and page retrieved. The tool tracks other search engine spiders as well. See the following demos:
trackSpiders.cgi - tracks Googlebot, Yahoo! Slurp, MSNbot
trackSpiders.cgi?s=gy - tracks Googlebot and Yahoo! Slurp
This free search engine tool can be downloaded here.
Technorati tags: googlebot, google cache, 304, http status codes, msnbot, yahoo+slurp, msn, search engine spiders, open source