I have a backend script that reports back all 404, 500, 400 etc etc errors. Well what I did was I went ahead and submitted my page to the engines that spider and within minutes I was getting logs of 404 not found errors on every one of the links that they were spidering from that page.

I think this is a real good idea and I really wish it would work

Funny thing is though, if you go to the page you dont get the 404 errors.
http://www.extremeforums.com/forums/spider.php

here is the error....
ON YOUR SITE, Extreme Forums
ERROR CODE 404 NOT FOUND
OCCURRED ON Wed Aug 9 02:23:48 2000
WHEN THE URL /search/259 WAS REQUESTED
FROM THE PAGE
BY A USER AT 195.145.119.25
THE BROWSER WAS Infoseek Sidewinder/0.9
------------------------------------------------------------------------------


One thing I notice though is that the engines are looking for /search/*** why arent they looking for /forums/search/*** ??? After all thats what is listed on search.php3


Im sure someone knows more about this than I do, so could you please comment?

Thanks,
~Chris