Quote:
Originally Posted by spamgirl
We have hundreds of guests on the site, I have no way to determine which the scraper is.
I just want to temporarily slow them until we can figure out what's going on. If you have a better idea, I'd be happy to take your advice. 
|
I would solve this problem by installing Paul M's "Track Guest Visits" and studying the log it provides daily, looking for IP addresses that load a lot of pages. That mod tracks visitors that way. It also gives you their user agent and tells exactly what pages they visited as well, and it's all timestamped even.
You must identify the bad actor and stop IT, not penalize all visitors. You want to slow down your page loading or otherwise restrict visitors, get ready for the hit from google in your search results and pagerank.