Quote:
Originally posted by NexDog
Hey man, it's your hack so I just want to benefit from your skills. 
Woke up this morning to find all bots in the Archive - 30 googlebots doing their thing so me is a happy chappy. 
Would just like to know the theory behind naming the archive with a .html extension.....
|
it seems bots arent interested in visiting my site

still waiting for bot rush but only sometimes googlebot10-11-12 visits my board then leave

they cant find archive ... they try to "retrieve password" , "register" and similiar things and they go out after visiting main page of archive finally ...
do i have to put every php file as it listed by TECK to robots.txt ... or "removing all those and allowing bots to visit all those" is better ?
thanks