Unusual Guest Activity
 

I have had two guest listed both with the exact same IP except for the last two numbers(They only differ by one number)... there activty is rather strange and they seem to be there all day..

they have been noted as doing Moderator duties, Viewing threads in printable version, editing post, etc....

as anyone noticed the same activity?

thanks

It is probably a robot.

Create a file by the name of robots.txt and place it in your www base directory with the following content.

I'll try that... thanks. what the hell does it do anyways?? the robot.

They somehow access your board and recursively traverse all the links starting from the home page. They collecct data for search engines...

What will this file actually do?

The asterisk indicates all search engine robots.
The slash tells the robot that it is not allowed to view the www root directory and everything else under it. :)

BTW, this link will give you pretty good info: http://www.robotstxt.org/wc/robots.html

You don't want to do that, that will stop search engine bots from indexing your site and then you will not appear in search engines.......

but you can modify it, to disallow em to go to several pages like postings.php and so on which are useless for em :)

How would you go about doing that, sir? ;)

Exclude specific directories and/or files:

What would be a good listing to include in that?

Ah thanks a lot Velo this is great, this could really help me out :)

Thanks..:)

Just a question;

Would this file go into the www directory or the base directory with public ftp, tmp, www, mail etc?

I don't want to have it on my site thinking that I've put it in the right directory and it works when it doesn't :p

to block access to the admin directory.. will it be able to use the directory?? cause both my Mod and Admin directories are using .htaccess, and require a password.