heres why I ask, I have a htaccess "mod" that hides robots.txt from everyone but the big 3 robots.
part of this is adding the MIME type to treat the txt as a php file, and at the beginning of robots.txt Ive added the line
Code:
<?php include("index.php?do=something"); ?>
then I've put the "something" call in my index.php file (non vB index)
it appears to work, and when I try and load the robots.txt file in my browser I'm thrown back to the main index......working as it should.
I'm really wondering if the include is loading the entire index.php file, or if it really is just loading that little piece of code to do the bot check.