View Full Version : Robots.txt for VB5
Spangle
05-11-2014, 05:52 PM
Does anyone have a suitable robots.txt for VB5, if they do could they post it up ?
Zachery
05-11-2014, 09:15 PM
Define suitable, what one person wants, another possibly doesn't.
Spangle
05-12-2014, 02:12 PM
Define suitable, what one person wants, another possibly doesn't.
True... I suppose I was being a bit too general.
I meant one that has all the common URL's that you don't want bots to look at, members.php, etc.
sparkybp
05-23-2014, 12:19 AM
bump for this! my content is not being shown in the snippets, only my custom text for the message displayed on top of yellow highlighting displayed to non-logged in or non-registered users.
vBulletin® v3.8.12 by vBS, Copyright ©2000-2025, vBulletin Solutions Inc.