The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
Bots
How i prevent bots from crawling on my website/forum?
|
#2
|
|||
|
|||
There's a bunch of mods having to do with spiders, just search for spider or spiders. There's this one for instance: www.vbulletin.org/forum/showthread.php?t=268208 which I think allows you to ban only the "bad" ones.
|
Благодарность от: | ||
Irishnotsane |
#3
|
|||
|
|||
Thanks, but is there a way to prevent them fullstop, as opposed to banning only the bad ones?
|
#4
|
|||
|
|||
I think you can create a file called robots.txt and upload it. Here's a link to a site about that: http://www.robotstxt.org/robotstxt.html . To be honest it's been so long since I've dealt with that stuff myself that I don't know how well it works. But like it says on that site, it depends on bots voluntarily obeying your rules. If they choose not to, then I don't see that you have any choice other than to try to ban them by user agent, or maybe ip (although I'm guessing that doesn't work all that well).
|
#5
|
|||
|
|||
Ah right, so by adding
Quote:
So by having this, plus that product, it should get rid of 90% (or so) of bots? |
#6
|
|||
|
|||
I'm not sure about that, but I'm pretty sure lots of other people around here will be able to comment....
|
#7
|
||||
|
||||
These days what you're talking about are generally called "spiders", with 'bots' being spam bots. You rarely want to ban spiders - they are your friends.
Spiders Display on Forumhome and Who's Online for vb4 |
Благодарность от: | ||
Irishnotsane |
#8
|
|||
|
|||
What do these "Spiders" even do?
I don't really want them on my forum regardless of if they're my friends or not, I want it to be just me and my members so I'd rather stay off Google and other search engines.. I own a small community based forum where users are invited in, so pointless being on Google anyway. |
#9
|
|||
|
|||
the link in post 2 is the best to stop bots the bad ones that is
|
Благодарность от: | ||
Irishnotsane |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|