robots.txt for keeping certain forums from being indexed/spidered? - vb.org Archive

		vb.org Archive > vBulletin 3 Discussion > vB3 General Discussions
robots.txt for keeping certain forums from being indexed/spidered?

Reply

#1

Old

12-07-2007, 12:43 PM

DFC99

DFC99 is offline

Join Date: Nov 2007

Posts: 5

Благодарил(а): 0 раз(а)

Поблагодарили: 0 раз(а) в 0 сообщениях

Default

robots.txt for keeping certain forums from being indexed/spidered?

Hi, I've got a few forums (e.g. f=46) on my forum (such as the sandbox and off-topic) which are open to everyone to see, but I don't want them spidered by google and other search engines. Is there a way of doing this using robots.txt? Thanks

!

Reply With Quote

#2

Old

12-07-2007, 05:54 PM

ssslippy

ssslippy is offline

Join Date: Jan 2006

Posts: 877

Благодарил(а): 0 раз(а)

Поблагодарили: 0 раз(а) в 0 сообщениях

Default

Not all search engines follow the robots.txt. So this wouldnt quite work.

Reply With Quote

Reply

« Previous Thread | Next Thread »

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules

Forum Jump

All times are GMT. The time now is 06:59 PM.