vb.org Archive - Help w/ spiders

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- vB3 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=111)

- - Help w/ spiders (https://vborg.vbsupport.ru/showthread.php?t=120156)

kofoid

07-02-2006 07:07 PM

Help w/ spiders

Hi all- I need some help with blocking a single spider from my site - I have NO CLUE if it's robots.txt, spiders.txt, etc.... I also don't know how to list the spiders... Can I put IP ranges? Can someone give me some examples/samples.

Many many thanks in advance!

lsgworldl

07-09-2006 01:26 PM

<a href="http://www.delphifaq.com/faq/web_publishing/f760.shtml" target="_blank">http://www.delphifaq.com/faq/web_publishing/f760.shtml</a>

All times are GMT. The time now is 02:39 PM.

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.00974 seconds Memory Usage 1,699KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)post_thanks_navbar_search (1)printthread (2)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: