vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB3 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=111)
-   -   Yandex Crawler (https://vborg.vbsupport.ru/showthread.php?t=326335)

oldengine 04-24-2018 04:11 AM
Yandex Crawler
 
The Yandex Russian crawler is trying to crawl me like this...

https://vbulletin.org/forum/index.php/read/72116

Vbulletin.org is showing the same effect as does my board.

The full URL looks like this...

https://vbulletin.org/forum/index.ph...ve/archive/arc

Code:
https://vbulletin.org/forum/index.php/read/72116&expand/archive/chat/chat/chat/chat/chat/archive/archive/chat/chat/archive/chat/chat/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/arc
Any clue about what they are attempting to accomplish?

Any way to halt this behavior?

IPs
141.8.43.172
52.90.254.43
100.43.90.161
5.255.250.121

Mattwhf 05-05-2018 11:12 AM
Why you are worrying about Yandex Crawler is crawling your website?

If you want to block Malicious Bots / Crawlers using .htaccess then reading tips in this post

https://forumweb.hosting/9415-block-...-htaccess.html

Hope it helps!


All times are GMT. The time now is 02:47 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01710 seconds
  • Memory Usage 1,710KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (2)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete