Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > vBulletin 2.x > vBulletin 2.x Full Releases
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
List Search engine Spider at Who's online Details »»
List Search engine Spider at Who's online
Version: 1.00, by Stadler Stadler is offline
Developer Last Online: Jul 2018 Show Printable Version Email this Page

Version: 2.2.x Rating:
Released: 06-07-2003 Last Update: Never Installs: 13
 
No support by the author.

I've created this hack, cause I wanted to see, when search engine spiders are browsing my forums.

This hack adds a textbox, where you can enter a list of Spider-IPs, so they would be recognized as 'Search engine spider' on who's online.

I'm using the lists from www.iplists.com right now and it seems to work without problems, though I've had to add some IPs from Inktomisearch that aren't listed there.

First I've used parts of the banip-function, but that was really slow then, so I've had to tweak it. Now its only slightly slower, than without it. You won't even recognize it.

I've ported it to the banip-function in order to reduce server-load, when using a big list of banned IPs. I'll release that, when I'm finished here.

Screenshots:
Search engine spider browsing forums
New textbox to add IPs in Admin-CP

PS: I'd be happy, if you only click install, if you really installed it, since I want to know, how many really installed it and since I need feedback.

I've added a version, that uses the useragent rather, than using an IP-List. I recommend using spiderips_useragent.txt from now on.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #32  
Old 03-21-2004, 07:59 PM
Dimitrix Dimitrix is offline
 
Join Date: Mar 2002
Location: Pittsburgh, PA
Posts: 31
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Great hack,
works like a charm

So far only GoogleBots bother me but Ill keep my eyes open
Thanks again
Dimitry
Reply With Quote
  #33  
Old 03-31-2004, 03:44 AM
Highlander Highlander is offline
 
Join Date: Apr 2002
Posts: 188
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

i have a problem with a new searchbot .. ..always when he is coming.. i have the error displayed on the screen and he is messig up the whole db .. i will loose the mysql server if i dont switch the forum offline .. he is making a server load of 7 or more .. normaly when i have 100 users online i have maybe a server load of 0.5 maximum 1.2 ..the sql server crashes when this bot is coming..

what i can do? deinstall this hack?
Reply With Quote
  #34  
Old 03-31-2004, 03:46 AM
Highlander Highlander is offline
 
Join Date: Apr 2002
Posts: 188
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

in index.php on 219 it writes following code:
PHP Code:
 if (!(preg_match("/$webrobot/i"$loggedinrobots) )) $loggedinrobots .= $webrobot ", "
need help.. quickly please .. it crashes nearly every three ays my server when he comes for a crawl

(server: dual xeon SQL server!)
Reply With Quote
  #35  
Old 03-31-2004, 12:17 PM
Stadler Stadler is offline
 
Join Date: Apr 2002
Location: Kiel, Germany
Posts: 142
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

That hack doesn't affect index.php or any other file, except online.php, so this hack is hardly related to this. You have to find out, which requires you to apply the change you've posted above.

btw: which version of MySQL is your Database-Server running?
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 12:13 AM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.03788 seconds
  • Memory Usage 2,239KB
  • Queries Executed 19 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)bbcode_php
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (5)post_thanks_box
  • (5)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (5)post_thanks_postbit_info
  • (4)postbit
  • (5)postbit_onlinestatus
  • (5)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete