vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Modification Graveyard (https://vborg.vbsupport.ru/forumdisplay.php?f=224)
-   -   Miscellaneous Hacks - Spider Display (https://vborg.vbsupport.ru/showthread.php?t=171322)

dave9720 05-05-2008 02:28 PM

Quote:

Originally Posted by Boofo (Post 1509157)
Do the Google dance for robots.txt. ;)

lol :D Thanks Boofo

JadedSouls 05-19-2008 09:00 PM

*installed*

Boofo 05-19-2008 09:09 PM

It sure took you long enough to find this. ;)

lee246 05-20-2008 03:22 PM

The spiders seems to be showing as guests on my forum. How can I fix it please?

Boofo 05-20-2008 03:34 PM

Read the install file and do the config.php file edit.

lee246 05-20-2008 04:21 PM

Thanking you.

odeezie 05-20-2008 11:30 PM

Not important, just want to do as a goof, but is there a way to change the display name "spiders" to something else?

Thanks!

Boofo 05-20-2008 11:43 PM

Have you looked at the phrase for this mod? ;)

odeezie 05-20-2008 11:51 PM

Quote:

Originally Posted by Boofo (Post 1526279)
Have you looked at the phrase for this mod? ;)

No, I dont really know where to look, or what to look for. :confused:

Edit: Wait wait...Language and Phrases, Phrase Manager, Who's Online, Spiders, then edit it?

Boofo 05-21-2008 12:03 AM

Yes, it would be in the phrase manager. Just do a text search for the word spiders.

odeezie 05-21-2008 12:06 AM

Quote:

Originally Posted by Boofo (Post 1526293)
Yes, it would be in the phrase manager. Just do a text search for the word spiders.

I did a search in phrases for spiders and there were five results that came back:

Who's Online Phrases Containing 'Spiders'
vBulletin Settings Phrases Containing 'Spiders'
GLOBAL Phrases Containing 'Spiders'
FAQ Text Phrases Containing 'Spiders'
Control Panel Help Text Phrases Containing 'Spiders'

Do I just edit the WHo's Online Phrase one? And when I click edit, I just have a blank text box for translations...is that where I edit it?

odeezie 05-21-2008 12:14 AM

If I use the find and replace tool will that work correctly. "Spiders" as the search for text and "New Name Here" as the replace with text?

Boofo 05-21-2008 01:15 AM

If you will look at the bottom of the XML file, you will see that:

x_members_y_guests_and_z_spiders

is the phrase you want to edit. That is the first place to check on any mod.

Bonus Paradise 05-21-2008 08:49 AM

many thanks for this hack
I installed it and I absolutely love it
:)

shofolofo 05-21-2008 09:06 AM

seems good from other people quotes ..

i didn't understand what it is exactly doing .. I mean .. you can always see crawlers in whoisonle page .. what makes this special ?


P.S : I pressed install = I want support

:p

Bonus Paradise 05-21-2008 09:09 AM

oh 1 question
if i check who is online
I see googlebot is there
but it say 0 spiders in the who is online bar
bot shows up as guest
Currently Active Users: 4 (2 members, 2 guests and 0 spiders)

Boofo 05-21-2008 09:39 AM

Quote:

Originally Posted by shofolofo (Post 1526629)
seems good from other people quotes ..

i didn't understand what it is exactly doing .. I mean .. you can always see crawlers in whoisonle page .. what makes this special ?


P.S : I pressed install = I want support

:p

You will see the number of spiders on the Who's Online page now as well as the number of spiders and their names on the forumhome.

Quote:

Originally Posted by Bonus Paradise (Post 1526632)
oh 1 question
if i check who is online
I see googlebot is there
but it say 0 spiders in the who is online bar
bot shows up as guest
Currently Active Users: 4 (2 members, 2 guests and 0 spiders)

You need to do the config.php file edit.

Bonus Paradise 05-21-2008 10:17 AM

Quote:

Originally Posted by Boofo (Post 1526653)
You will see the number of spiders on the Who's Online page now as well as the number of spiders and their names on the forumhome.



You need to do the config.php file edit.


yes i added this my includes/config.php what you say
maybe i did something wrong
the end of my includes/config.php looks now so ...

Code:

// Image Processing Options
        // Images that exceed either dimension below will not be resized by vBulletin. If you need to resize larger images, alter these settings.
$config['Misc']['maxwidth'] = 2592;
$config['Misc']['maxheight'] = 1944;

if(THIS_SCRIPT == 'index')
{
global $specialtemplates;
$specialtemplates = array_merge($specialtemplates, array('wol_spiders'));
}

/*======================================================================*\
|| ####################################################################
|| # Downloaded: 17:11, Fri May 2nd 2008
|| # CVS: $RCSfile$ - $Revision: 25157 $
|| ####################################################################
\*======================================================================*/


Boofo 05-21-2008 10:43 AM

And you uploaded the spiders xml?

Bonus Paradise 05-21-2008 10:46 AM

Quote:

Originally Posted by Boofo (Post 1526701)
And you uploaded the spiders xml?

yes i did all step by step :confused:

Bonus Paradise 05-21-2008 10:49 AM

here it is
http://www.bonusparadise.com/forum/i..._vbulletin.xml
so I really dont know what is wrong

Boofo 05-21-2008 10:53 AM

Then you need to redo it as you missed something somewhere.

Bonus Paradise 05-21-2008 11:00 AM

Quote:

Originally Posted by Boofo (Post 1526722)
Then you need to redo it as you missed something somewhere.

ok i will try this then again
want to thank you and all others here for the great work you do

Regards
Marina

Boofo 05-21-2008 11:01 AM

Let me know if you are still having problems after you re-install this. ;)

indie2industry 05-21-2008 12:25 PM

works perfectly for me

Stubbed 05-22-2008 08:24 AM

Heh. When I first installed this mod, I completely left out the config.php edit, I didn't even read that part on this post or the install.txt - No idea how that happened. I just assumed I had no spiders browsing at all. Then over the space of a week I kept checking the "Who's online" and obviously seeing them in there and thought I'd give this a go again, and noticed the config.php edit.

Works perfectly, Brilliant mod Boofo.

My only one smallll suggestion/how to: Make the spiders link to their "info" tag. They look out of place with just the nonlinked text :cool:

Boofo 05-22-2008 08:49 AM

Linking the Spiders would not be possible as alot of spiders don't have a link.

shofolofo 05-22-2008 10:30 AM

would I be stupid if I asked for a screenshot of the result ?

I installed it but dunno yet where is the change or iam not a good observer

Boofo 05-22-2008 11:24 AM

On the forumhome:

Quote:

Currently Active Users: 2 (1 members, 0 guests and 1 spiders)

Boofo, Yahoo! Slurp
Who's Online:

Quote:

1 members, 0 guests and 1 spiders

shofolofo 05-22-2008 11:38 PM

ahaaaa


Great :)

Thanks boofo
:)

davemac 05-27-2008 03:36 PM

I like the idea here but I don't want all my users seeing the spiders. Have you considered an option to display this information on the admin panel only? Like and an extension of this mod.

Thanks,

davemac 05-27-2008 05:52 PM

Quote:

Originally Posted by davemac (Post 1533043)
I like the idea here but I don't want all my users seeing the spiders. Have you considered an option to display this information on the admin panel only? Like and an extension of this mod.

Thanks,

Nevermind. I've combined these two mods adding the spider detection code to the admin panel one listed above. I'll mark installed regardless as all the spider detection code is from this mod.

Cheers.

Boofo 05-27-2008 06:08 PM

How is that going to work when the code needs to be on the forumhome and Who's online?

Vinyljunky 05-28-2008 11:56 AM

Installed and working :up:

However it doesnt seem to be identifying this spider (I guess its a spider)
livebot-65-55-165-109.search.live.com

Thanks

VinylJunky

lolitka 05-28-2008 12:33 PM

Quote:

Originally Posted by Vinyljunky (Post 1533987)
However it doesnt seem to be identifying this spider (I guess its a spider)
livebot-65-55-165-109.search.live.com

I had same problem with one of googlebots. It was called as a guest and in the IP info it has something like crawler-google.com or sth like this.

What can we do to prevent before something like this again?

Cheers!

Boofo 05-28-2008 01:22 PM

Make sure you have the latest spiders xml uploaded to the includes/xml directory. Spiders are recognized by their User Agent, not their resolved IP. If you check the User Agent on those you will see they look like normal users.

Vinyljunky 05-28-2008 01:34 PM

Quote:

Originally Posted by lolitka (Post 1534012)
I had same problem with one of googlebots. It was called as a guest and in the IP info it has something like crawler-google.com or sth like this.

What can we do to prevent before something like this again?

Cheers!

I guess the spiders.xml needs updating, but I dont know the best source for accurate info.

Can anybody advise?

Thanks

VJ

Boofo 05-28-2008 02:10 PM

You're not understanding how it works. You can't update the xml with the IP info as vb identifies spiders by their User Agent only. If the spider info is not in the UA, vb sees it as a guest, no matter what the IP resolves to.

Vinyljunky 05-28-2008 02:55 PM

Quote:

Originally Posted by Boofo (Post 1534075)
You're not understanding how it works. You can't update the xml with the IP info as vb identifies spiders by their User Agent only. If the spider info is not in the UA, vb sees it as a guest, no matter what the IP resolves to.


Ah thank you, I understand now :)

So I guess that means one of three things?
- The Live Search spiders dont use/display user agent info
- The Live Search spider agent info isnt in the xml file
- It wasnt a spider

Is that a fair assumption?

Thanks

VJ

Amenadiel 05-28-2008 03:04 PM

Well, I was browsing this mod when I noticed that a similar mod for VB 3.6 that I was still using is now in the graveyard. ¿Why? I don't know, but I deinstalled that one, installed this one and now I'm seeing a lot of robots I didn't see before. Baidu, Technorati, Twiceler... I'm loving this.


All times are GMT. The time now is 12:40 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01519 seconds
  • Memory Usage 1,819KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (14)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (3)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete