Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > vBulletin 2.x > vBulletin 2.x Full Releases
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
Details »»

Version: , by Overgrow Overgrow is offline
Developer Last Online: Jun 2004 Show Printable Version Email this Page

Version: 2.0.x Rating:
Released: 04-29-2001 Last Update: Never Installs: 53
 
No support by the author.

I am tired of my 200,000 posts not being listed in Google. I was inspired by phpbuilder.com this morning and I wrote:

vbSpiderFriend - the search engine indexer for all of your posts

Purpose: Allow search engine spiders to crawl a linked list of all of your posts.

Project Requirements:

-Friendly URLs (no query strings)
-Good dynamic meta tags
-Never have to touch the script again.. It is Y3K compliant, simply re-submit to the engines to update your listings

Install Requirements:

-vBulletin 1.x or 2.x
-about 10 minutes


1) Download the attached Zip.

2) Open class.mysql.php and put your database login info at the top.

3) Create a new directory called archive under your forum, like /forum/archive

4) Open the included .htaccess and change the Error 404 to your new archive path.

5) Open index.php and change the self-explanatory variables at the top of the file.

6) Upload all 3 files to your archive directory.

7) Submit /forum/archive/index.php to search engines and watch em crawl


DISCLAIMER: I don't use 2.x but I checked the schema and this should work fine.

NOTES: This uses ErrorDocument and query string parsing to get the variables needed. I do not have the time or energy to troubleshoot this if it does not work on your server. Sorry!

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #202  
Old 03-09-2002, 05:45 AM
buro9 buro9 is offline
 
Join Date: Feb 2002
Location: London, UK
Posts: 585
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

yeah, sorry!

what with the upgrade to 2.2.3b, i lost a few evenings whilst i upgraded and re-applied hacks for the four boards i run.

i'm busy this wekeend, but i've booked monday off work specifically to add the final touches (the indexer), i'll open a thread in beta's and place a link to it from here on moday afternoon.

so you can download and try it then

cheers

david k
Reply With Quote
  #203  
Old 03-09-2002, 02:19 PM
Brian Brian is offline
 
Join Date: Nov 2001
Posts: 35
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

cool
Reply With Quote
  #204  
Old 03-11-2002, 06:39 PM
buro9 buro9 is offline
 
Join Date: Feb 2002
Location: London, UK
Posts: 585
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

OK, I have created a thread in beta's.

https://vborg.vbsupport.ru/showthrea...358#post228358

Having spent the day doing nothing that I wanted, but simply upgrading everything to 2.2.4 I am fuming at vb...
I hope to find time to finish this hack just as soon as vb can release a version that is stable!
Reply With Quote
  #205  
Old 03-11-2002, 08:24 PM
limey's Avatar
limey limey is offline
 
Join Date: Dec 2001
Location: -
Posts: 187
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I feel like a jackass...this hack used to work for me until I recompiled apache...

Now the index page pulls up the forums, but the archive pages end up with 404 errors.

I have tried:

-changing the httpd.conf AllowOverride All
-adding a special directory addition to my domain.conf file..
-restarted apache a bunch of times.

.htaccess is setup as
ErrorDocument 404 /archive/index.php

I dont use srm.conf or access.conf. Everything is in httpd.conf.

I recompiled apache and php last night. Maybe this has something to do with it? I doubt it though. I did recompile php without --with-apache flag and I stil ldon't know if that matters.

thanks.
Reply With Quote
  #206  
Old 03-12-2002, 10:50 PM
eva2000's Avatar
eva2000 eva2000 is offline
 
Join Date: Oct 2001
Location: Brisbane, Australia
Posts: 577
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by buro9


eva2000, I shall endeavour to make sure that this does not generate files for private forums. This will be perfect for you since entering private forum id's would not be possible, since the files are static. Though it should be noted that as this will generate static files... should you later turn a public forum private then you would have to delete those files manually, hence including the $forumId in the proposed folder structure.

Proposed storage:

The folder structure...

$forumpath/archive/$forumId/$year/$month/$day

For the file names...

$postId.htm

I shall start this on Tuesday next week, and hope to have it finished by Saturday next week (I'd do it sooner, but it's my birthday and this isn't that important!).

The files will be standalone and I shall develop them with vb v2.2.2 though as I shall only be accessing user, post, thread and forum (I guess... I'll have to look at the schema) this should be backwards compatible to at least 2.x boards. Though I will only be supporting the latest version at any time.

If I run into trouble or need assistance with the schema I shall let you know.
i knew there's a reason i should use email notifications

how about having the ability to rerun a script to regenerate the static html files if you later change a public forum to private ? you could have a forumid setting in the script which you can edit to either

1. remove all static html files and recreate the static files based on new forumid settings

OR

2. remove only the static html files for the forumid which when private

would be nice to be able to have the option to set the path to where the static html files are to placed
Reply With Quote
  #207  
Old 03-13-2002, 05:32 AM
buro9 buro9 is offline
 
Join Date: Feb 2002
Location: London, UK
Posts: 585
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

You should really post on the thread in the beta's forum.
I hate to have hijacked this one, which is for someone else's release.

Anyhow, deleting by forumid, threadid, or time range is definately something that could be accomodated, since it would only really mean having to delete certain folders and their contents.

Though to be honest, this would be something built after the initial release.

Phase 1 will concentrate on generating the files.
Phase 2 can be the management of them, including deletions.
Phase 3 can be any advanced formatting and/or allowing multiple templates for cross-platform archives.

Cheers

David K
Reply With Quote
  #208  
Old 03-14-2002, 04:02 PM
drazq drazq is offline
 
Join Date: Jan 2002
Posts: 9
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Hi,

I just installed the hack - and it works ...

however, there seems to be a bug in it .. Not all messages are shown. Eg. in a week with 10 messages, maybe 6-7 are shown in the archive ..

any clues to why I have this problem?

- draz Q.
Reply With Quote
  #209  
Old 03-14-2002, 07:29 PM
buro9 buro9 is offline
 
Join Date: Feb 2002
Location: London, UK
Posts: 585
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally posted by drazq
Hi,

I just installed the hack - and it works ...

however, there seems to be a bug in it .. Not all messages are shown. Eg. in a week with 10 messages, maybe 6-7 are shown in the archive ..

any clues to why I have this problem?

- draz Q.
Not really, it's hard to determine the reason why not all of the posts were generated... the following spring to mind:

The 7 day date range is too specific, and you calculation of 10 in a week is based upon a more broad range.
Some posts may be in hidden forums, that only administrators and mods could see.

I would really need to have a dump of your database and re-create the problem here to be able to debug thoroughly.

I have tested on a forum of 49,767 posts, and simply right click the archive folder, and the file count matched perfectly. That said, I do not have hidden forums... but the queries are based upon guest access so these should be excluded from any caching.

For a proof of concept, extend the days younger range to several thousand, this should act as a catch-all and generate for all posts ever (it takes a while!, make a cup of tea)... this way you can verify against the not-logged in users post count on the forum home page.

Cheers

David K
Reply With Quote
  #210  
Old 03-14-2002, 08:15 PM
drazq drazq is offline
 
Join Date: Jan 2002
Posts: 9
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Well,

Just now I posted a new post in one of my open forums, and it didn't show up in 2002 - March - Week 3 or Week 4. It should be there right ..

- draz Q.
Reply With Quote
  #211  
Old 03-14-2002, 10:22 PM
pigsy pigsy is offline
 
Join Date: Nov 2001
Posts: 61
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Those folks that have installed this hack, have you seen a significant increase in traffic coming from Google?
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 11:14 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04613 seconds
  • Memory Usage 2,312KB
  • Queries Executed 27 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (2)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (11)post_thanks_box
  • (11)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (11)post_thanks_postbit_info
  • (10)postbit
  • (11)postbit_onlinestatus
  • (11)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete