vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Modification Requests/Questions (Unpaid) (https://vborg.vbsupport.ru/forumdisplay.php?f=112)
-   -   VB Search engine wanted to spider my entire site (https://vborg.vbsupport.ru/showthread.php?t=68984)

pets.ca 09-01-2004 10:16 PM

VB Search engine wanted to spider my entire site
 
Hi there,

I am looking for a search engine that could be used to spider my entire site (about 10,000 pages). VB's search engine works well but I would like to expand it to include ALL .htm pages as well as additional php/sql pages.

Is there a hack or way that I could do this? I have tried other search engines but they end up including multiple instances of the same page or inappropraite pages (e.g., profile pages, print pages, etc).

Also, by using one search engine, I could have the same engine on the VB pages as on the rest of my site.

Help would truly be appreciated.

Dave@pets.ca

dshankle 09-02-2004 09:47 AM

As a fairly new user of vbulletin I would be interested in any thoughts on this as well. I would like to use it as my home page and if one search could catch the threads as well as my library of documents in word, access, powerpoint, etc. that would be great.

Thanks for any help, suggestions or guidance.

ScottA 09-02-2004 01:08 PM

Quote:

Originally Posted by pets.ca
Hi there,

I am looking for a search engine that could be used to spider my entire site (about 10,000 pages). VB's search engine works well but I would like to expand it to include ALL .htm pages as well as additional php/sql pages.

Is there a hack or way that I could do this? I have tried other search engines but they end up including multiple instances of the same page or inappropraite pages (e.g., profile pages, print pages, etc).

Also, by using one search engine, I could have the same engine on the VB pages as on the rest of my site.

Help would truly be appreciated.

Dave@pets.ca

Well, you could try using another search engine to spider your site. There is an old tutorial on DevShed.com I used 2-3 years ago to create a PHP interface for ht://Dig. You can see my version in use at NissanPerformanceMag.com. The forums are on a separate site, so this doesn't search both the "static" content and the vB pages, though I suppose it could.

When I was searching on DevShed.com to dig up the link I came across another article that appears to be much more up to date.

pets.ca 09-02-2004 02:55 PM

My question, however, is will this approach use the exisitng VB Search? I only want one search engibe for my entire site (VB forums and the rest of the site)

ScottA 09-02-2004 03:25 PM

No. I don't know how to modify the vB search to work as a spider so it will search an entire site. That's why I suggested looking into using something else. I used ht://Dig, but because I have my forums under a separate domain it doesn't search both, though I don't see why it isn't possible.


All times are GMT. The time now is 01:42 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.00944 seconds
  • Memory Usage 1,719KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (5)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete