[ScottA]

Originally Posted by pets.ca

Hi there,

I am looking for a search engine that could be used to spider my entire site (about 10,000 pages). VB's search engine works well but I would like to expand it to include ALL .htm pages as well as additional php/sql pages.

Is there a hack or way that I could do this? I have tried other search engines but they end up including multiple instances of the same page or inappropraite pages (e.g., profile pages, print pages, etc).

Also, by using one search engine, I could have the same engine on the VB pages as on the rest of my site.

Help would truly be appreciated.

Dave@pets.ca

Well, you could try using another search engine to spider your site. There is an old tutorial on DevShed.com I used 2-3 years ago to create a PHP interface for ht://Dig. You can see my version in use at NissanPerformanceMag.com. The forums are on a separate site, so this doesn't search both the "static" content and the vB pages, though I suppose it could.

When I was searching on DevShed.com to dig up the link I came across another article that appears to be much more up to date.