vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3 Articles (https://vborg.vbsupport.ru/forumdisplay.php?f=187)
-   -   Howto : Enable FullText Searching in vBulletin 3.0.2/3 (https://vborg.vbsupport.ru/showthread.php?t=66789)

buro9 10-29-2004 09:42 AM

Is it me or does the "Find In Thread" functionality fail with this turned on? Is there a quick fix to this?

I've merged boards and fulltext searching means that I won't have to rebuild search indexes on a 300,000+ post forum.

I'm merging again soon to go over the 500,000+ post mark, and I'll have the same request then too ;)

mickmel 11-02-2004 12:41 PM

I'm on version 3.0.3, with debug mode on, but there's no "full text" option in the "version info and other untouchables" section (or anywhere else, for that matter). Did they move (or remove) the fulltext option in 3.0.3?

buro9 11-02-2004 12:46 PM

Quote:

Originally Posted by mickmel
I'm on version 3.0.3, with debug mode on, but there's no "full text" option in the "version info and other untouchables" section (or anywhere else, for that matter). Did they move (or remove) the fulltext option in 3.0.3?

You're looking in the AdminCp right? Under vBulletin Options?

mickmel 11-02-2004 01:21 PM

Quote:

Originally Posted by buro9
You're looking in the AdminCp right? Under vBulletin Options?

Yep. Admin CP --> vBulletin Options --> Version Info and Other Untouchables

The options in there are:
-vBulletin Version Number
-Save Attachments as Files
-File Attachment Path
-Save Avatars as Files
-Avatar File Path
-Avatar URL
-WYSIWYG Use DIV not P
-BB Code Parser Function

Then the [save] and [reset] buttons, and the debug box below that.

Am I just missed something dumb here? :)

mickmel 11-02-2004 05:33 PM

I've looked everywhere (both in my AdminCP and online for answers) and can't find this option. Anyone have an idea where it might be?

M1th 11-02-2004 05:40 PM

Quote:

Originally Posted by mickmel
I've looked everywhere (both in my AdminCP and online for answers) and can't find this option. Anyone have an idea where it might be?

As stated in the first post:

You'll need to shut your boards down for security reasons and
enter debug mode, or enable debug mode for yourself only.


So...

PHP Code:

$debug 1

Add that in your config.php file.

mickmel 11-02-2004 05:43 PM

Quote:

Originally Posted by M1th
As stated in the first post:

You'll need to shut your boards down for security reasons and
enter debug mode, or enable debug mode for yourself only.


So...

PHP Code:

$debug 1

Add that in your config.php file.

Right. I did all of that. Then I go to the Admin CP, then to vBulletin Options, and the Version Info and Other Untouchables option is there. I go into that, but don't see an option for fulltext. All I see are:
-vBulletin Version Number
-Save Attachments as Files
-File Attachment Path
-Save Avatars as Files
-Avatar File Path
-Avatar URL
-WYSIWYG Use DIV not P
-BB Code Parser Function

I'm not sure why it's not there. Is it because I'm on 3.0.3 and not 3.0.2?

Zachery 11-02-2004 06:34 PM

Quote:

Originally Posted by mickmel
Right. I did all of that. Then I go to the Admin CP, then to vBulletin Options, and the Version Info and Other Untouchables option is there. I go into that, but don't see an option for fulltext. All I see are:
-vBulletin Version Number
-Save Attachments as Files
-File Attachment Path
-Save Avatars as Files
-Avatar File Path
-Avatar URL
-WYSIWYG Use DIV not P
-BB Code Parser Function

I'm not sure why it's not there. Is it because I'm on 3.0.3 and not 3.0.2?

Its there in my 3.0.3... how did you upgrade?

mickmel 11-02-2004 07:12 PM

Quote:

Originally Posted by Zachery
Its there in my 3.0.3... how did you upgrade?

Nothing out of the ordinary. I've been slowly upgrading since we started back on version 1.something. Do you know what file I might be out of date on and I'll make sure to reupload that correct one?

mickmel 11-03-2004 11:48 AM

I've re-uploaded all of the files in the "admincp" directory, but I still don't have the fulltext option in there. Where is a setting like that stored?

Zachery 11-03-2004 03:05 PM

Quote:

Originally Posted by mickmel
I've re-uploaded all of the files in the "admincp" directory, but I still don't have the fulltext option in there. Where is a setting like that stored?

When you upgraded you made sure all the files were 3.0.3 and ran the upgrade scripts? If you dont see that option its telling me that the new vboptions.xml didnt get uploaded before you finished the upgrade.

mickmel 11-04-2004 12:56 AM

Quote:

Originally Posted by Zachery
When you upgraded you made sure all the files were 3.0.3 and ran the upgrade scripts? If you dont see that option its telling me that the new vboptions.xml didnt get uploaded before you finished the upgrade.

I'm not sure what happened. The last few upgrades went successfully. The problem was a missing entry in the options table (I think that's the name). Anyhow, it's working now.

Next problem... :)

I'm having problems getting one of the ALTER commands to work. After failing with the "post" one a few times, I tried the "thread" one. It completed successfully in just over 4 seconds. I'm running these queries via SSH.

I've run the "post" ALTER command a few times and it's never able to finish. I've repaired the table (no errors), optimized the table and flushed the index. It still won't finish. I might just be impatient, but I let it go for an hour and it hadn't finished. No error message, just no result. The thread table has about 78,000 records in it, the post table has about 1.3 million records in it.

The other strange thing is that my server load while it's working is almost nothing. It's at most 0.05. I would expect that if it was working that hard on the post index it would be putting more strain on the server.

So, the questions:

- Is a one hour wait for this a problem or am I just impatient? Given that the thread table takes 4 seconds and the post table has about 15 times more records, it should only take about 60 seconds, right?
- Is there a way to simplify the query into a few separate ones so that I can run them one at a time?
- Anything else I can do to optimize the table so this might run faster or finish?

Thanks,
Mickey

Zachery 11-04-2004 11:38 AM

ALTER commands usualy take a while, and I am not running this on my own board anymore so i cannot comment too much on it, I hope someone who has abit more knowleged about this can respond.

mickmel 11-04-2004 12:01 PM

In the hopes of speeding it up, I've cut the post ALTER command down a bit. Instead of:

ALTER TABLE post ADD FULLTEXT INDEX (title,pagetext)

I'm just doing

ALTER TABLE post ADD FULLTEXT INDEX (title)

Assuming it works, I'll do the pagetext as a separate query as well. Right now we're at 40 minutes and no sign of finishing.

The only reason I'm concerned about it taking so long is that the thread table completed so quickly.

I'll let it go a while longer and see what happens...

Mickey

Zachery 11-04-2004 01:07 PM

The post talbe is quite abit larger... have you configured mysql's setting since installing mysql? an unoptmized my.cnf/ini can be horrid for running larger querys like the alter querys.

mickmel 11-04-2004 01:21 PM

Quote:

Originally Posted by Zachery
The post talbe is quite abit larger... have you configured mysql's setting since installing mysql? an unoptmized my.cnf/ini can be horrid for running larger querys like the alter querys.

Yep. It's optimized and it's a fast server (dual Xeon, 2 gigs RAM, SCSI). We're at 2 hours now and it'll still working on it. This can't be right...

mickmel 11-04-2004 01:28 PM

Ok, I did a bit more digging and I might have found part of the problem. I was looking at the table in PHPMyAdmin, and found that it has a ton of indexes on it. Here is what it has...

Code:

Keyname          Type                  Cardinality          Action          Field
PRIMARY        PRIMARY        1526312          Drop        Edit        postid
dateline        INDEX                1526312          Drop        Edit        dateline
iconid                INDEX                15                  Drop        Edit        iconid
userid                INDEX                11924                  Drop        Edit        userid
threadid        INDEX                508770          Drop        Edit        threadid
                                                                userid
title                FULLTEXT        508770          Drop        Edit        title
                                                                pagetext
title_2        FULLTEXT        1526312          Drop        Edit        title
                                                                pagetext
title_3        FULLTEXT        508770          Drop        Edit        title
                                                                pagetext
title_4        FULLTEXT        1526312          Drop        Edit        title
                                                                pagetext
title_5        FULLTEXT        508770          Drop        Edit        title
                                                                pagetext
title_6        FULLTEXT        1526312          Drop        Edit        title
                                                                pagetext
title_7        FULLTEXT        508770          Drop        Edit        title

There are 1,526,312 rows in that table, so the ones that show that appear to be done. Should I drop all of the title indexes except for one that has all of the records (like title_2)? Or should I drop all of them and try to reindex?

Killsparer 01-01-2005 01:03 PM

Quote:

Originally Posted by buro9
Is it me or does the "Find In Thread" functionality fail with this turned on? Is there a quick fix to this?

Same problem. Any way to fix this?

buro9 01-08-2005 11:08 PM

Quote:

Originally Posted by Killsparer
Same problem. Any way to fix this?

This is now all working in vb 3.0.5 :D

Congrats to all for their hard work, it is VERY appreciated. :)

buro9 01-09-2005 12:55 PM

Does anyone know... are Similar Threads driven by the fulltext search too?

i.e. If I purge my word index tables, will I break anything now that most of this appears to be working?

Smitty 02-20-2005 11:23 PM

Good question.

What is the status on this? Are a lot of you using it successfully? I'm considering trying it.

mickmel 02-20-2005 11:43 PM

Quote:

Originally Posted by Smitty
Are a lot of you using it successfully? I'm considering trying it.

I've been using it on my largest site (1.6M posts) for a few months and it's been working very well.

Freddie Bingham 02-21-2005 02:27 AM

Quote:

Originally Posted by mickmel
I've been using it on my largest site (1.6M posts) for afew months and it's been working very well.

Personally, Iwouldn't recommend the 3.0.x fulltext search for large sites. Functionally, it works, but since it only used In Boolean mode, it canbe resource heavy. The 3.1 FullText search has options for Bololean andNatural Language search as well as many little optimizations throughout the code.

neocorteqz 02-21-2005 03:07 AM

You know , I've seen that option in the vB options in the admin CP. wanted to try it, but wasn't sure if I should. Now can I test it out woithout clearing my search index?? I'd rather not reindex the search index if this doesn't turn out good results.

Smitty 02-21-2005 08:11 AM

Thanks for the tip, Freddie. I'll have to read through the thread again so I better understand - You mean vB 3.0.x vs. a future 3.1 version of vBulletin?

My board isn't very big. The data and index of the database is only about 200 megabytes (attachments are in a separate directory).

I don't plan on doing this right now - maybe in a couple of weeks. Just scoping things out in advance.

nawialkair 06-27-2005 12:09 AM

Quote:

You'll need to shut your boards down for security reasons and enter debug mode, or enable debug mode for yourself only.
How do I enter the debug mode??

THanks

Marco van Herwaarden 06-27-2005 08:19 AM

Edit your config.php, and place the following line in it:
PHP Code:

$debug 1


LambHyjoo 03-29-2006 11:36 PM

Hi, I just switched to FullText Search with Vbulletin 3.0.13

I would like to know if the FullText Search is know more stable than it was in the past ? Is it better than the FullText Hack provided by JohnWoo (https://vborg.vbsupport.ru/showthrea...light=fulltext)

Last question : Except the two queries (Index stuffs with Post and Thread tables) and the "vboption[fulltext] = 1", am I supposed to do something else ?

Thanks in advance for your answears !

/Edit : One more question :D The Relevance Search doesn't seem to work with Fulltext ?


All times are GMT. The time now is 05:50 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01948 seconds
  • Memory Usage 1,823KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (3)bbcode_php_printable
  • (14)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (28)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete