vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.0 Full Releases (https://vborg.vbsupport.ru/forumdisplay.php?f=33)
-   -   Fulltext boolean search v.2.2 for vB (https://vborg.vbsupport.ru/showthread.php?t=62282)

JohnWoo 03-26-2004 05:11 AM

yes... if it take more then 30-40 minutes, it is better to drop fulltext index, do flush, repair table, optimise table and after it try to create index again.
PS on one my friend's forum with ~1.6mln posts it took 28 minutes to create index :)

JonP 03-26-2004 12:24 PM

Took me 9 hours and 30 minutes to index.

Now I can't post or delete threads :(

JonP 03-26-2004 12:31 PM

Btw, was reindexing through a mysql shell prompt not vbulletin.

JohnWoo 03-26-2004 01:43 PM

then what error message you have when you "can't post or delete threads"?
and i still think that 9 hours is not normal...
and still recommend to try again

ALTER TABLE post DROP INDEX pagetext
after it
ALTER TABLE post DROP INDEX title
after it
FLUSH TABLE post
after it
REPAIR TABLE post
after it
ALTER TABLE post ADD FULLTEXT (title)
after it
ALTER TABLE post ADD FULLTEXT (pagetext)
and after it
OPTIMIZE TABLE post

Nearly sure that it must take less then hour summary :)

JonP 03-26-2004 03:09 PM

Running a dedicated server only hosting the forum, P4 2.4ghz 1.5 gigs RAM, 1.3 million posts.

Right now I'm getting ready to revert back to my backed up database.

Takes forever to try and drop indexes, and/or repair table.

msimplay 03-27-2004 02:30 PM

hmm question whats in this hack that makes getting unanswered posts impossible

ie this hack should be simple but each time it returns 0 results

https://vborg.vbsupport.ru/showthrea...095#post491095

rikman 03-27-2004 07:02 PM

Quote:

Originally Posted by JonP
Took me 9 hours and 30 minutes to index.

Did you shut down your board while altering the tables? If there are queries waiting for access to the post table while it is locked, your machine load will grow high and higher. This has an affect on ALL tasks running on your machine, incl. creating the index columns at your post table.

rikman

Erwin 03-29-2004 09:34 AM

Any other large forums tried this yet? :)

msimplay 03-29-2004 10:07 AM

Quote:

Originally Posted by Erwin
Any other large forums tried this yet? :)

http://www.wass-up.com/forum/

has it installed i helped with the installation of it and we've not had any problems with it but there is one sacrifice which is similar threads
they don't seem to work with this hack

Boofo 03-29-2004 10:25 AM

The "Unanswered Threads" hack doesn't work with it, either, I am told.

msimplay 03-29-2004 10:47 AM

Quote:

Originally Posted by Boofo
The "Unanswered Threads" hack doesn't work with it, either, I am told.

lol yeh thats coz i tested it for ya :p

Boofo 03-29-2004 11:29 AM

And a good job you did. ;)

JohnWoo 03-29-2004 03:57 PM

it must start working after fix in latest v.1.9 :)

msimplay 03-29-2004 04:17 PM

any chance of upgrade instructions ?

JohnWoo 03-29-2004 04:31 PM

:)

1. after

// code block 5 added by [FullText Search hack] (getting list of posts with match against search phrase)

add

if (strlen($query) > 0) {

2. before

// end of code block 5 added by [FullText Search hack]

add

}


it is all :)

msimplay 03-29-2004 05:14 PM

thanks i didnt fancy rehacking the whole thing
does this now allow unanswered topics mod and similar threads ?

JohnWoo 03-29-2004 05:51 PM

unanswered topics mod - yes
similar threads - not, but thinking and think that it is near :)

msimplay 03-29-2004 07:20 PM

Quote:

Originally Posted by JohnWoo
unanswered topics mod - yes
similar threads - not, but thinking and think that it is near :)

good work :D

JohnWoo 03-29-2004 09:25 PM

ok :) Think that "Similar Threads" works with v.2.0 :)

msimplay 03-29-2004 10:34 PM

Quote:

Originally Posted by JohnWoo
ok :) Think that "Similar Threads" works with v.2.0 :)

yayyyyyy it works
but u made a tiny mistake

instead of searching for

PHP Code:

function fetch_similar_threads($threadtitle$threadid 0) { 

you should search for and replace

PHP Code:

function fetch_similar_threads($threadtitle$threadid 0

on step 4 of the install otherwise you get a parse error

JohnWoo 03-30-2004 06:34 AM

true... Uploading fixed txt

JonP 03-31-2004 04:49 AM

Quote:

Originally Posted by rikman
Did you shut down your board while altering the tables? If there are queries waiting for access to the post table while it is locked, your machine load will grow high and higher. This has an affect on ALL tasks running on your machine, incl. creating the index columns at your post table.

rikman

Yep, I completely shut down the forum, and the forum is the only thing on the dedicated server.

Erwin 04-01-2004 10:21 AM

Ooh... this is so tempting...

sabret00the 04-01-2004 10:26 AM

what does it do exactly and what's the advantage of having this installed?

msimplay 04-01-2004 10:37 AM

Quote:

Originally Posted by Erwin
Ooh... this is so tempting...

well it seems to be working perfect now
i have it installed with similar threads and unanswered posts
u can check at my website
Quote:

Originally Posted by sabret00the
what does it do exactly and what's the advantage of having this installed?

it removes the need for a search index hence making your database smaller and faster
extremely good for large sites
it will be standard in vb3.1 but don't know how long that will take
and large sites need it now

check this link for a better description of its capabilities
https://vborg.vbsupport.ru/showthrea...ighlight=mysql

Boofo 04-01-2004 11:16 AM

Quote:

Originally Posted by Erwin
Ooh... this is so tempting...

If you install this, Erwin, please let me know what you think of it. If you're brave enough, I may have a go at it. ;)

sabret00the 04-01-2004 11:54 AM

Quote:

Originally Posted by msimplay
well it seems to be working perfect now
i have it installed with similar threads and unanswered posts
u can check at my website
it removes the need for a search index hence making your database smaller and faster
extremely good for large sites
it will be standard in vb3.1 but don't know how long that will take
and large sites need it now

check this link for a better description of its capabilities
https://vborg.vbsupport.ru/showthrea...ighlight=mysql

thanks for explaining that, it's fairly exciting after reading that thread :)

Natch 04-01-2004 02:22 PM

I am running it - small board, but definite performance improvement ...

Plus I just like the fulltext searching bonus!

[size]and I'm a sucker for a hack not many have installed ...[/size]

msimplay 04-03-2004 08:30 AM

ok one problem theres an option when u make a new forum where it says do not index posts
traditionally this stops people from searching those forums
but with this hack to be able to do that
u have to be able to exclude forums from fulltext searching with the same setting

reason is because i have the unanswered post hack installed and also the news syndication hack installed

which means that all posts in the news area will always be unanswered
so i do not want them to be searchable

Dontom 04-03-2004 04:26 PM

Quote:

Originally Posted by msimplay
hey sorry for bugging you :p
i have found a new bug
when you search this thread it returns results from other threads

Same here, too.
Tom

dslteam 04-03-2004 07:36 PM

Hello!

Great Hack! We use vb3 gold with about 320.000 posts and I have just installed it. On our Dual AMD MP 2.5 Ghz - the installation (with these DB queries) took about 23 seconds.

The search performance is indeed much better now.

Thanks!

JohnWoo 04-03-2004 09:45 PM

Yes.. You are right msimplay. I missed that thing.
Uploading updated zip and to upgrage just change in search.php

Code:

//fast list of forums visible and searchable for user
        foreach ($bbuserinfo['forumpermissions'] AS $forumid => $fperms) {
                if (!($fperms & CANVIEW) OR !($fperms & CANSEARCH) OR !verify_forum_password($forumid, $forum['password'], false)) {
                        $not_forumid .= $forumid." ";
                }
        }

to
Code:

//fast list of forums not visible or searchable for user
        foreach ($bbuserinfo['forumpermissions'] AS $forumid => $fperms) {
                if (!($fperms & CANVIEW) OR !($fperms & CANSEARCH) OR !verify_forum_password($forumid, $forum['password'], false) OR !($forumcache[$forumid]["options"] & $_FORUMOPTIONS["indexposts"])) {
                        $not_forumid .= $forumid." ";
                }
        }


msimplay 04-03-2004 09:57 PM

Quote:

Originally Posted by JohnWoo
Yes.. You are right msimplay. I missed that thing.
Uploading updated zip and to upgrage just change in search.php

Code:

//fast list of forums visible and searchable for user
          foreach ($bbuserinfo['forumpermissions'] AS $forumid => $fperms) {
                if (!($fperms & CANVIEW) OR !($fperms & CANSEARCH) OR !verify_forum_password($forumid, $forum['password'], false)) {
                          $not_forumid .= $forumid." ";
                  }
          }

to
Code:

//fast list of forums not visible or searchable for user
          foreach ($bbuserinfo['forumpermissions'] AS $forumid => $fperms) {
                if (!($fperms & CANVIEW) OR !($fperms & CANSEARCH) OR !verify_forum_password($forumid, $forum['password'], false) OR !($forumcache[$forumid]["options"] & $_FORUMOPTIONS["indexposts"])) {
                          $not_forumid .= $forumid." ";
                  }
          }


that doesn't seem to work i can still search those forums
i tested with a another account thinking maybe it only applies to not admins
but no that doesn't seem to work

JohnWoo 04-03-2004 10:13 PM

hmm..
You are able to search in that forums typing "Key Words" in field on search page or you can see that forums after clicking some link (like unanswered post hack have)?

msimplay 04-03-2004 10:15 PM

i have a staff forum which has a post called reported in there
i used the nav drop down
and typed in report*

but it seemed to work on showthread
but again not with unanswered posts

obviosly normal registered members can't see it due to permissions
coz thats a staff forum

but what about forums that are not protected by permissions and are still viewable but just don't want them to be searchable
for example a test forum where people test signatures avatars bbcode etc

just tested again your hack works on
showthread
advanced search
forumdisplay

not navbar
not unanswered

JohnWoo 04-03-2004 10:28 PM

Think that I need to think a little :)
But can you please try to replace 2 strings

unset ($postQueryLogic);
$postQueryLogic = array('post.postid IN(' . $postids . ')');

with one

$postQueryLogic[] ='post.postid IN(' . $postids . ')';

and say how it will go?

PS using unset because I still trying to give less job to database - sorry :)

msimplay 04-03-2004 10:37 PM

hey sorry for bugging you :p
i have found a new bug
when you search this thread it returns results from other threads

msimplay 04-03-2004 10:59 PM

Quote:

Originally Posted by JohnWoo
Think that I need to think a little :)
But can you please try to replace 2 strings

unset ($postQueryLogic);
$postQueryLogic = array('post.postid IN(' . $postids . ')');

with one

$postQueryLogic[] ='post.postid IN(' . $postids . ')';

and say how it will go?

PS using unset because I still trying to give less job to database - sorry :)

this doesnt seem to work :disappointed:

JohnWoo 04-04-2004 07:07 PM

and how it is now? after v.2.2 changes ?

jb605 04-05-2004 02:43 AM

I just installed this hack on vB 3.0.0 gold version. I am running a chinese website. Chinese is multibyte language, and the words are not delimited by space. I thougt by using fulltext search, the searched keyword is matched against the fulltext index directly, so there is no need to build word index on post. Am I correct?

But now I got no search result at all. Can anybody give any hints?

Thanks a lot.


All times are GMT. The time now is 10:24 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01672 seconds
  • Memory Usage 1,834KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (4)bbcode_code_printable
  • (2)bbcode_php_printable
  • (13)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (3)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete