Sphinx Search

[ubuntu-geek]

Originally Posted by orban

I know this is a bit ugly right now, but:

http://forums.mtgsalvation.com/search.php

Also the "Search This Forum" is using Sphinx now.

"Search This Thread" and all queries using userids have to be done the old way for the moment until the new Sphinx version is released.

But I'm happy users can search our 1.4 million posts in <1sec again. Without crashing the server, locking any tables or anything.

When new version is out I'll finish the implementation and release it

New version of sphinx or vb? I really want to try this out.. searches are killing us.

[orban]

sphinx

[mute]

Hm. this is very strange. I have verified that my config is the same as yours (minus the names of the indexes), and have emptied my sphinx_counter table, nuked all my indexes, and rebuilt.

[root@db2 var]# /home/httpd/sphinx/bin/search -c /home/httpd/sphinx/etc/sphinx.conf purple
Sphinx 0.9.6
Copyright (c) 2001-2006, Andrew Aksyonoff

- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbpostidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbpostdeltaidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbthreadidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec
- loaded 591 stopwords from '/home/httpd/sphinx/etc/sphinx.stopwords'
index 'vbthreaddeltaidx': query 'purple ': returned 0 matches of 0 total in 0.000 sec

I broke something, but I don't know what

Ah, I found the problem I think.

For whatever reason, on my initial index, despite having used --rotate, it is leaving *new* index files in my var dir:

[root@db2 var]# ls -la *new*
-rw-r--r-- 1 root root 1356935444 Oct 2 13:39 vbpost.new.spd
-rw-r--r-- 1 root root 10644727 Oct 2 13:39 vbpost.new.spi
-rw-r--r-- 1 root root 54322284 Oct 2 13:42 vbthread.new.spd
-rw-r--r-- 1 root root 879893 Oct 2 13:42 vbthread.new.spi

Sphinx won't search against these, but I'm not sure why they didn't roll over.

[orban]

Yeah I don't have .new. ones, just .old. ones.

Permissions?

[mute]

It is what I believe a bug in sphinx. If you start searchd w/ no indexes preexisting, then index with --rotate, it won't rotate. The solution is to stop searchd, nuke everything, index, then start searchd.

It took me a while to figure it out, I'm not sure why it isn't smart enough to see that there aren't preexisting indexes when searchd tries to rotate.

[orban]

Oh

Yeah I did the first index without searchd started.

Report it so it can be fixed

[ubuntu-geek]

I was just curious is your search_sphinx.php posted a few threads back the most current one? or have you made more adjustments?

[mute]

Just an FYI, make sure you limit access to that search on your dev boxes if you don't potentially want people searching for info in your private forums

I guess now we just get to wait patiently for 0.9.7 to come out...

[orban]

What you mean? Other users with ssh access?

Yeah or kmike can share his patch https://vborg.vbsupport.ru/showpost....2&postcount=21

[ubuntu-geek]

Originally Posted by mute

Just an FYI, make sure you limit access to that search on your dev boxes if you don't potentially want people searching for info in your private forums

I guess now we just get to wait patiently for 0.9.7 to come out...

Not sure what you mean. It seems the permission system works on private/non private when doing searches with sphinx.