Sphinx Search

[ALanJay]

Originally Posted by Neil Lock

Finally got it to work,

Now I have another question, I want to run this from a slave database ie grab the query data but the sphinx requires the REPLACE INTO which obv cant run on a slave instance so my question is this - is it possible to hook this up to run on the master for the replaces and the slave for the other queries. I intend on going and playing but wondered before hand whether anyone had a solution?

Thanks

Neil

Can I ask why?

searchd can be on any computer and the database it looks into can be on any other one (that it can see). You obvioulsy have to configure the front end to look at searchd on the correct computer and change the localhost references to the IP address of the machine that has searchd running on it.

But the load from indexing the files isn't that great and the way Oban has implemented it with a main index and deltas means that even with a large board with lots of posts and we get from 10,000 to 40,000 a day running the rebuild of the full index once a day at a quite preriod will not put a load on the database (and in our case with a file with nearly 12 million posts it takes under 5 minutes). The creation of the delta file which I run every 5 minutes takes just a few seconds.

Sphinx's overhead when indexing seems very small (as far as I can tell) on the mySQL database so I don't see the need to complicate things.

In my setup:

HTML front ends (x8 - 10.10.10.11 to 10.10.10.18) sphinx.php points to 10.10.10.19

10.10.10.19 - searchd when index created looks at 10.10.10.1

10.10.10.1 - mySQL master database

As I understand it all Sphinx leaves in the database is a marker to say where the line between the main and delta database is.

Good luck Neil

[orban]

Originally Posted by mute

Yeah, my users are complaining about the out of order results, but I haven't had the time lately to delve into it. I swear at one point it was working, but now.. not so much.

That's really weird

I never had this problem.

[amcd]

Originally Posted by orban

That's really weird

I never had this problem.

i have the same problem, though no one has complained yet

[orban]

Can you reproduce this with "search" on the same input?

Might be worth asking in the sphinx forums.

[DaiTengu]

For curiousity's sake, can I get rid of any of my indexes on the post table now? The table crashes periodically, and with the fulltext index it takes almost an hour to repair.

[Neil Lock]

hey,

cheers for the help, probably against our server peoples wishes i indexed from the master database (our master db is fairly heavily loaded - we were trying to avoid adding anything new which may "tip it over") - so i now have an indexed db, the searchd daemon running now all i need to do is play around and write some scripts to manipulate the data the searchd returns - my first job is to build a standalone search which can be used to test before it goes live on our forums. I am actually quite excited about this product and looking forward to using it. Cheers guys. Will keep you posted on progress.

Neil

[DaiTengu]

has anyone managed to fix the out-of-order results on their forum, yet?

[kmike]

I'm taking a wild guess here, but maybe the returned results are sorted by relevance, that's why they seem out of order? (which order btw? date posted?)

[DaiTengu]

Yeah, they're supposed to be sorted by date. Apparently I'm not the only person having the problem.

[ALanJay]

Originally Posted by DaiTengu

Yeah, they're supposed to be sorted by date. Apparently I'm not the only person having the problem.

When I wrote a search against oanother (non forum database) and I added sort by date I discovered that the place that the sort type is set matters.

ie

////////////
// do query
////////////
$cl = new SphinxClient ();
$cl->SetServer ( $sphinx_server, $sphinx_port );
$cl->SetWeights ( array ( 100, 1 ) );
// Number of results to display //
$cl->SetLimits ( intval(0), intval($limit) );
// $cl->SetMatchMode ( $any ? SPH_MATCH_ANY : SPH_MATCH_ALL );
$cl->SetMatchMode ( $sp_srch );
$cl->SetSortMode ( $sp_sort );
$cl->SetGroups ( $groups );
$cl->SetGroups2 ( $groups2 );
$cl->SetGroups3 ( $groups3 );
$cl->SetGroups4 ( $groups4 );
$cl->SetGroups5 ( $groups5 );
$res = $cl->Query ( $q, $index );

Works for me byt putting the "SetSortMode" below Group 5 didn't work not sure why But it might be worth checking where it appears.