View Full Version : Sphinx Search
16.5 mil posts
488k threads
vb 3.6
no plans to move to vb 4 until everyone else does it, too.
boolean and phrase search are needed. been missing them.
spending for a search solution - no problem. spending 2k - no way.
I would really love an updated version that runs on 3.6 that takes advantage of all the Sphinx goodies, since I don't see us moving to 4.0 for close to a year. All of the custom code we've written has to be ported and tested, and being the lone admin on a site this big has my hands full a lot of the time.echo
eoc_Jason
01-13-2010, 08:14 PM
Okay, I've been working slowly but surely... Here's the following constraints thus far:
1. New threads/posts added when you run your delta cron job (most run every 2-5 min)...
2. Changes in # views, last poster, deleted threads / posts, etc should be real time updates.
3. Edits to the title or post text will not be updated until next full re-index (usually nightly) unless it is within the delta file.
Will have boolean searching, phrase, etc...
Okay, I've been working slowly but surely... Here's the following constraints thus far:
1. New threads/posts added when you run your delta cron job (most run every 2-5 min)...
2. Changes in # views, last poster, deleted threads / posts, etc should be real time updates.
3. Edits to the title or post text will not be updated until next full re-index (usually nightly) unless it is within the delta file.
Will have boolean searching, phrase, etc...
One thing I'd like to have that we don't currently have, is properly ordered search results. If you don't do full reindexing on a regular basis, they tend to get really out of order.
kmike
01-15-2010, 10:47 AM
Apart from using Sphinx to search for the similar threads, you can also use it to generate the post excerpts with search keywords highlighted when in the "Show search results as posts" mode.
Our stats: almost 14 mln posts, 1.1 mln threads, 300k users, vB 3.8.
We're using our own Sphinx implementation since it predates the hack in this thread.
We got rid of the obscure search and sort modes though (such as sorting by the number of views or replies), and there was not a single complaint from our members. I don't think you should focus too much on 100% compliance with the default search. Having too many document attributes will inflate the index size, resulting in more I/O and more sluggish performance.
If you are worried about the need to edit the default search form template, you could always clone it, make the necessary changes and ship it with the product.
eoc_Jason
01-15-2010, 06:26 PM
Thanks for the feedback guys. Another thing I'm pondering on is instead of trying to work off just a main + delta index is to break the total post count up and constantly rotate smaller indexes...
I.E. If a site has 10,000,000 posts... Have 10 indexes each with 1,000,000 threads. Then have each of the indexes rotate say hourly. This would be a shift from the typical one massive re-index nightly (or however often you do it). In theory too, the last index would contain the most recent posts and could be re-indexed more often.
I dunno, that's just a thought... My concern right now is the core code for searching, the indexes themselves can be manipulated differently at a later time as that is transparent to everything else.
kmike
01-16-2010, 05:20 AM
Thanks for the feedback guys. Another thing I'm pondering on is instead of trying to work off just a main + delta index is to break the total post count up and constantly rotate smaller indexes...That's what we're doing, too, though the delta is still there. The bonus is that you can set up a distributed index with the number of agents equal to the number of CPUs, like described here (http://sphinxsearch.com/docs/manual-0.9.9.html#conf-agent), to take advantage of all CPUs in the server. However it's more of a manual operation, it would be hard to generate a partitioned sphinx.conf automatically.
eoc_Jason
01-17-2010, 09:17 PM
kmike - thanks for that info, I must over looked over that in the docs...
Just curious, how much of a performance difference did you see using the distributed process?
I kind of got sidetracked today... One of my good friend's wife just got out of the hospital, so I was there for a while today. Then I was coding some anti-spammer measures for my forum registration process...
We have 2 post indexes, one or our live post table, and one for our archived post table. They each have 30 million posts each. I don't see a point in sharding the post indexes aside from being able to take advantage of multiple CPUs when indexing.
The way I see it, if I can keep the old indexes online while I do a full reindex, I don't really care how long the full reindex takes since (at least in our case), the search server is just a slave database server and not our primary.
Kevlar
01-18-2010, 11:20 AM
The only thing I am waiting on before converting to vB4 is sphinx (or a working search alternative). The rest of the little stuff I modded I can do with or without until those developers get upgrades.
1.3 million threads
18 million posts
mute, can you share how did you archive post table ? What changes did you do in code and MySQL ? I want to move my old posts to another post_archive table but I am not sure how can I join those tables from vbulletin code.
eoc_Jason
my forum is 200k threads and 10mil posts, vb 3.8.4. I have only one database (no slave), nginx webserver, Core I7 with 12GB RAM.
I installed sphinx on server and from ssh it works great but from moded search.php it works very strange, sometimes when I want to find some keywords with option "show results as posts" it returns "no results" message but if I change search options to "show results as thread" with same keywords, I got good numbers of results showen as threads.
Users posts search does not works at all, search.php?do=finduser&u=xxx always gives blank screen no php errors in log or anywhere just blank screen and thats it.
my forum is 200k threads and 10mil posts, vb 3.8.4. I have only one database (no slave), nginx webserver, Core I7 with 12GB RAMIt is time for you to move to dual servers - one for webserver/PHP and another for MySQL.
It is time for you to move to dual servers - one for webserver/PHP and another for MySQL.
no money making here :) just spend
I think spliting big post table to smaller read only archived tables will be cheaper and even better solution and of couse Sphinx for search.
mute, can you share how did you archive post table ? What changes did you do in code and MySQL ? I want to move my old posts to another post_archive table but I am not sure how can I join those tables from vbulletin code.
It's REALLY nasty. I really don't think you want to do it. In fact, I'm thinking about abandoning it on our site.
Back when we wrote it, we were probably at like 25 million posts, on (if I remember right), like a dual xeon with HT. Now, we're on a Quad Quad xeon box with 16gb of ram. We have 30 million in our archived tables (10x3 mill posts each) + 30 million in our post table. I'm not seeing any slowdowns against the post table, which has me wondering if we'd be seeing any slowdowns if I was pulling against all 60 million in one table, given how much faster our CPUs have gotten and how much ram we have sitting around.
masons
01-19-2010, 02:41 AM
Hi,
I have sphinx installed for my wiki since a few days, and now am looking to get it working with my vbulletin setup,
But, my server load went a bit overboard this morning (120+) and I have no idea how to work with that,..... any tips on taking some presure of the load? Before I add this to vbull?
Some server stats (dedicated)
Processor #1 Vendor: GenuineIntel
Processor #1 Name: Intel(R) Core(TM)2 Duo CPU E8300 @ 2.83GHz
Processor #1 speed: 1998.000 MHz
Processor #1 cache size: 6144 KB
Processor #2 Vendor: GenuineIntel
Processor #2 Name: Intel(R) Core(TM)2 Duo CPU E8300 @ 2.83GHz
Processor #2 speed: 1998.000 MHz
Processor #2 cache size: 6144 KB
go through this (http://www.vbulletin.com/forum/showthread.php?218599-Some-tuning-tips-from-the-MySQL-experts) thread over at vb.com
eoc_Jason
01-19-2010, 03:24 PM
We have 2 post indexes, one or our live post table, and one for our archived post table. They each have 30 million posts each. I don't see a point in sharding the post indexes aside from being able to take advantage of multiple CPUs when indexing.
The way I see it, if I can keep the old indexes online while I do a full reindex, I don't really care how long the full reindex takes since (at least in our case), the search server is just a slave database server and not our primary.
Splitting up the posts index into several sources has more advantages that just re-indexing. As kmike eluded to, you can setup "agents" on your server so that when a person does a search it will search all the sources in parallel utilizing one source per CPU.
For most people though, even large indexes we are all probably just using 1 CPU without realizing it and still maintaining less than one second search times...
This week I'm going to be swamped working on some new AMD processor reviews, so work on the new sphinx code will have to be set aside until Tuesday next week.
I'm super pumped though, after diving into the documentation and code, I realized it's really not that bad at all...
Splitting up the posts index into several sources has more advantages that just re-indexing. As kmike eluded to, you can setup "agents" on your server so that when a person does a search it will search all the sources in parallel utilizing one source per CPU.
eoc_Jason, can you share how to split post table index into several sources ?
kmike
01-26-2010, 09:52 AM
FYI, realtime index updates in Sphinx are near:
http://twitter.com/sphinxsearch/statuses/8179531738
Looks like so far the realtime indexes are only accessible via SphinxQL.
weeno
02-24-2010, 11:30 PM
hey guys,
Can someone post their sphinx.conf file for sphinx version 0.9.9? I'm still running into a few problems so wanted to compare.
arn
boggseric
02-26-2010, 01:43 AM
Was post number 1 supposed to contain some XML mods? Or am I missing something here.
edit: Never mind, there are no xml files, you have to create the plugins manually and copy and paste the code into them.
ivanp
03-01-2010, 08:42 PM
Any update for Sphinx for vB4?
Lea Verou
03-01-2010, 09:12 PM
Has anyone used Sphinx with languages != english?
Does it work correctly?
FULLTEXT had issues with greek...
boggseric
03-13-2010, 04:18 PM
Has anyone figured out the "Find More Posts by UsernameHere" issue? It results in these error messages, but the results seem to work properly:
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
Warning: strpos() [function.strpos]: Empty delimiter. in /includes/functions_search.html on line 868
I really don't want to put Sphinx live until this is fixed... any advice would be welcome.
I am wondering if it has something to do with using an older 3.6 version of vBulletin.
This is a pretty old post but it is still relevant. The from looking at the line it's refereing to it looks like he problem is with the function that it is trying to find the search text in the post result to highlight it. Since there is no search text the value is null and strpos does't like that.
edit: I think I got it fixed. The problem is with the process_quote_removal function.
Keep in mind I am running 3.8.4pl2
I edited includes/functions_search.php and made the following changes
Search for this block of code:
function process_quote_removal($text, $cancelwords)
{
$lowertext = strtolower($text);
foreach ($cancelwords AS $word)
{
$word = str_replace('*', '', strtolower($word));
if (strpos($lowertext, $word) !== false)
{
// we found a highlight word -- keep the quote
return "\n" . str_replace('\"', '"', $text) . "\n";
}
}
return '';
}
This line is the culprit for me: if (strpos($lowertext, $word) !== false)
it appears that $word ends up being null which causes strpos to puke the errors.
so I changed the function to this:
function process_quote_removal($text, $cancelwords)
{
$lowertext = strtolower($text);
foreach ($cancelwords AS $word)
{
$word = str_replace('*', '', strtolower($word));
if ($word !== '')
{
if (strpos($lowertext, $word) !== false)
{
// we found a highlight word -- keep the quote
return "\n" . str_replace('\"', '"', $text) . "\n";
}
}
}
return '';
}
You can see I just added an if statement to check if $word is null. If $word is null it skips over the code since there is obviously nothing to highlight.
I have tested the normal search and the search term is still highlighted and I am no longer getting errors during search for more posts by this user.. YMMV.
WoodiE
03-13-2010, 11:11 PM
Is this real or just an info about Sphinx? Someone told me that it costs $2,000 to have it setup on vBulletin - no?
TechGuy
03-13-2010, 11:57 PM
Unfortunately, no... you can install Sphinx yourself for free, but it is no small task and there are some issues to deal with.
The $2k is likely referring to the "Axivo Searchlight" product, though I hesitate to use the word product as it's been "coming soon" for more than a year. They finally released a closed beta, so I suspect it's still being developed, but that was over three months ago and still no product.
boggseric
03-13-2010, 11:59 PM
Is this real or just an info about Sphinx? Someone told me that it costs $2,000 to have it setup on vBulletin - no?
I just set it up using the info in post 1 (https://vborg.vbsupport.ru/showpost.php?p=1086294&postcount=1) and the files from post 582 (https://vborg.vbsupport.ru/showpost.php?p=1538931&postcount=582)
I used the info from this post (https://vborg.vbsupport.ru/showpost.php?p=1383599&postcount=445) to make sure it stayed running and this post (https://vborg.vbsupport.ru/showpost.php?p=1207641&postcount=310) to setup the crons for delta and nightly.
Other than that the only changes I made were from my previous post (https://vborg.vbsupport.ru/showpost.php?p=2002898&postcount=773) to fix the "find more posts by this user" issue.
It is now up and running on my 3.8.4pl2 forums with:
Threads: 799,861, Posts: 11,892,282, Members: 24,815
I set the max amount of of results to 20,000 and it's working great. Searches no longer take my forum to it's knees.
The things I haven't done yet are to remove the indexes from post and convert my tables to innodb.
Total cost? My time reading through this never ending thread and compiling the data above.
WoodiE
03-14-2010, 01:10 PM
TechGuy - I didn't realize there was two different options for using Sphinx on vBulletin. Though by the sounds of it neither are very easy to setup. One either very pricey, two according to boggseric a lot of files and editing to do - both still have issues and nothing everything working.
Does anyone know of any other solutions to making vBulletin search easier on the server and sill maintain all of vB's features?
adnoid
03-14-2010, 06:24 PM
I just set it up using the info in post 1 (https://vborg.vbsupport.ru/showpost.php?p=1086294&postcount=1) and the files from post 582 (https://vborg.vbsupport.ru/showpost.php?p=1538931&postcount=582)
I used the info from this post (https://vborg.vbsupport.ru/showpost.php?p=1383599&postcount=445) to make sure it stayed running and this post (https://vborg.vbsupport.ru/showpost.php?p=1207641&postcount=310) to setup the crons for delta and nightly.
Other than that the only changes I made were from my previous post (https://vborg.vbsupport.ru/showpost.php?p=2002898&postcount=773) to fix the "find more posts by this user" issue.
It is now up and running on my 3.8.4pl2 forums with:
Threads: 799,861, Posts: 11,892,282, Members: 24,815
I set the max amount of of results to 20,000 and it's working great. Searches no longer take my forum to it's knees.
The things I haven't done yet are to remove the indexes from post and convert my tables to innodb.
Total cost? My time reading through this never ending thread and compiling the data above.
Thank you for putting this all together. I've been looking at the alternatives for our board, now approaching 5,000,000 posts. I'm not a heavyweight coder, but I'll be giving your method a shot.
boggseric
03-15-2010, 11:39 AM
TechGuy - I didn't realize there was two different options for using Sphinx on vBulletin. Though by the sounds of it neither are very easy to setup. One either very pricey, two according to boggseric a lot of files and editing to do - both still have issues and nothing everything working.
Does anyone know of any other solutions to making vBulletin search easier on the server and sill maintain all of vB's features?
You'd probably be best off if you did it yourself, that way if you need to make changes in the future you know what you are doing. It's not overly complicated.
I don't know squat about linux or vB but I know computers and some programming (other than PHP). I managed to fumble my way through it.
If you can afford the 2k solution, good. If not maybe you'd be better off paying someone to set sphinx up for you.
TechGuy
03-15-2010, 11:42 AM
My point is that even if you can afford the $2k solution, it doesn't matter -- that solution doesn't exist.
Without reading through the entire thread, what's the status of using advanced search fields using the solution you mentioned earlier? (It was a long time ago when we last tried, but I remember we had to drop it because we couldn't sort by most of the fields.)
boggseric
03-15-2010, 12:55 PM
My point is that even if you can afford the $2k solution, it doesn't matter -- that solution doesn't exist.
Without reading through the entire thread, what's the status of using advanced search fields using the solution you mentioned earlier? (It was a long time ago when we last tried, but I remember we had to drop it because we couldn't sort by most of the fields.)
Sorting is definitely an issue. But from my forums perspective we had nothing to lose. The vBulletin search and MySQL search both brought our server to it's knees and frequently even crashed the server.
So we basically only had a few options:
Trim almost all of our posts and threads and put them in a different database. This seems like a good idea, but then you have to maintain two databases and do some trickery to not lose your total post count in your main forum. Then the users have to switch forums to search for something if they don't find it in the main forum. Large searches in the archive forum still eat up MySQL resources on the server and slow down the main forum.
Not allow searching at all. Not an option for us, we are a car tech forum and people MUST be able to search for data.
Continue with the vBulletin/Fulltext searches and just deal with the slow forum, crashes and angry users.
We chose sphinx, it may not be perfect but it's better than any option vBulletin has offered.
ivanp
03-15-2010, 03:36 PM
boggseric, have you tried setting up Sphinx for vB4?
boggseric
03-15-2010, 03:59 PM
boggseric, have you tried setting up Sphinx for vB4?
Nope, I don't have any intentions of heading in that direction. I'm sure it would take a pretty hefty rewrite of sphinx_search.php.
Lizard King
03-25-2010, 01:22 PM
My point is that even if you can afford the $2k solution, it doesn't matter -- that solution doesn't exist.
Without reading through the entire thread, what's the status of using advanced search fields using the solution you mentioned earlier? (It was a long time ago when we last tried, but I remember we had to drop it because we couldn't sort by most of the fields.)
If i am not mistaken searchlight does not have any sorting issues and several user i know confirmed that . the prices were high but they have a way more attractive pricese now compared to old prices.
rsuplido
04-28-2010, 04:33 AM
boggseric, have you tried setting up Sphinx for vB4?
http://www.vbulletin.com/forum/showthread.php?350427-Sphinx-search-BETA-for-vBulletin-4.0
I'm not even convinced the odd sorting is that much of a bad thing. It's actually rather logical and more relevant, if you think about it. For example, you have 3 threads and you're searching for the word "cheese":
Thread 1, a thread posted to on a daily basis - the word "cheese" was posted 1 year ago.
Thread 2, a thread posted to on a weekly basis - the word "cheese" was posted 1 month ago.
Thread 3, a thread posted to on a monthly basis - the word "cheese" was posted 1 week ago.
vBulletin search would likely show the threads in the order 1, 2, 3.
Sphinx would likely show the threads in the order 3, 2, 1.
On the face of it, thread 1 hasn't been about "cheese" for a year, despite it being regularly posted to. Wouldn't a searcher looking for "cheese" find either thread 2 or 3 more relevant?
I would suggest the sorting issue with Sphinx is more about people's expectations than any actual problems. The results of a search, even for more common words, might actually be more relevant in most cases.
Just something to think about. ;)
Mickie D
06-06-2010, 03:21 PM
is there a plugin that will work on the 3.7 version of vbulletin.
Cant keep up with this post even though I implemented it some years ago lol.
I looked at the vb4 version to see if there was a way of implementing this on lower versions of vb3 series but there is allot of changes you will need to make, and finding the time might be a problem.
Thanks.
Mickie
ChopSuey
06-06-2010, 04:33 PM
I don't think they will downgrade the mod.
Mickie D
06-06-2010, 07:01 PM
I have just been doing the original hack (from this post https://vborg.vbsupport.ru/showthread.php?p=2003154#post2003154)
And I have had a nightmare adding a DATABASE PREFIX to the code lol.. taken me over 1 hour to code all the prefix's into it lol.
Anyway I have nearly got the original working with the latest sphinx, hopefully I can now get the plugins working.
Nearly there.
It would be great if they could add there advanced version (VB4) to the lower versions of vbulletin - at a guess from 3.6 - 3.8 would be almost identicle.
Where would we ask for this support anyway ?
Mickie
ChopSuey
06-07-2010, 01:12 AM
Add to the lower versions? They have wayy better things to do.
Mickie D
06-07-2010, 05:55 PM
Add to the lower versions? They have wayy better things to do.
That's a silly post, allot of people still use vbulletin 6, 7, 8, 9, etc.
I have 2 million posts and 70,000 members and do not want to upgrade to vb4 for many reasons but server load is the biggest factor.
Anyway I have it working now so no one has to worry about looking after customers that use a earlier version of VB
Mickie
kmike
06-09-2010, 10:36 AM
ChopSuey, they already have a working (in production) 3.7 version, as could be seen on most of the IB auto sites. They have decided not to release it - probably to not add it to the number of reasons because of which people stay on vB 3.x.
kontrabass
06-17-2010, 12:05 PM
Is anyone using VB4 with VB's Sphinx plugin successfully?
*chirp chirp chirp*
JesterP
06-20-2010, 04:26 PM
I just set it up using the info in post 1 (https://vborg.vbsupport.ru/showpost.php?p=1086294&postcount=1) and the files from post 582 (https://vborg.vbsupport.ru/showpost.php?p=1538931&postcount=582)
I used the info from this post (https://vborg.vbsupport.ru/showpost.php?p=1383599&postcount=445) to make sure it stayed running and this post (https://vborg.vbsupport.ru/showpost.php?p=1207641&postcount=310) to setup the crons for delta and nightly.
Other than that the only changes I made were from my previous post (https://vborg.vbsupport.ru/showpost.php?p=2002898&postcount=773) to fix the "find more posts by this user" issue.
It is now up and running on my 3.8.4pl2 forums with:
Threads: 799,861, Posts: 11,892,282, Members: 24,815
I set the max amount of of results to 20,000 and it's working great. Searches no longer take my forum to it's knees.
The things I haven't done yet are to remove the indexes from post and convert my tables to innodb.
Total cost? My time reading through this never ending thread and compiling the data above.
I wanted everyone to know boggseric's post is the way to go. Even though I read everything I could find about Sphinx, his post pulled it all together and I am now ready to convert to innodb FINALLY.
Thank you boggseric.
My setup:
Nginx for all web/PHP
Sphinx 0.9.9
vBulletin 3.8.3 80k members 740k posts
My only complaint so far is that it seems to take longer to go to a search result that's listed than clicking on anything else on the site. I'm wondering if the highlighting of the search terms the site does is causing the delay.
Thanks to everyone who contributed to this thread..... it's pure gold.
Jester
Has anyone noticed issues with "Find all posts by user" not showing all of a users recent posts? I'm not certain what's causing it, but even when my delta indexes are up to date, I'm having difficulty finding all of a users current posts. I'm not sure if it has something to do with posts being deleted or what, but it seems like it's sort of wonky.
hqarrse
07-03-2010, 09:39 AM
For Vbulletin 4 I suggest using DigitalPoint's sphinx mod. This is the link although you will need to join as a premium member at $25 for a month.
http://articles.digitalpoint.com/content.php?r=12-Sphinx-Search-For-vBulletin-4&nocache=1
It's early days but this has been simple to install and is working well on a forum of just over 3,000,000 posts. I'm still on a development version as I'm moving from a different CMS, but will post if I have any problems once I go live.
saf-t scissors
07-08-2010, 11:47 PM
I got this running with boggseric's summary last night.
I'd like to point out this old Orban post (https://vborg.vbsupport.ru/showthread.php?p=1283359#post1283359), which I found helpful. It's a little out of date, so don't follow the instructions word for word. But it fills in some helpful background information like creating the counter tables.
It's also worth mentioning that I did have to make a few changes to the cron files to get them working properly. It's not a big deal, but helpful to know for those that aren't familiar with shell scripts and would like to plug and play. I'll post my files with comments after I get them cleaned up.
Alfa1
07-16-2010, 05:53 PM
It would be great to see step by step instructions for vb 3.8.
Orbans post is for vb 3.6
Is anybody willing to write this?
JesterP
07-16-2010, 06:02 PM
It would be great to see step by step instructions for vb 3.8.
Orbans post is for vb 3.6
Didn't matter for me.
boggseric
07-16-2010, 11:47 PM
It would be great to see step by step instructions for vb 3.8.
Orbans post is for vb 3.6
Is anybody willing to write this?
https://vborg.vbsupport.ru/showpost.php?p=2003154&postcount=776
Alfa1
07-17-2010, 01:44 AM
Does anyone know how to include search for groups, blogs, thread prefixes, attachments, VM, PM and albums?
KevinL
07-17-2010, 02:08 AM
The only real sphinx search for 3 series is searchlight. The best out there...
Alfa1
07-17-2010, 02:40 AM
Possibly. But that costs an arm and a leg.
KevinL
07-17-2010, 03:10 AM
Very very true haha at least it is worth it :)
I just noticed Sphinx 1.10-beta has been released (http://sphinxsearch.com/news/42.html). With real time index support. Sounds amazing :)
Lizard King
09-11-2010, 03:54 AM
Possibly. But that costs an arm and a leg.
However if you have a big board , compensating that cost will max take 3-4 month with the money you save from your server expenses
Keep the promoting and talk of commercial products out of this thread or next time I clean it up I'll give infractions... Thanks :)
final kaoss
12-19-2010, 07:43 PM
Now, what needs to be done to get this working with vb 4.x? After all this program is free and does not belong to digitalpoint.
*found it
http://www.vbulletin.com/forum/showthread.php?350427-Sphinx-search-BETA-for-vBulletin-4.0
sivaganeshk
12-28-2010, 01:51 AM
Now, what needs to be done to get this working with vb 4.x? After all this program is free and does not belong to digitalpoint.
*found it
http://www.vbulletin.com/forum/showthread.php?350427-Sphinx-search-BETA-for-vBulletin-4.0
The first instruction itself BUMPs me :(
*Please do not install this product unless you have a strong technical background
Vitaly
12-31-2010, 03:40 AM
Maybe someone wish to join / continue https://github.com/rcdesign/vb-sphinx_search . It works for 4.x, and used at my production forum. But i have no time to maintain it here and answer technical questions. Of cause, you can report bugs @ github.
That code is much better, than published by Andrian. It requires Sphinx 1.10+.
Boofo
12-31-2010, 03:47 AM
The first instruction itself BUMPs me :(
*Please do not install this product unless you have a strong technical background
That "supposedly" will only work with Sphinx 0.9.8. I couldn't get it to work with 0.9.8.1 so I gave up.
Vitaly
04-11-2011, 04:31 AM
Seems, my work with sphinx for vb 4.x finished https://github.com/rcdesign/vb-sphinx_search . "Proper" tags support added, bugs fixed. Note, it requres sphinx 1.11 from svn repo. See details in readme. If someone wish to improve - possible todo is here: https://github.com/rcdesign/vb-sphinx_search/wiki
Uberguilds
05-07-2011, 08:04 AM
Has anyone used Sphinx with languages != english?
Does it work correctly?
FULLTEXT had issues with greek...
No problem searching with Arabic, or 2 character searches.
My setup is Arabic RSS feeds coming through the RSS manager which is searchable through Sphinx on 3.8.
92 2.8GHz cores
184GB ram
10,800GB raw 15krpm local storage
8TB raw 7200rpm local storage
24TB raw 7200rpm iscsi storage
If any large vb installs need sphinx on 3.8 I'm only a PM away.
http://r-shief.org/sphinx.PNG
SnakeV
07-25-2011, 05:59 AM
Anyone got this working with similar threads?, i have installed all and it's working nice, except that.
I'm willing to pay if anyone can do this compatible with Similar Threads.
Mooff
07-25-2011, 01:50 PM
If you are willing to pay, just use this one:
http://products.digitalpoint.com/vbulletin-sphinx-search.php
SnakeV
07-25-2011, 04:38 PM
If you are willing to pay, just use this one:
http://products.digitalpoint.com/vbulletin-sphinx-search.php
I'm under vB 3.8, and as far i know the digitalpoint sphinx is only for vB 4.x.
8thos
07-27-2011, 09:25 PM
Seems, my work with sphinx for vb 4.x finished https://github.com/rcdesign/vb-sphinx_search . "Proper" tags support added, bugs fixed. Note, it requres sphinx 1.11 from svn repo. See details in readme. If someone wish to improve - possible todo is here: https://github.com/rcdesign/vb-sphinx_search/wiki
Can you make a comparison chart between yours and digitalpoints?
Angel-Wings
08-01-2011, 08:21 AM
Well - if you can wait a bit - Oracle plans to add fulltext indices support for InnoDB with MySQL 5.6 - finally.
Client side the old MyISAM syntax can be used so there's - once 5.6 is released - no longer a need to install any 3rd party plugin.
Maybe just wait a bit until 5.6 reaches production status, then there's no need to play around with Sphinx.
http://www.oracle.com/us/corporate/press/439460?rssid=rss_ocom_pr
Alfa1
12-03-2011, 12:18 AM
It would make sense if the vbulletin search overhaul will use this.
SnakeV
12-03-2011, 06:14 PM
If anyone interested on doing support for similar threads:
https://vborg.vbsupport.ru/showthread.php?p=2274364
prandah
12-13-2011, 05:56 PM
if someone or digitalpoint make a 3.8.X sphinx
maybe i will buy it :D
i have version 4.x
but i downgrade my forum to 3.8.x
Chris8
12-14-2011, 12:07 AM
if someone or digitalpoint make a 3.8.X sphinx
maybe i will buy it :D
i have version 4.x
but i downgrade my forum to 3.8.x
Why are you downgrading to 3.8 if I may ask? :) Is it even possible to downgrade from 4.X to 3.8.X?
prandah
12-15-2011, 11:12 AM
Why are you downgrading to 3.8 if I may ask? :) Is it even possible to downgrade from 4.X to 3.8.X?
yes you can downgrade vbulletin 4 to 3
vbulletin 4 my server got a lot of querry :(
so i diwngrade it :D
vbulletin 3 very very little querry :D
lauxanh
02-10-2012, 07:59 PM
Anyone got a working solution for vb 3.8.7?
Mecho
11-06-2012, 01:09 PM
too bad there is no confirmed working version for 3.8.X version.
Anyone ??
snakes1100
11-06-2012, 10:43 PM
It works just fine on 3.8.7, i run it on a few sites/servers & have been since 3.8.7 was released.
Adrian Schneider
12-31-2012, 07:42 PM
Does this work with the new versions of Sphinx Search? (2.x)
Does this work with the new versions of Sphinx Search? (2.x)
Yup.
snakes1100
01-01-2013, 08:31 AM
Confirmed, running it on 2.0.6
anyone got it working with sphinx 2.1.1-beta?
I upgraded from 2.05 and is getting this error:
expected searchd protocol version 1+, got version '0'
Did you upgrade the API as well?
weinstoc
10-02-2014, 01:35 AM
We've been running Sphinx with our VB 3.8 installation for years. It's worked flawlessly (I think) until recently. All of a sudden if I use advanced search to search for a particular user's (apparently any particular user) posts in the last few months, I see only posts that occurred up to September 2...even though I know that the particular users have made many, many posts since then.
I tried manually running the indexer to create a new index. It made no difference.
Any thoughts?
We're running 0.9.8.1 if it matters.
Zachery
10-02-2014, 02:43 AM
My gut is to tell you to run the newer version and reindex from scratch.
Lynne
10-02-2014, 04:07 PM
Did you change any of the Forums to be set to "Index New Posts in Search Engine" to No?
vBulletin® v3.8.12 by vBS, Copyright ©2000-2025, vBulletin Solutions Inc.