View forum posts 4.1.12

[John Lester]

So for the last 6 months or perhaps longer (first I heard of it was 6 months ago) when a member clicks on another members name in the postbit (legacy) and clicks the "View Forum Posts" link ... it doesn't show recent posts. There's about a 3 week gap between the posts the link returns and the actual most recent post of the user.

This is the only search that's buggered up (http://www.braintalkcommunities.org/search.php?do=finduser&userid=2728&contenttype=vBForum_Post&showposts=1) but is "fixed" for a little while after I rebuild the search index.

Anyone have any ideas as to what's going on with this search feature?

[Lynne]

What is set for AdminCP > Settings > Options > message searching options > Queue Search Updates ? And if it's set to yes, look at Scheduled Tasks and make sure the task to run the queue processor task is running.

[John Lester]

Ok it was set to yes but there was no "Search Queue Updates" in the scheduled task. Do you happen to know how to set it up? Or where I can go searching for instructions on setting it up?

[Lynne]

I don't know the actual name of it as it has changed a few times (mine still is just called "tsq"). Here are the specifics of setting it up.

Title: Search Queue Update
Minute: 0, 10, 20, 30, 40, 50
Active: Yes
Filename: ./includes/cron/queueprocessor.php

Save it. Run it. It should now be set to run every 10 minutes on your forum and index all new posts every 10 minutes.

[John Lester]

Thank you Lynne :)

There was a process called queuprocessor but for some reason it was set to run every 0 hour every ten minutes. I have just now changed that to * (every hour) and every 10 minutes and will see if it's working properly tomorrow.

--------------- Added 1370117863 at 1370117863 ---------------

Ok so queueprocessor wasn't running even with all settings set properly. I have just created the task that you laid out of me and will report back when I check it again later today :)

[John Lester]

Ok it's not running at all. In the scheduled task manager it shows when it's supposed to run next, but it never shows up in the log, and it's not running. So I attached two screen shots, the first is how the task is set up, and the other is the task log showing that it isn't running.

Note: It doesn't show in the log even when it's run manually. The log shows a span of roughly 3 hours of tasks.

[Lynne]

You don't have a log phrase in there. Also, are you checking your error_logs ?

[John Lester]

Sheesh.....you're right I don't have a phrase in there *smacks the back of his head* I haven't seen anything in the error logs that relates to scheduled tasks, just a few 404 errors that I haven't figured out yet :D

Ok so I'll put in a log phrase and see what happens.

[John Lester]

Ok I placed a log phrase but it's still not showing up on the task log. In case I'm missing something in the error log, I have attached it as a .txt file.

[Zachery]

So if you run it manually, what happens? Any error or output?

[John Lester]

If I run it manually there are no errors, no indication in the task manager log that it ran, and no update to the "view forum posts".

[Lynne]

This file exists on your site - /includes/cron/queueprocessor.php ?

I just clicked the search link in the first post and I am getting results of posts from today. So, why are you thinking it isn't working?

[John Lester]

Yep just looked again and the file is there. Some of my members are complaining that when they use that feature to find posts by someone it's not returning the most recent results. In some cases the results are weeks old even though the person being searched has posted either the day before the the day of the search. When I check the member being searched, often I will not get recent posts either. So something's out of whack I just haven't narrowed it down yet.

I don't quite understand the purpose of queueprocessor.php ... is it supposed to be only 2K (file size)? Mine looks complete but sure looks like it doesn't do anything, but I am a complete noob when it comes to vB's code :D

[Lynne]

Do all your forums have Index New Posts in Search Engine set to Yes? If it is set to No, then no posts in that forum will be indexed and thus they will not show up in ANY search.

[John Lester]

All forums were set to yes and one category was set to no. I switched to category to yes and will see if that has any effect. Another note to mention ... the scheduled task "Search Queue Update" doesn't show up in the log for my super admin account either. Which sucks I was hoping maybe I didn't give my normal admin account the proper permissions but it looks like that's not the issue :(

[Lynne]

I just looked on my test site and nothing gets logged when the Search Queue Update job gets run. I think it's because of the way it's coded (I don't see it having the log_cron_action code at the end).

[John Lester]

Well that makes sense :) Thanks Lynne for looking into that part :cool:

[John Lester]

I have yet to resolve this issue and have been getting more complaints. To summarize:

Clicking on a members profile and then clicking on "view forum posts" doesn't return all of the users posts. It seems to randomly select either really old posts, or only new posts.

Using advanced search to look up a users posts only returns 150 or so results, no matter how many posts they've made.

There are multiple pages shown for members with lots of posts when a search of their posts is done. However the last 4 or 5 always return a "no results" error when navigating to them either by clicking on the page, or clicking the arrow until the page is reached.

I have gone through this thread and repeated the creation of the task mentioned by Lynne with no success :(

Anyone have any ideas?

[Lynne]

First off, are ALL the forums in the Forum Manager set to Index New Posts in Search Engine (if you change that, you MUST go to Maintenance > General Update Tools and Rebuild your search index). Actually, I would suggest Rebuilding your search index to see if that fixes the issue.

When you click to view the users posts, you will ONLY get the number of results set in AdminCP > Settings > Options > Searching Options > Maximum Search Results to Return . If that is set to 150 and a user has 1000 posts, you will only get 150 returned.

[John Lester]

Yes all of the forums (and categories) are set to index new posts. Did that last time I brought this up. Max search results to return was bumped from 10K to 30K (nobody currently has more than 23K posts) back then as well.

It's a little frustrating to have this happen, as a lot of good information is almost impossible to find now. I'll be upgrading the forum in the summer after classes and hopefully that fixes the issue.

[Lynne]

Your server may not allow you to return that many posts.

I know you said you have all the forums set to index new posts now, but you didn't say whether you ran Rebuild Search Index also which is needed if you change that setting.

[John Lester]

I have rebuilt the search index and contacted the host (the last time I brought this up). The host says they can't see anything that would prevent the search from returning all of the results.

But let's just say that there is a setting limiting the number of returns, that still doesn't explain the sporadic omission of newer results that would fall below the setting limit.

I'll send another ticket to the host and see if someone else spots something on their end :D

[Lynne]

It would be the PHP setting max_input_vars that could restrict the number of results you get. And, if you have suhosin, there are settings for that which would do the same (I'm not sure about mod_security, but I would guess so with that also).

Did you ever say what version of PHP and MySQL are on the server?

Did you ever ask your host if they changed anything on your server at about the time this problem started?

[John Lester]

PHP setting max_input_vars is at 1000. Host didn't change that but they changed the memory from 64MB to 128MB with no effect. Just waiting to hear back on any other possible additional tweaks.

PHP is 5.3.25 and MySQL is 5.1.73

--------------- Added 1430373996 at 1430373996 ---------------

Host reinstated previous memory size (don't know why they increased that anyways) and increased max_input_vars to 2000 with no effect :(

Something I've noticed when searching using different members. Some will return random results (date wise) all the way back to the day the boards went live. However some will only return dates back to last year even though the poster has hundreds or thousands of post prior to 2014.

I re-uploaded all files earlier today in case there was a bug with one causing this issue, did not fix it :(

[Lynne]

How many rows in your post table?

How many rows in your searchcore table? (It should have more than your post table if it was reindexed completely.)

[John Lester]

Rows in post table = 39580, rows in searchcore table = 5376 .... hmmm odd. I will rebuild the search index and check after. Thanks for that info Lynne :)

--------------- Added 1430534415 at 1430534415 ---------------

After emptying the search index and rebuilding it, it appears to be working properly now :) I'm wondering if something interrupted the rebuild the last time I tried.

Asked my members to perform exhaustive searches, if nobody reports any issues then I can cross this off my list!

[Stratis]

I had same issue, for some how I changed the number in field
"Maximum Search Results to Return"
Question: What number must we put here is better? is there a problem if we put 1000 or 2000?

If this number is smaller than posts members have it will not show them all in results.
:)

[Lynne]

The server PHP setting max_input_vars is often set to 1000 which means you won't be able to get more than 1000 results even if you set the results to 2000.

[Stratis]

Actually I have put it to test as number 3000
Member result is: Results 2601 to 2620 of 2620 (last page)
I see 105 pages, 25 results in a page.

I don't know if it is problem to have it so high? Thanks for the answer.

[Lynne]

It can cause server load issues. But if you have a good server, then you shouldn't need to worry.

[John Lester]

It's only been a few days, but everyone is reporting back that the search works now :) Thanks Lynne:cool: