We index all threads right from the start on forums we can access. We basically index all new threads as they are posted to power the persistant search features and have a fresh index while in the background we do a full historical scan to get existing threads which we do gradually and in a smart way to ensure it causes no load issues - on a big board this can take a while but we do eventually get pretty much all the visible threads.
:banana:
|