command line re-indexing (copyright issues?)

[Ahmad]

Hi,

I've almost never did a 'complete' rebuild of our forum indexes. Everytime I find my self faced with timeout, browser or network problems interrupting the process. And I find the feedback provided by maintainence scripts in general not the nicest thing. A progress bar would be much better.

I suddenly become very creative and productive when exams are around the corner!

I've just finished porting the vBulletin search index rebuilding code to Python. Tested it on my notebook with my (3 posts) test vB installation, and it worked great. Comparing the 'word' and 'postindex' tables it produces, they were exactly the same as those produced by vBulletin.

Our current host is not so great. They have an old version of python and don't have the MySQL package installed. I will test it again when I load my test installation with data from our live installation.

Anyway, I have questions about laws/ethics of distributing the code I made.

1. First of all, the code is almost a literal translation of the vBulletin code. I wanted it to produce the same results, so I had to do it this way (at least initially). It is, of course, written in a different programming language, so I had to read PHP and write Python myself. So it is not an exact copy. But I haven't even changed function and variable names.

2. I had to 'borrow' the list of bad words found in searchwords.php. Is this list available somewhere else on the net? where did vBulletin get it from? I can probably find similar, maybe even better lists, but I want it to be as close to the way vBulletin originally works as possible.

Another problem I'm wondering about is if this is considered a hack at all. It's doesn't contain any PHP


I am planning to re-write it later all in my own code, but untill then, can I release this hack here?

I'll leave you now with what it looks like:

C:\Documents and Settings\TOSHIBA\Desktop>python vbindexer.py
vbindexer v0.1a (c) 2004, Ahmad Alhashemi <http://www.ahmadh.com/>
MySQL host:
MySQL username:
MySQL password:
MySQL database ['forum']:
Table prefix [none]:
Empty existing indexes first? [y]:

Dropping indexes... Done.

Indexing posts...

post#                       progress                        done/total    ETA
    7 [=======================100%=======================]     3/    3 00:00:00

* For the clueless. Python is a (the) programming langauge. See http://www.python.org/ for more information.

[mixylplik3]

Since I can't obtain this, I assume there was a copyright problem?

[Ahmad]

Actually, I didn't recieve any comment regarding this, and I'm still not sure. I figured that there isn't a lot of interest in it, so I didn't follow this up.

It's a nice conicidence that you posted this reply right when I started testing it on our live board, which uncovered a couple of bugs and python regex limitations I shall be working on.

Are you interested in the script?

[mixylplik3]

Yes! I'd love to run this script!

[Ahmad]

I'd love to give it to you. I'm actually in the process of re-writing it, and will probably release it soon, but I'm not sure how much time this will take.

How about this.. If it's not finished by next Friday, send me a pm, and I'll give it to you as-is.

[telc]

I just found out today, that vbulletin provides a command line shell script to reindex the search tables. It is in the Do_Not_Upload folder when you download vbulletin. Its called searchsearchshell.php. I am running it right now and it is flying. Only 4.5million more posts to go .

[bjs144]

Originally Posted by muxx

I just found out today, that vbulletin provides a command line shell script to reindex the search tables. It is in the Do_Not_Upload folder when you download vbulletin. Its called searchsearchshell.php. I am running it right now and it is flying. Only 4.5million more posts to go .

Thank you so much!!

You have saved me so much time here!!

I am so so please!!