Added forums via CSV file to the database, not all show in forum index.

[TWood]

I used phpMyAdmin and a CSV file to add a bunch of forums in bulk to the 'forum' table in the MySQL database. I discovered that to get them to show in the forum list on the front page of the website, I had to go to Admin Control Panel>Maintenance>Update Counters>Rebuild Forum Information.

That worked until I hit the point in the list where the forum ID is number 198. After that, none of the newly created forums will show up in any listing, including Forum Manager in the ACP, even though they are there in the forum database table.

Also, I've deleted a couple of forums from the list in the database, but those forums DO show up in the forum list page.

http://www.mazofo.com/forum/ 797591 and 787592 shouldn't be there.

So obviously there's a cache somewhere that needs updating. Any ideas welcome.

Thanks,

TW

The first image shows the place in the database table where the new forums stop appearing in the forum index in vBulletin. The second image is the last rows of the table. The third image is of the far right columns at the place where the forums stop appearing in the vBulletin forum index.

[Marco van Herwaarden]

You should not add new forums directly to the database, there is more to it then adding 1 row to the forum table.

[TWood]

I can't add them one at a time. I have to add 43,000 eventually, one for each zipcode, so they have to be done in the database. If 'there's more to it than adding one row to the forum table' then how do I find out what that 'more to it' is?

Thanks,

TW

[Marco van Herwaarden]

vBulletin (3.x) will not work with 43.000 forums. On most servers ~1.500-2.000 is the maximum.

[TWood]

I'm discovering that!

But I'll still need to add them through the database, I'll just break it down into separate installations.

I was able to add several hundred using this technique, then 'something' broke. I'm trying to figure out what broke.

[Marco van Herwaarden]

Most likely the datastore cache table could not hold all the data.

I'll just break it down into separate installations.

Please be aware that this will require multiple licenses.

[TWood]

Originally Posted by Marco van Herwaarden

Most likely the datastore cache table could not hold all the data.

Please be aware that this will require multiple licenses.

Okay, now we're getting somewhere. If I add them in smaller blocks, would that help the datastore table?

Yes, I know that this will require multiple licenses. I'm setting up a 'proof of concept' site for now. I just need to get the technical issues resolved.

[Marco van Herwaarden]

No adding them in smaller blocks would not help, as all the forums (and their description etc..) are serialized and stored in a single row in the datastore table.

[TWood]

Come on Marco, we're in the Yes We Can! era now.

How do I make this work?

Ironic that phpBB handled this problem very elegantly:

http://zipcode.forumity.com/forum.html

And that's on a free shared forum server.

TW

[Marco van Herwaarden]

It simply is not feasible to run vB3 with more then 1500-2000 forums.