I wrote my own spider and translated all my pages in 40 languages. According to vbSEO sitemap generator - somesthing between 50-60K pages (don't remember exactlly) including oryginal not translated pages. DB stats:
TABLE ROWS SIZE
wt_cache 168 930 166,0 MB
wt_cache_medium 490 901 144,7 MB
wt_cache_short 812 496 66,0 MB
Would you care to share that spider? I would be interested in using it. My server has the horsepower and bandwidth and with 320,000 posts, I would like to get a leg up! Feel free to PM me.
On a related note, can you give me a short explanation of the three databases? How do they correlate with the 50-60k that the sitemap reports?
Would you care to share that spider? I would be interested in using it. My server has the horsepower and bandwidth and with 320,000 posts, I would like to get a leg up! Feel free to PM me.
On a related note, can you give me a short explanation of the three databases? How do they correlate with the 50-60k that the sitemap reports?
Great Mod guys, as I said before I am loving it.
You can just turn the crawl rate up in Google Webmaster Tools, that works.
Would you care to share that spider? I would be interested in using it. My server has the horsepower and bandwidth and with 320,000 posts, I would like to get a leg up! Feel free to PM me.
On a related note, can you give me a short explanation of the three databases? How do they correlate with the 50-60k that the sitemap reports?
Great Mod guys, as I said before I am loving it.
Some people was already asking me - it is written in Java and uses its testing engine - without IDE you will not be able to even run it. If someone feel good in Java, is able to run tests and edit code to change some hardcoded things, then PM me
About cache tables - those split short, medium and long translations. Thanks that it works much faster, because short and medium data have full indexes and unique constraints which preserves data duplication. How those tables correlates with 50-60k of pages in sitemap - they have something about 50k translated pages from my forum
Some people was already asking me - it is written in Java and uses its testing engine - without IDE you will not be able to even run it. If someone feel good in Java, is able to run tests and edit code to change some hardcoded things, then PM me
About cache tables - those split short, medium and long translations. Thanks that it works much faster, because short and medium data have full indexes and unique constraints which preserves data duplication. How those tables correlates with 50-60k of pages in sitemap - they have something about 50k translated pages from my forum
I made a really basic spider in PHP. Heres an element of it. If you build on it you could make it work nicely
Warning: mysql_connect() [function.mysql-connect]: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) in /home/climarso/public_html/forum/translate.php on line 41
Could not connect: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)