View Full Version : Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator
Ogmuk
05-25-2009, 10:27 AM
My sitemap xml file is at: http://#####.co.nz/vbseo_sitemap/data/sitemap_1.xml.gz
and the .htaccess file is at http://#####.co.nz/ I have no Forum file so all sub files are off my root directory.
Since you do not have a forum directory, your sitemap should be accessible at: http://#####.co.nz/sitemap_index.xml.gz - if it's not then the htaccess isn't forwarding correctly.
jack the lad
05-25-2009, 06:39 PM
My htacces is :RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
I have now moved my http://#####.co.nz/sitemap_index.xml.gz to my root directory.
I will let you know how I get on.
Many thanks
Ogmuk
05-25-2009, 07:48 PM
You shouldn't move it. The htaccess forwards each request at http://#####.co.nz/sitemap_index.xml.gz to http://#####.co.nz/vbseo_sitemap/data/sitemap_index.xml.gz (but there should not actually be a file at http://#####.co.nz/sitemap_index.xml.gz, it just forwards). In fact, you should not be able to even access http://#####.co.nz/vbseo_sitemap/data/sitemap_index.xml.gz directly if you put the other htaccess there. It should only be accessible at http://#####.co.nz/sitemap_index.xml.gz. Are you using Apache?
jack the lad
05-25-2009, 09:27 PM
Are you using Apache?
Don't know, why and where would I find out?
Cheers
I have move back my http://#####.co.nz/sitemap_index.xml.gz and Google webmaster tools say's everything is sweet, for now anyway :)
jack the lad
05-26-2009, 04:49 AM
Nah, still got the same errors :down:
Any idea's?
Ogmuk
05-26-2009, 11:42 AM
There are various ways to check which internet server is running on your server. But usually if it's Linux, it's using Apache. If it's Windows, it's usually IIS (internet information server). One way to do it is using this site:
http://uptime.netcraft.com/up/graph
Insert your domain name at the top. Then at the results, you may get various different results but the OS and server listed at the top should show what the server is running now.
If you're using Windows with IIS then htaccess files don't work. There are still work-arounds for it (since I'm using IIS too) but you need to figure out which internet server you're using first.
jack the lad
05-26-2009, 06:25 PM
Ogmuk- It's Apache.
Thanks for the link.
Does this affect me?
Ogmuk
05-26-2009, 08:17 PM
Ok, htaccess should work then. Check if it's called .htaccess, so that starts with a dot. Also check if the .htaccess inside vbseo_sitemap/data is present. This is a different one, which just says "deny from all".
The .htaccess from the vbseo_sitemap-2-5.zip, inside the htaccess directory, should be located at http://#####.co.nz/.htaccess - if you would try to load it from your browser it should say Forbidden. If it says "The page cannot be found" then it's not in the right place. Also check if http://#####.co.nz/vbseo_sitemap/data/.htaccess is present.
There might also be the possibility that your host doesn't let you use .htaccess files. In that case there is little you can do. You can test this with these steps: http://www.webune.com/forums/how-to-test-check-if-mod-rewrite-is-enabled-t40.html
AKBAR
05-28-2009, 05:34 AM
Thanks!
jack the lad
05-29-2009, 05:32 AM
I must say a BIG thank you to Ogmuk. You have been fantastic in helping me out with my problems getting my site working correctly.
Above and beyond the call of duty my friend ;)
shinng
06-02-2009, 05:38 AM
the installation went smoothly, but i have no idea if it is working properly. can someone please confirm that it is working properly? i'd appreciate the confirmation.
thanks.
Ogmuk
06-02-2009, 06:08 AM
the installation went smoothly, but i have no idea if it is working properly. can someone please confirm that it is working properly? i'd appreciate the confirmation.
thanks.
On which domain did you install it? If it's the domain from the signature then it's not working. This URL should give a sitemap and it doesn't: http://www.sportsgatherings.com/forum/sitemap_index.xml.gz
Check if the sitemap files are here: http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz and if you have a .htaccess in http://www.sportsgatherings.com/forum/ which forwards each request to the data/sitemap_index.xml.gz url.
almohd
06-02-2009, 09:47 AM
Thanks
W!cKeD
06-02-2009, 10:11 AM
* Thanks & Installed * :up:
rrudeboy
06-02-2009, 02:12 PM
i installed this and ran it.. nice but i thought this was also required to make links look nicer like giving them a title so i don't have to do it with BB code... anyone ?
iojam
06-02-2009, 08:24 PM
That is a feature of vBSEO product, not vBSEO Sitemap Generator.
shinng
06-03-2009, 02:30 AM
On which domain did you install it? If it's the domain from the signature then it's not working. This URL should give a sitemap and it doesn't: http://www.sportsgatherings.com/forum/sitemap_index.xml.gz
Check if the sitemap files are here: http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz and if you have a .htaccess in http://www.sportsgatherings.com/forum/ which forwards each request to the data/sitemap_index.xml.gz url.
thanks for the quick response, unfortunately, i don't know how to get it fixed. all the folders/files seem to be in the correct location.
before you (or anyone else) answers that question, i want to go back to the domain issue you brought up. i have a sitemap as you saw on my main site, which is sportsgatherings.com so do you think i need to create a sitemap for sportsgatherings.com/forum? technically since it's off the same domain, i wouldn't need to right? usually the reason why people would want this mod installed is because their site is a forum from the get go as opposed to a blog/website like mine is. let me know, thanks again.
Ogmuk
06-03-2009, 05:33 AM
i have a sitemap as you saw on my main site, which is sportsgatherings.com so do you think i need to create a sitemap for sportsgatherings.com/forum? technically since it's off the same domain, i wouldn't need to right? usually the reason why people would want this mod installed is because their site is a forum from the get go as opposed to a blog/website like mine is. let me know, thanks again.
This is a sitemap for your forum, not your entire website and since you can submit multiple sitemaps to search engines, it will help get the more popular threads indexed quicker.
1) Insert a password for people to access vbseo_sitemap/index.php because it's publicly accessible now. (AdminCP -> vBSEO -> vBSEO Sitemap Settings -> vBSEO Sitemap Interface Access Password)
2) Check the value of "Sitemap Files URL" (also in AdminCP -> vBSEO -> vBSEO Sitemap Settings). It should be empty.
3) AdminCP -> vBSEO -> vBSEO Sitemap Reports -> Run Sitemap Generator
4) Check if /forum/vbseo_sitemap/data/sitemap_1.xml.gz is there. If it is then it's a .htaccess problem.
gamerfu
06-03-2009, 04:16 PM
Google and Yahoo! fails, what is wrong?
Summary:
============================
Forum Display: 126
Show Thread: 7677
Show Post: 65949
Member Profiles: 388
Poll Results: 138
Blog Entries: 0
Blog Tags: 0
Album URLs: 4
Social Groups URLs: 51
Tag URLs: 43
Archive: 2032
Total Indexed URLs: 76341
Total Processing Time: 23.14 seconds
Google ping: FAILED.
Yahoo ping: FAILED.
Ask ping: Successful.
Moreover ping: Successful.
Live.com ping: Successful
shinng
06-08-2009, 07:09 AM
This is a sitemap for your forum, not your entire website and since you can submit multiple sitemaps to search engines, it will help get the more popular threads indexed quicker.
1) Insert a password for people to access vbseo_sitemap/index.php because it's publicly accessible now. (AdminCP -> vBSEO -> vBSEO Sitemap Settings -> vBSEO Sitemap Interface Access Password)
2) Check the value of "Sitemap Files URL" (also in AdminCP -> vBSEO -> vBSEO Sitemap Settings). It should be empty.
3) AdminCP -> vBSEO -> vBSEO Sitemap Reports -> Run Sitemap Generator
4) Check if /forum/vbseo_sitemap/data/sitemap_1.xml.gz is there. If it is then it's a .htaccess problem.
thank you very much for the step by step instructions. i did everything you suggested and after running the sitemap generator, i do see this:
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 294 [3,222.6Kb mem used] [0s (+0s)]
and this:
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 1 [3,223.0Kb mem used] [0s (+0s)]
Sitemap has been created
i'm assuming that it's good to go.
Ogmuk
06-12-2009, 11:13 AM
It's not working yet. Check if this file exists on your server:
/forum/vbseo_sitemap/data/sitemap_index.xml.gz
shinng
06-12-2009, 06:45 PM
It's not working yet. Check if this file exists on your server:
/forum/vbseo_sitemap/data/sitemap_index.xml.gz
I see it in my server (I use filezilla), but the sitemap_index.xml.gz is a winzip file. Should this be extracted?
ugurcafe
06-12-2009, 07:30 PM
thnks
Crystal Shards
06-12-2009, 07:37 PM
Can you make this so it works with "Check Version"?
Ogmuk
06-13-2009, 06:21 AM
I see it in my server (I use filezilla), but the sitemap_index.xml.gz is a winzip file. Should this be extracted?
No, that's fine. Your server keeps giving a 404 though. I am checking this URL:
http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
You can start with temporarily removing or renaming the .htaccess in forum/vbseo_sitemap/data/ to exclude the possibility that this .htaccess file is causing this problem.
shinng
06-13-2009, 09:47 AM
No, that's fine. Your server keeps giving a 404 though. I am checking this URL:
http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
You can start with temporarily removing or renaming the .htaccess in forum/vbseo_sitemap/data/ to exclude the possibility that this .htaccess file is causing this problem.
I removed the .htaccess file from forum/vbseo_sitemap/data/. However, I noticed that when I open the htaccess folder, this folder contains the .htaccess file along with htaccess.txt, isapi_rewrite.txt, lighttpd_rewrite.txt, and zeus_rewrite.txt. I see those 5 files in the folder, but I don't think I uploaded those 4 txt files into my forum/vbseo_sitemap/data folder. Should I try reuploading all 5 files or are those 4 txt files irrelevant? Previously the 4 .txt files were not uploaded, only the .htaccess file was before I deleted it.
Ogmuk
06-13-2009, 10:06 AM
I removed the .htaccess file from forum/vbseo_sitemap/data/. However, I noticed that when I open the htaccess folder, this folder contains the .htaccess file along with htaccess.txt, isapi_rewrite.txt, lighttpd_rewrite.txt, and zeus_rewrite.txt. I see those 5 files in the folder, but I don't think I uploaded those 4 txt files into my forum/vbseo_sitemap/data folder. Should I try reuploading all 5 files or are those 4 txt files irrelevant? Previously the 4 .txt files were not uploaded, only the .htaccess file was before I deleted it.
Worry about that htaccess after it's working.
http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
This is working now because you removed the htaccess.
Now the next step is to get the forward from http://www.sportsgatherings.com/forum/sitemap_index.xml.gz to http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz working with the .htaccess.
1) Upload the .htaccess from the zip, in the htaccess folder to http://www.sportsgatherings.com/forum/ or if you already have a htaccess there, edit it and add the 2 lines.
2) Check if http://www.sportsgatherings.com/forum/sitemap_index.xml.gz works now.
3) If it does, upload the .htaccess from the zip: upload/vbseo_sitemap/data/.htaccess to http://www.sportsgatherings.com/forum//vbseo_sitemap/data/
4) Check if http://www.sportsgatherings.com/forum/sitemap_index.xml.gz still works. http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz should now give an error. If so, then you're done.
shinng
06-13-2009, 06:33 PM
Worry about that htaccess after it's working.
http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
This is working now because you removed the htaccess.
Now the next step is to get the forward from http://www.sportsgatherings.com/forum/sitemap_index.xml.gz to http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz working with the .htaccess.
1) Upload the .htaccess from the zip, in the htaccess folder to http://www.sportsgatherings.com/forum/ or if you already have a htaccess there, edit it and add the 2 lines.
2) Check if http://www.sportsgatherings.com/forum/sitemap_index.xml.gz works now.
3) If it does, upload the .htaccess from the zip: upload/vbseo_sitemap/data/.htaccess to http://www.sportsgatherings.com/forum//vbseo_sitemap/data/
4) Check if http://www.sportsgatherings.com/forum/sitemap_index.xml.gz still works. http://www.sportsgatherings.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz should now give an error. If so, then you're done.
I noticed that there are 2 .htaccessfiles when I extracted the zip file from here.
The 1st is located in the htaccess folder that contains .htaccess (123 bytes) and 4 txt files.
The 2nd is located in the uploads/data folder that contains .htacess (13 bytes) and index.php.
When I look at my /forum root, I already have a .htaccess file in there (121 bytes). When I upload the .htaccess (123 bytes) from the htaccess folder to the root, do I rename it and just upload it? If so, that is what I did. I also uploaded the.htaccess file (13 bytes) from the uploads/data folder to my forum/vbseo_sitemap/data. I think I'm still getting errors.
tommac3
06-13-2009, 09:35 PM
I am getting this error:
This page contains the following errors:
error on line 1 at column 1: Document is empty
Below is a rendering of the page up to the first error.
Ogmuk
06-14-2009, 05:53 AM
When I upload the .htaccess (123 bytes) from the htaccess folder to the root, do I rename it and just upload it? If so, that is what I did.
Shouldn't need to rename it. It's already called ".htaccess". Unless you are using htaccess.txt and renaming that to .htaccess. Which is the same thing.
I also uploaded the.htaccess file (13 bytes) from the uploads/data folder to my forum/vbseo_sitemap/data. I think I'm still getting errors.
Better to delete that until you get the first 2 steps working. That htaccess is making it more difficult to troubleshoot. If I were you I'd turn off the custom error pages on your server for now until you get this thing working. It's hard to see what's going wrong when I'm not seeing the precise error.
kmatwill
06-14-2009, 01:35 PM
Hi, I've been using this for a little while and just realized that for the most part, only my member profiles are being reported. This is supposed to report all posts, threads, etc. right? Is it because most of my forum is private?
Date 2009-06-14 05:42
Processing time 4.59 s
Total URLs 1,586 (-19)
Forumdisplay URLs 1 (-1)
Showthread URLs 0 (-)
ShowPost URLs 0 (-)
Archive URLs 2 (-1)
Member Profile URLs 1,581 (-17)
Poll Results URLs 0 (-)
Blog Entries URLs 0 (-)
Blog Tag URLs 0 (-)
Album URLs 0 (-)
Social Group URLs 0 (-)
Tag URLs 1 (-)
Ogmuk
06-14-2009, 06:23 PM
Yeah, personally I have Showpost URLs turned off because else the number gets too large but it looks like you have Showthread URLs turned off as well, which is the most important one.
kmatwill
06-14-2009, 07:08 PM
Thank you. Unfortunately those options are set to Yes, so I'm not sure why they aren't showing... Anyone else have any ideas?
iojam
06-16-2009, 12:24 AM
The threads must be visible to guests, otherwise they are not inlcuded in sitemap (since search engines will not be able to view them anyway).
KipLarson
06-16-2009, 01:59 AM
I run a wordpress blog on the main portion of my site and have the forum installed on mysite.com/forum/
So through Wordpress I use a plugin that does a Google sitemap generator:
http://wordpress.org/extend/plugins/google-sitemap-generator/
So my question is should I use the vBSEO sitemap plugin in addition to this wordpress one as well or should I just run the wordpress one perhaps?
I assume Google doesn't take multiple sitemaps...
Thoughts?
Ogmuk
06-16-2009, 09:35 AM
I assume Google doesn't take multiple sitemaps...
Thoughts?
https://www.google.com/webmasters/tools/
Get your site verified there, then you can submit multiple sitemaps.
Blue91
06-17-2009, 10:07 PM
Can someone help me verify if this is working? I get a log file within my vbseo_sitemap/data directory stating google received the sitemap, etc etc.
I feel like I did everything correctly but in reading post #263 by Ogmuk (https://vborg.vbsupport.ru/showpost.php?p=1821850&postcount=263), he states to Shinng that his link (http://www.sportsgatherings.com/forum/sitemap_index.xml.gz) should show a sitemap. When I try to see a sitemap at that same location but with my domain, I do not. I have that file on my server in the data directory, but when I go to www.pomoforacing.com/forums/sitemap_index.xml.gz, I get a "site not found."
Is it just that the link he typed above was incorrect? If I go to http://www.pomoforacing.com/forums/vbseo_sitemap/data/sitemap_index.xml.gz, I get a "forbidden" (it's there, just forbidden to view).
Thanks.
*edit* For now, nevermind... for some reason, I don't have access to upload the .htaccess file to my forums directory. I can add the /data/ one, but not the main one. Unsure why and cannot access server control panel until I get home from work.
accludetuner
06-18-2009, 09:20 PM
I installed this mod, checked it out and due to the fact that it ONLY adds links to your forum specific stuff like posts and blogs I uninstalled it. I would love if it actually crawled the site and indexed all the links from your site, not just the VB specific ones. Great idea, but very limited control and scope of what gets added to the sitemap files so I had to pass on this one.
SirHappy
06-20-2009, 03:13 PM
thx. nice works.
TosaInu
06-20-2009, 06:07 PM
Hello,
the .htacces goes to the forumroot (/forum) not the web accessible root of the site (/), right?
Ogmuk
06-20-2009, 07:37 PM
Hello,
the .htacces goes to the forumroot (/forum) not the web accessible root of the site (/), right?
Correct.
TosaInu
06-20-2009, 08:59 PM
Thank you Ogmuk.
My data folder contains some 87 sitemap-x-.xml.gz now and googlebot just started downloading them. It has downloaded over 260 files though (duplicates). Is that normal?
TosaInu
06-21-2009, 08:48 AM
Hello,
Our forum is stored on a subdomain: http://forum.mysite.com The forum is located inside its own directory: http://forum.mysite.com/vb
I installed this version like instructed by the manual. So, the .htacces goes to http://forum.mysite.com/vb and the whole vbseo_sitemap directory and contents to http://forum.mysite.com/vb. Folders are CHMOD 777. In the ACP VBSEO settings search engines are notified automatically.
I ran the sitemap script and sitemaps are generated and stored inside http://forum.mysite.com//vb/vbseo_sitemap/data/
According to the report list in the ACP, the search engines are notified (confusing again, because Yahoo has to be notified manually?). According to the sitemap download log, the files are downloaded by googlebot. They were downloaded more than once yesterday after having installed the hack (shouldn't that be just once?).
Today there still is not a single sitemap file in google webmasters tool.
I guess something is still wrong?
This also confuses me. In the ACP/VBSEO settings it reads:
By default the vBSEO Sitemap files will be located in your forum root. Use this field to specify a different location, for example, your site root: http://www.yourdomain.com
NOTE: You must edit the .htaccess file of the folder in which you want to locate your sitemap files. More information here. Leave this setting empty to use default vB url.
I thought the files are stored in http://forum.mysite.com//vb/vbseo_sitemap/data/ by default?
djbaxter
06-21-2009, 03:14 PM
My data folder contains some 87 sitemap-x-.xml.gz now and googlebot just started downloading them. It has downloaded over 260 files though (duplicates). Is that normal?
No. Why do you have all those duplicates? Updates to the sitemap should overwrite the old files, not create brand new ones.
Our forum is stored on a subdomain: http://forum.mysite.com The forum is located inside its own directory: http://forum.mysite.com/vb
I installed this version like instructed by the manual. So, the .htacces goes to http://forum.mysite.com/vb and the whole vbseo_sitemap directory and contents to http://forum.mysite.com/vb. Folders are CHMOD 777. In the ACP VBSEO settings search engines are notified automatically.
I ran the sitemap script and sitemaps are generated and stored inside http://forum.mysite.com//vb/vbseo_sitemap/data/
:confused:
If you created a subdomain for your forum, why would you then create a subfilder in that subdomain to install it? It would seem far more logical to install the forum in the root. You're making things unnecessarily complicated.
Second, the instructions as to where to find the sitemap need to be in the root directory unless you otherwise specifiy where to find them using the sitemap declaration in a robot.txt file in the root directory. In your case, the root directory is forum.mysite.com/ not forum.mysite.com/vb/.
According to the report list in the ACP, the search engines are notified (confusing again, because Yahoo has to be notified manually?).
I believe that was only when Yahoo was using the text format. Now that they're using the XML format like everyone else, it's all automatic. I've never done a manual notification.
According to the sitemap download log, the files are downloaded by googlebot. They were downloaded more than once yesterday after having installed the hack (shouldn't that be just once?).
It depends on how often you run the sitemap generator. Check your cron files.
Today there still is not a single sitemap file in google webmasters tool. I guess something is still wrong?
Any errors will be noted in your Webmaster Central account - check there to find out what's wrong.
This also confuses me. In the ACP/VBSEO settings it reads:
By default the vBSEO Sitemap files will be located in your forum root. Use this field to specify a different location, for example, your site root: http://www.yourdomain.com
NOTE: You must edit the .htaccess file of the folder in which you want to locate your sitemap files. More information here. Leave this setting empty to use default vB url.
I thought the files are stored in http://forum.mysite.com//vb/vbseo_sitemap/data/ by default?
They are. Ignore this part for now. You have enough to figure out already and you certainly don't want to complicate it any further by messing with that setting.
TosaInu
06-21-2009, 04:09 PM
Hello djbaxter,
Thank you for replying.
No. Why do you have all those duplicates? Updates to the sitemap should overwrite the old files, not create brand new ones.
It doesn't make duplicate files in the directory. The googlebot seems to download them several times (within an hour, so they are not updated ones).
:confused:
If you created a subdomain for your forum, why would you then create a subfilder in that subdomain to install it? It would seem far more logical to install the forum in the root. You're making things unnecessarily complicated.
Because I can't create subdomains myself. The host is doing that and I have only a few. So, I have to put several things on one subdomain to prevent a cluttering and clash of names.
Second, the instructions as to where to find the sitemap need to be in the root directory unless you otherwise specifiy where to find them using the sitemap declaration in a robot.txt file in the root directory. In your case, the root directory is forum.mysite.com/ not forum.mysite.com/vb/.
Hmm, thus the .htaccess supplied with this hack needs to be in forum.mysite.com and not forum.mysite.com/vb? But how comes google seems to be downloading the sitemap?
And that means I have to change the .htaccess a bit from
RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
to:
RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vb/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
Right?
I believe that was only when Yahoo was using the text format. Now that they're using the XML format like everyone else, it's all automatic. I've never done a manual notification.
Ok.
It depends on how often you run the sitemap generator. Check your cron files.
The default one, I recall it's once a day.
Any errors will be noted in your Webmaster Central account - check there to find out what's wrong.
No errors are reported.
They are. Ignore this part for now. You have enough to figure out already and you certainly don't want to complicate it any further by messing with that setting.
Ok, the problem is just with the location of the .htaccess I guess?
djbaxter
06-21-2009, 04:23 PM
1. I don't understand how it's possible that Google is trying to download the sitemap, not shoiwing it as successful, and yet not reporting any errors... unless you already have a sitemap in the root for forum.mysite.com? Try deleting ALL existing sitemaps and the manually running the cron job again from your vBulletin Admin CP (after relocating the .htaccess file).
2. No, you don't change the rewrite rules/instructions. That is already set up in the vB ACP. Leave it as it is.
TosaInu
06-21-2009, 05:25 PM
Hello djbaxter,
No, I don't have a sitemap in the root.
I recall having experimented with vbseo a year ago or so and I did edit the .htaccess in the root then (http://forums.mysite.com). That info is still there in the rewrite rules:
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vb/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
{{Aik, I'm starting to understand what went wrong this year: nothing was there.}}
So, I only have the default htaccess supplied by this hack in forums.mydomain.com/vb and I remove the line from the root .htaccess? But how does google then know it should look into forums.mydomain.com/vb? Through the robot.txt like you mentioned? What do I put there?
Nothing at all? Is the right url submitted to the searchengines when completing the creation through CRON or run?
djbaxter
06-21-2009, 06:33 PM
No, I don't have a sitemap in the root.
I recall having experimented with vbseo a year ago or so and I did edit the .htaccess in the root then (http://forums.mysite.com). That info is still there in the rewrite rules:
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vb/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
Is this the edited version? or the version created when you installed vbseo_sitemap? Don't use the edited one.
So, I only have the default htaccess supplied by this hack in forums.mydomain.com/vb and I remove the line from the root .htaccess? But how does google then know it should look into forums.mydomain.com/vb? Through the robot.txt like you mentioned? What do I put there?
No. I didn't say remove the lines from .htaccess in the root. I said remove any sitemap files currently in the root. You need the redirect lines in the root directory version of .htaccess because it will redirect Google spiders when they go there to access them. Leave the lines in an .htaccess file in the /vb/ folder as well (I don't know how you have things set up in Webmaster Central - having it in both places shouldn't hurt and it may help).
Is the right url submitted to the searchengines when completing the creation through CRON or run?
It should be unless you've messed up any of the settings. If worst comes to worst, uninstall and then reinstall vbseo_sitemap to get back to the proper settings and then follow the directions given to you during the installation or in the instructions for installation.
TosaInu
06-21-2009, 06:56 PM
Is this the edited version? or the version created when you installed vbseo_sitemap? Don't use the edited one.
It's an edited line I appended to an existing .ht in http://forums.mydomain.com
I'm pretty sure vb/ needs to be added to the path, otherwise it points to the non-existing folder http://forums.mydomain.com/vbseo_sitemap It is http://forums.mydomain.com/vb/vbseo_sitemap ?
You need the redirect lines in the root directory version of .htaccess because it will redirect Google spiders when they go there to access them. Leave the lines in an .htaccess file in the /vb/ folder as well (I don't know how you have things set up in Webmaster Central - having it in both places shouldn't hurt and it may help).
You mean in vb's ACP regarding VBSEO? The default values.
djbaxter
06-21-2009, 07:17 PM
It's an edited line I appended to an existing .ht in http://forums.mydomain.com
I'm pretty sure vb/ needs to be added to the path, otherwise it points to the non-existing folder http://forums.mydomain.com/vbseo_sitemap It is http://forums.mydomain.com/vb/vbseo_sitemap ?
You mean in vb's ACP regarding VBSEO? The default values.
:confused:
How can it be both the "default values" and an "edited line"?
In any case, try what I've suggested so far. I don't understand a lot of what you're posting here, not the least of which is the statement that Webmaster Central is trying to download the sitemap, apparently not finding it, and yet not showing any errors. Either I'm missing something or you are - I don't see how that's possible.
If my suggestions don't work, you may need to wait for one of the vBSEO people to log in.
TosaInu
06-21-2009, 07:27 PM
:confused:
How can it be both the "default values" and an "edited line"?
In any case, try what I've suggested so far. I don't understand a lot of what you're posting here, not the least of which is the statement that Webmaster Central is trying to download the sitemap, apparently not finding it, and yet not showing any errors. Either I'm missing something or you are - I don't see how that's possible.
If my suggestions don't work, you may need to wait for one of the vBSEO people to log in.
Hello djbaxter,
Sorry for the confusion. By default values I mean what I set in Vbulletins ACP/VBSEO settings.
The edited line applies to the .ht I already had before I even knew about VBSEO. As far as I know searchbots only look in the root of a domain or subdomain for a sitemap. So, it has to be told there that it's somewhere else.
According to the VBSEO control panel, the sitemaps are created (and they are) and google is notified. Google then manages to download the files (according to the same VBSEO control panel). But when I go to googles Webmaster Central for my site, nothing is there.
Brathamike
06-22-2009, 01:03 AM
hello what are the these files for in the htaccess file
isapi_rewrite, lighttpd_rewrite, zeus_rewrite
do i keep them in the htaccess folder and put the whole folder in the root directory
or
do i take those files out of the htaccess folder and put them in the root directory
Also it says that this file is in my root directory sitemap_index.xml.gz but its not. when i generate
a site map i dont see this in my root directory when i click on the link to see my site map it says
page not found? any thoughts on this
thanks
please answer..
going to buy gold soon as i get the ansawer
Budweiser
06-22-2009, 02:18 PM
Hello. I use VBSEO and installed the sitemap v2.5
I want to add a line to robots.txt (EG: "sitemap: http://www.example.com/sitemap.xml")
What file is the sitemap? I see "sitemap_1.xml.gz" and "sitemap_index.xml.gz" and few others... I assume one of these is the file I need to point to?
Thnx, Kev
djbaxter
06-22-2009, 02:34 PM
The edited line applies to the .ht I already had before I even knew about VBSEO. As far as I know searchbots only look in the root of a domain or subdomain for a sitemap. So, it has to be told there that it's somewhere else.
Yes. That's what the mod_rewrite line and vbseo_getsitemap.php does. The bots will look in the root (usually); the mod_rewrite and vbseo_getsitemap.php redirect it to where the files are actually physically located. If you try to do the work of those two functions, you'll end up confusing the bots, yourself, and everyone else. Think simple. Let the add-on do the complicated work.
hello what are the these files for in the htaccess file
isapi_rewrite, lighttpd_rewrite, zeus_rewrite
do i keep them in the htaccess folder and put the whole folder in the root directory or do i take those files out of the htaccess folder and put them in the root directory
If you are using an Apache server with mod_rewrite enabled, ignore those files. They are for alternate server operating systems or configurations.
Also it says that this file is in my root directory sitemap_index.xml.gz but its not. when i generate a site map i dont see this in my root directory when i click on the link to see my site map it says page not found? any thoughts on this
See my reply to TosaInu above.
Hello. I use VBSEO and installed the sitemap v2.5
I want to add a line to robots.txt (EG: "sitemap: http://www.example.com/sitemap.xml")
What file is the sitemap? I see "sitemap_1.xml.gz" and "sitemap_index.xml.gz" and few others... I assume one of these is the file I need to point to?
Thnx, Kev
No. Just point to sitemap.xml -- mod_rewrite and vbseo_getsitemap.php take care of the rest.
Budweiser
06-22-2009, 07:11 PM
Hello. I use VBSEO and installed the sitemap v2.5
I want to add a line to robots.txt (EG: "sitemap: http://www.example.com/sitemap.xml")
What file is the sitemap? I see "sitemap_1.xml.gz" and "sitemap_index.xml.gz" and few others... I assume one of these is the file I need to point to?
Thnx, Kev
No. Just point to sitemap.xml -- mod_rewrite and vbseo_getsitemap.php take care of the rest.
Yes but... there is no sitemap.xml file to point to.. I am supposed to point to a file that is not there??
djbaxter
06-22-2009, 07:51 PM
Yes but... there is no sitemap.xml file to point to.. I am supposed to point to a file that is not there??
Yes. That's what those mod_rewrite lines do. They intercept any attempts to retirve sitemap.xml and redirect them to the appropriate file name and location.
Brathamike
06-22-2009, 08:47 PM
Originally Posted by Budweiser
Yes but... there is no sitemap.xml file to point to.. I am supposed to point to a file that is not there??
Yes. That's what those mod_rewrite lines do. They intercept any attempts to retirve sitemap.xml and redirect them to the appropriate file name and location.
I don't have mod rewrite and I still don't
see the site map and I still get a page that's not there
when I try to viewy site map
I still don't get it
djbaxter
06-22-2009, 09:22 PM
I don't have mod rewrite and I still don't
see the site map and I still get a page that's not there
when I try to viewy site map
I still don't get it
If you don't have mod_rewrite enabled on your server, the standard solution contained in the installation instructions for the vbseo_sitemap add-on will not work.
In that case, try the following...
Add the following line to the robots.txt file in the root directory of your site or create a plain text file (ASCII/ANSI format) containing the line and upload it to the root of your site:
Sitemap: http://www.yoursite.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
This assumes your forum is installed in a subfolder called "forum". If the subfolder name is something else, change the line to reflect both your actual domain and the actual subfolder name.
If your forum is installed in the root directory, the line would look like this:
Sitemap: http://www.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz
If your forum is installed in the root of a subdomain, it would look something like this:
Sitemap: http://forum.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz
Note that in all cases you are pointing the spiders to the real location of the sitemaps index file, which tells the spider how many sitemap files to look for and their filenames. This index file is created automatically by the vbseo_sitemap cron job.
Note that what I'm suggesting in this post is to be used instead of the standard mod_rewrite solution indicated in the vbseo_sitemap installation insturctions.
Brathamike
06-22-2009, 09:53 PM
If you don't have mod_rewrite enabled on your server, the standard solution contained in the installation instructions for the vbseo_sitemap add-on will not work.
In that case, try the following...
Add the following line to the robots.txt file in the root directory of your site or create a plain text file (ASCII/ANSI format) containing the line and upload it to the root of your site:
Sitemap: http://www.yoursite.com/forum/vbseo_sitemap/data/sitemap_index.xml.gz
This assumes your forum is installed in a subfolder called "forum". If the subfolder name is something else, change the line to reflect both your actual domain and the actual subfolder name.
If your forum is installed in the root directory, the line would look like this:
Sitemap: http://www.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz
If your forum is installed in the root of a subdomain, it would look something like this:
Sitemap: http://forum.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz
Note that in all cases you are pointing the spiders to the real location of the sitemaps index file, which tells the spider how many sitemap files to look for and their filenames. This index file is created automatically by the vbseo_sitemap cron job.
Note that what I'm suggesting in this post is to be used instead of the standard mod_rewrite solution indicated in the vbseo_sitemap installation insturctions.
Hello i check the server and i do have it
mod_rewrite is enabled :
LoadModule rewrite_module libexec/mod_rewrite.so
so what should i do now since i do have mod_rewrite
thanks
djbaxter
06-22-2009, 10:24 PM
Hello i check the server and i do have it
mod_rewrite is enabled :
LoadModule rewrite_module libexec/mod_rewrite.so
so what should i do now since i do have mod_rewrite
thanks
Follow the installation instructions for the add-on and add the lines to your .htaccess file.
Brathamike
06-22-2009, 11:17 PM
Follow the installation instructions for the add-on and add the lines to your .htaccess file.
i dont see any place in the insstructions that mentions the add on as you mention and the .htaccess files i in the root directorie of the forum
Brathamike
06-22-2009, 11:26 PM
Ok its working my .htaccess was not correct thanks for your help..going to your website right now as were speaking to see whats the difference on the free version and paid version
djbaxter
06-23-2009, 12:04 AM
It's not my website. I'm not associated weith vBSEO and there is no "paid version" of the vBSEO sitemap. It is a free offering.
vBSEO itself is a vBulletin SEO package and it's not free.
Budweiser
06-23-2009, 12:44 AM
I am trying to verify that I have this installed correctly. I tried testing my mod_rewrite as described at bvseo.com (Forum Link) (http://www.vbseo.com/f77/how-check-if-mod_rewrite-working-my-site-21502/) but it didnt work right. I will follow up on that issue on their website.
Here is a screen shot of my report details (the site isn't open yet, not many posts)
Note: ALL of the search engine pings failed. Does that mean it is not installed correctly?
When I click on Sitemap Files>Index File... There is a reference to this URL but it is not valid on my server.. Is this correct/incorrect? (http://www.usamusicians.com/forum/sitemap_1.xml.gz)
Also when I click on urllist.txt I get this message..."Sitemap file not found:"
Looks like a problem to me but who knows...:erm:
djbaxter
06-23-2009, 01:03 AM
I am trying to verify that I have this installed correctly. I tried testing my mod_rewrite as described at bvseo.com (Forum Link) (http://www.vbseo.com/f77/how-check-if-mod_rewrite-working-my-site-21502/) but it didnt work right. I will follow up on that issue on their website.
Here is a screen shot of my report details (the site isn't open yet, not many posts)
Note: ALL of the search engine pings failed. Does that mean it is not installed correctly?
When I click on Sitemap Files>Index File... There is a reference to this URL but it is not valid on my server.. Is this correct/incorrect? (http://www.usamusicians.com/forum/sitemap_1.xml.gz)
Also when I click on urllist.txt I get this message..."Sitemap file not found:"
Looks like a problem to me but who knows...:erm:
There is no urllist.txt - that is an oudated, now-defunct format previously used by Yahoo. The link you posted to your sitemap worked just fine for me.
Please read what I posted above. I think you are confusing vBSEO, a commercial vBulletin SEO package, with vBSEO_sitemap. You have installed the free vbseo_sitemap only. You have NOT installed the vBSEO package. They are separate products and there is a huge difference.
Budweiser
06-23-2009, 02:47 AM
Please read what I posted above. I think you are confusing vBSEO, a commercial vBulletin SEO package, with vBSEO_sitemap.
I am not confused. I purchased and installed VBSEO a few days ago and it was suggested to me by their staff to install the sitemap also.... so I did. I just want to make sure everything is working optimally because I haven't used VBSEO or a sitemap before. If it is not installed correctly or is just not working correctly then what's the sense... I'm sure you can understand where I am coming from...
So the fact that the search engine pings failed is not an issue?
and.. If urllist.txt is an oudated, now-defunct format previously used by Yahoo then why is it included in this updated version of the sitemap app? (This is just a nag/rhetorical question)
djbaxter
06-23-2009, 02:56 AM
My apologies. But if you have a l;egal vBSEO license, your best bet is to submit a support ticket and/or post in the sitemap forum there. You'll likely get a much faster response. Chances are one of the support people will get your authorization for FTP access and sort it out for you.
As for urllist.txt, I don't know - you'll have to ask the developers that question.
I don't know what's going on with the pings. Do you have a Google Webmaster Central accounbt? If not, get one. Add your forum as a site and add a sitemap to that listing in Webmaster Central. If Google is having a problem retrieving your sitemap, they should indicate that via error messages.
ctrlbrk
06-23-2009, 10:13 PM
Has anyone written an add-on module for vbSEO that will index the "Links and Downloads" vb module? I see one exists for Downloads II... but I'm using LDM...
Mike
Brathamike
06-24-2009, 08:11 AM
im getting a 404 page error when google is trying to find the robot.txt file. this program dossent have this so how do i make or get a robot.txt file
any thoughts on how to make this??
djbaxter
06-24-2009, 12:54 PM
Create a basic plain text (ASCII/ANSI) file called robots.txt (note: robots not robot) containing just the following:
User-agent: *
Disallow:
This tells all nspiders to "disallow" nothing, i.e., crawl andindex everything.
Upload this to the root directory of your site, not a subdirectory.
Dflow75
06-24-2009, 09:26 PM
why do I get Sitemap file not found on "Your Google Sitemap Index URL"
I have just installed the sitemap mod
Is this mod compatible with Zoints SEO? If the answer is "yes" can anybody tell me which settings do I have to make. Sorry for my bad English. I hope you will understand what I mean.
iojam
06-25-2009, 10:48 AM
Dflow75,
make sure that you create sitemap after installing the mod (click "Run sitemap generator" in vbseo_sitemap/ interface).
80's,
no, sorry - it's not compatible with Zoints SEO.
Budweiser
06-29-2009, 07:46 PM
im getting a 404 page error when google is trying to find the robot.txt file. this program dossent have this so how do i make or get a robot.txt file
any thoughts on how to make this??
Look at post #306 pn page 21 of this thread. I already asked this and the answer I was given is there...
I dont understand it... but there is an answer... :confused:
..
rajubd
06-29-2009, 07:58 PM
anyone know about this problem? my site map generated to this directory - vbseo_sitemap/data/sitemap_1.xml.gz . how can i move this to root...
Biker_GA
06-29-2009, 11:11 PM
Look at post #306 pn page 21 of this thread. I already asked this and the answer I was given is there...
I dont understand it... but there is an answer... :confused:
..
You create a text file called robots.txt and upload it to your root directory for your forum. It's as easy as that.
cloferba
07-01-2009, 03:57 PM
i dont know why my site is keeping transfering information later this:
[SECTION START] showthread [3,935.4Kb mem used] [0s (+0s)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 30000 [3,857.4Kb mem used] [22s (+21s)]
[create sitemap in text format] part #2 [3,857.5Kb mem used] [22s (+0s)]
and nothing else occur...why vbseo sitemap doesnt finish the sitemap creation?
RetroDreams
07-09-2009, 05:49 PM
Where does this pull location information from? For some reason, my location isn't working, thus all of my URLs are invalid.
<url>
<loc>/</loc>
<priority>1</priority>
<lastmod>2009-07-09T18:41:43+00:00</lastmod>
<changefreq>daily</changefreq>
</url>
Ogmuk
07-09-2009, 09:47 PM
i dont know why my site is keeping transfering information later this:
[SECTION START] showthread [3,935.4Kb mem used] [0s (+0s)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 30000 [3,857.4Kb mem used] [22s (+21s)]
[create sitemap in text format] part #2 [3,857.5Kb mem used] [22s (+0s)]
and nothing else occur...why vbseo sitemap doesnt finish the sitemap creation?
Try turning off "Generate Yahoo-Compatible Text Sitemap".
Budweiser
07-10-2009, 12:53 AM
Originally Posted by Budweiser View Post
Hello. I use VBSEO and installed the sitemap v2.5
I want to add a line to robots.txt (EG: "sitemap: http://www.example.com/sitemap.xml")
What file is the sitemap? I see "sitemap_1.xml.gz" and "sitemap_index.xml.gz" and few others... I assume one of these is the file I need to point to?
Thnx, Kev
reply: No. Just point to sitemap.xml -- mod_rewrite and vbseo_getsitemap.php take care of the rest.
I added the sitemap to my new google account and got this error. google doesnt see a file either. What do I do to fix this?
Thnx...
oddball118
07-10-2009, 02:22 AM
Has anybody had this issue when they run the scheduled task?
Scheduled Task Manager
vBSEO Sitemap Generator
[homepage] [5,201.5Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [5,201.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 10, total threads: 0, pages: 1 [5,201.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 57, total threads: 1, pages: 1 [5,202.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 66, total threads: 1, pages: 1 [5,202.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 11, total threads: 121, pages: 4 [5,202.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 62, total threads: 4, pages: 1 [5,203.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 13, total threads: 157, pages: 4 [5,203.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 14, total threads: 26, pages: 1 [5,204.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 15, total threads: 2, pages: 1 [5,205.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 16, total threads: 12, pages: 1 [5,205.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 54, total threads: 9, pages: 1 [5,205.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 56, total threads: 4, pages: 1 [5,205.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 64, total threads: 35, pages: 1 [5,205.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 67, total threads: 8, pages: 1 [5,206.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 12, total threads: 0, pages: 1 [5,206.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 17, total threads: 85, pages: 3 [5,206.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 18, total threads: 3, pages: 1 [5,207.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 19, total threads: 133, pages: 4 [5,207.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 20, total threads: 27, pages: 1 [5,208.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 21, total threads: 2, pages: 1 [5,208.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 22, total threads: 17, pages: 1 [5,208.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 33, total threads: 2, pages: 1 [5,209.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 60, total threads: 0, pages: 1 [5,209.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 61, total threads: 1, pages: 1 [5,209.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 34, total threads: 0, pages: 1 [5,209.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 52, total threads: 0, pages: 1 [5,209.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 35, total threads: 0, pages: 1 [5,209.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 36, total threads: 26, pages: 1 [5,210.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 37, total threads: 0, pages: 1 [5,210.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 23, total threads: 0, pages: 1 [5,210.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 24, total threads: 12, pages: 1 [5,210.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 25, total threads: 6, pages: 1 [5,210.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 40, total threads: 0, pages: 1 [5,210.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 41, total threads: 9, pages: 1 [5,210.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 42, total threads: 7, pages: 1 [5,210.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 43, total threads: 3, pages: 1 [5,211.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 44, total threads: 3, pages: 1 [5,211.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 45, total threads: 1, pages: 1 [5,211.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 49, total threads: 0, pages: 1 [5,211.3Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 50, total threads: 7, pages: 1 [5,211.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 51, total threads: 3, pages: 1 [5,211.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 26, total threads: 0, pages: 1 [5,211.5Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 27, total threads: 7, pages: 1 [5,211.6Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 58, total threads: 0, pages: 1 [5,211.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 59, total threads: 3, pages: 1 [5,211.8Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 28, total threads: 0, pages: 1 [5,211.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 29, total threads: 9, pages: 1 [5,212.0Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 30, total threads: 0, pages: 1 [5,212.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 31, total threads: 3, pages: 1 [5,212.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 32, total threads: 2, pages: 1 [5,212.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 38, total threads: 0, pages: 1 [5,212.4Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 39, total threads: 18, pages: 1 [5,212.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 46, total threads: 0, pages: 1 [5,212.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 47, total threads: 28, pages: 1 [5,213.2Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 48, total threads: 0, pages: 1 [5,213.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 53, total threads: 4, pages: 1 [5,213.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 65, total threads: 4, pages: 1 [5,214.1Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 55, total threads: 5, pages: 1 [5,214.2Kb mem used] [0s (+0s)]
[SECTION START] showthread [5,214.4Kb mem used] [0s (+0s)]
[archive homepage] [5,718.4Kb mem used] [1s (+1s)]
[SECTION START] forumdisplay archived [5,718.5Kb mem used] [1s (+0s)]
[SECTION START] showthread archived [5,751.4Kb mem used] [1s (+0s)]
[SECTION START] member [5,697.6Kb mem used] [1s (+0s)]
[SECTION START] polls [5,780.0Kb mem used] [1s (+0s)]
[SECTION START] blogs [5,785.2Kb mem used] [1s (+0s)]
[SECTION START] albums [5,786.0Kb mem used] [1s (+0s)]
[SECTION START] groups [5,788.3Kb mem used] [1s (+0s)]
[SECTION START] tags [5,792.6Kb mem used] [1s (+0s)]
[SECTION START] blog tags [5,560.1Kb mem used] [1s (+1s)]
[addon module] vbseo_sm_calendar.php [5,560.7Kb mem used] [1s (+0s)]
[addon module] vbseo_sm_downloads.php [5,563.2Kb mem used] [1s (+0s)]
[addon module] vbseo_sm_downloads2.php [5,603.8Kb mem used] [1s (+0s)]
Fatal error: Call to undefined function vbseo_filter_text() in /home/blah/public_html/blahblah/vbseo_sitemap/addons/vbseo_sm_downloads2.php on line 30
Then I get this sql DB error...
Database error in vBulletin 3.8.3:
Invalid SQL:
SELECT * FROM links_categories WHERE private = 0;
MySQL Error : Table 'blah_blahblah.links_categories' doesn't exist
Error Number : 1146
Request Date : Thursday, July 9th 2009 @ 07:45:12 PM
Error Date : Thursday, July 9th 2009 @ 07:45:13 PM
Script : http://www.blahblah.com/admincp/cronadmin.php?do=runcron&cronid=32
Referrer : http://www.blahblah.com/admincp/cronadmin.php?do=modify
IP Address : 24.105.140.142
Username : ME
Classname : vB_Database
MySQL Version : 5.0.67-community
Ogmuk
07-10-2009, 06:59 AM
Originally Posted by Budweiser View Post
I added the sitemap to my new google account and got this error. google doesnt see a file either. What do I do to fix this?
Thnx...
You forgot to add "forum/" and the file name is "sitemap_index.xml.gz". Try this: "forum/sitemap_index.xml.gz". If you really want forum/sitemap.xml.gz to work too then you could make a symbolic link:
cd /var/www/yourdomain.com/forum/vbseo_sitemap/data
ln -s ./sitemap_index.xml.gz sitemap.xml.gz
cloferba
07-15-2009, 04:12 AM
Try turning off "Generate Yahoo-Compatible Text Sitemap".
now it works!
but when i go to google webmaster and i submit my 2 sitemaps, google said:
Invalid tag value
This XML tag has an invalid value. Please fix it and resubmit.
Parent tag:
url
whats the problem!!!???
help! :eek::eek::eek::eek:
Saviour
07-15-2009, 07:31 AM
Tried several times to get this installed and working on a board powered by vb 3.8.3. Followed directions as per the "read me".
Made sure I checked which files I wanted included in the sitemap, against my robots.txt file. Generated the sitemap. Info was sent to Google, and Google Sitemaps show no errors, but they also show no files, either.
Clicked the link to the sitemap...error 404. Mod_rewrite is enabled by default on a shared server.
I currently have an .htaccess file in the root of my domain. Added the included .htaccess file to the forum root. Files are being generated and stored in the vbseo_sitemap/data folder which was set at 777. The sitemaps are not being stored in the forum root.
Even removed the .htaccess file from the forum root and added the rewrite rule to site root .htaccess file, including forums folder as path. Changed path in options of mod...still have the same issue.
After about 7 tries trying to get this to work...I finally gave up.
Uninstalled...
Sephirot
07-15-2009, 09:37 PM
now it works!
but when i go to google webmaster and i submit my 2 sitemaps, google said:
whats the problem!!!???
help! :eek::eek::eek::eek:
same here
I opened the file and saw that the priority tag was empty for my forumdisplay and member profile pages!
<priority></priority>
I guess I know why ... when using smart priority and the result priority is zero, the failsafe test in the function vbseo_add_url fails.
function vbseo_add_url($url, $priority = 1.0, $lastmod = 0, $freq = '')
{
//some code
if(!$priority) // this test is true for $priority = 0
$priority = $vboptions['vbseo_sm_priority']; // but this option does not exist!
Saviour
07-15-2009, 10:06 PM
Okay...I've decided to give this one last shot. LOL!
Anyway...Followed the instructions to install for my version of vB, which is currently 3.8.3.
The htaccess file in my forum root is the one that came with this mod. I didn't change a thing in the htaccess file.
If it matters, I also have an htaccess file in the root of my site which basically reads this:
RewriteEngine On
ErrorDocument 400 http://glitchpc.com/error400.html
ErrorDocument 401 http://glitchpc.com/error401.html
ErrorDocument 403 http://glitchpc.com/error403.html
ErrorDocument 404 http://glitchpc.com/error404.html
ErrorDocument 500 http://glitchpc.com/error500.html
AddType x-mapp-php5 .php
I uploaded all the files in the upload folder to my forum's root. I also changed the permissions of the "data" folder to "777".
I configured the vBSEO settings in my ACP and left the Sitemap Files URL field blank so that vBSEO site files will be stored in my forum root. However, that's not the case. They seem to be stored in the "data" folder.
When I go to my Sitemaps Reports page and click the link to the sitemap in "Your Google Sitemap Index URL", I get an error 400 page.
What am I missing here?
If it matters, I'm on a shared server and my host is 1and1.com.
If I had a million dollars...I'd give it to the next person who can solve this issue I'm having.
cellarius
07-16-2009, 09:45 AM
I corrected an issue and added seperate database support to benFF's addon for Photopost Pro:
http://www.vbseo.com/f44/sitemap-addon-photopost-photopost-classifieds-5035/index2.html#post224775
Saviour
07-16-2009, 01:00 PM
Update...
Okay...here's the thing with this mod...
The sitemap is generated. I receive an email that it's been updated. I haven't configured it to automatically notify the SEs though...until I can find out what's causing this error. If you click the link, below...you'll see what I mean.
Your Google Sitemap Index URL: http://glitchpc.com/forums/sitemap_index.xml.gz
Again...I've followed the installation instructions to the letter. I can see the information in the data folder. The data folder has been CHMOD to 777. I've uploaded the .htaccess file to the forum's root. Originally, the sitemap was submitted to Google and, again, I receive no errors from Google regarding the sitemap. Yet...Google shows no URLs associated with it. The plus side...no URLs...no errors...LOL! Yet...the link above still isn't working.
Again...I certainly would appreciate any help. I don't have vBSEO installed...so I know support is probably limited, but I'm at my wits end as to why I'm getting an error 404 page when clicking the above referenced link.
Additional Update...
Issue has been resolved by the great support provided at vBSEO.com.
Strike-Force.ne
07-18-2009, 12:35 PM
Installed on a newly installed 3.8.3 with no issues, so it will work for 3.8.3
How did you fix it?
Update...
Okay...here's the thing with this mod...
The sitemap is generated. I receive an email that it's been updated. I haven't configured it to automatically notify the SEs though...until I can find out what's causing this error. If you click the link, below...you'll see what I mean.
Your Google Sitemap Index URL: http://glitchpc.com/forums/sitemap_index.xml.gz
Again...I've followed the installation instructions to the letter. I can see the information in the data folder. The data folder has been CHMOD to 777. I've uploaded the .htaccess file to the forum's root. Originally, the sitemap was submitted to Google and, again, I receive no errors from Google regarding the sitemap. Yet...Google shows no URLs associated with it. The plus side...no URLs...no errors...LOL! Yet...the link above still isn't working.
Again...I certainly would appreciate any help. I don't have vBSEO installed...so I know support is probably limited, but I'm at my wits end as to why I'm getting an error 404 page when clicking the above referenced link.
Additional Update...
Issue has been resolved by the great support provided at vBSEO.com.
Saviour
07-20-2009, 11:20 AM
How did you fix it?
Follow this link: http://www.vbseo.com/f67/error-404-a-35614/
iyama
07-20-2009, 12:42 PM
How to chmod 0777 on shared window hosting with cpanel?
Looked over at VBSEO but im still getting an error 404
Saviour
07-22-2009, 03:48 PM
Looked over at VBSEO but im still getting an error 404
You may get a quicker response if you post over there.
vbplusme
07-22-2009, 05:21 PM
How to chmod 0777 on shared window hosting with cpanel?
You can change permissions in the cpanel file manager, its one of the picks on the menu bar.
Meola
07-22-2009, 08:32 PM
One dumb question!
I'm running vB 3.8.3 and wrongly installed the 3.6.x version of this MOD!! Is there any difference between these two versions? What should I do totally? replacing the files?!
donnie_ogm
07-25-2009, 04:44 AM
This is a very useful MOD.
Unfortunately on my site it seems it dosen't work.
For example when I click on "run sitemap generator" I receive back this error:
[homepage] [4,287.7Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [4,287.8Kb mem used] [0s (+0s)]
[SECTION START] showthread [4,287.8Kb mem used] [0s (+0s)]
[archive homepage] [4,287.9Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay archived [4,287.9Kb mem used] [0s (+0s)]
[SECTION START] showthread archived [4,288.1Kb mem used] [0s (+0s)]
[SECTION START] polls [4,288.2Kb mem used] [0s (+0s)]
[SECTION START] blogs [4,288.2Kb mem used] [0s (+0s)]
[SECTION START] albums [4,288.2Kb mem used] [0s (+0s)]
[SECTION START] groups [4,288.2Kb mem used] [0s (+0s)]
[SECTION START] tags [4,289.4Kb mem used] [0s (+0s)]
Database error
What should I do to fix this problem?
Thanks for your help
Ohiosweetheart
07-25-2009, 07:31 PM
any ideas why I wouldn't be receiving the email notifications when my email address is in the vbseo sitemap settings?
Alfa1
07-29-2009, 12:46 AM
How can I include pages from Photopost Pro and AndrewD's Link and Download Manager in the sitemap?
cellarius
08-01-2009, 04:33 PM
How can I include pages from Photopost Pro and AndrewD's Link and Download Manager in the sitemap?
For PP Pro see http://www.vbseo.com/f44/sitemap-addon-photopost-photopost-classifieds-5035/index2.html#post224775
j1mmy
08-02-2009, 12:39 AM
Where is the sitemap that I give to Google?
matthewhotdude
08-03-2009, 10:56 AM
Can't get this to work I get the email telling my my sitemap is done and gives me this link
http://www.chattaboxforums.com/vbseo_sitemap/ I click on it and get a error
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, webmaster@chattaboxforums.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.
Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
nikki712
08-04-2009, 05:13 PM
I installed this and it starts generating the sitempa, but then i get a db error saying that the forum.linkback table doesn't exist. I looked in PHP, and there is no forum.linkback table. I can create one, but how many fields do I need to put when I create it?
iojam
08-04-2009, 05:51 PM
Do you have vBSEO product installed as well? If yes, make sure that you are running the latest version.
matthewhotdude
08-04-2009, 06:17 PM
Anyone?
iojam
08-04-2009, 06:24 PM
I'm getting a "File not found" error on http://www.chattaboxforums.com/vbseo_sitemap/ , did you remove the folder?
matthewhotdude
08-04-2009, 06:59 PM
re-installed the mod and this
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, webmaster@chattaboxforums.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.
Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
--------------------------------------------------------------------------------
Apache/2.2.9 (Unix) mod_ssl/2.2.9 OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 Server at www.chattaboxforums.com Port 80
nikki712
08-04-2009, 09:43 PM
Yes, I just updated to vbseo3.3. But, for some reason it stopped working when I was running the 3.2 version of vbseo. It hasn't worked in a few months, but it's odd b/c I haven't dropped any tables. I'm not sure what's up but it's frustrating.
nikki712
08-04-2009, 09:50 PM
This is a very useful MOD.
Unfortunately on my site it seems it dosen't work.
For example when I click on "run sitemap generator" I receive back this error:
What should I do to fix this problem?
Thanks for your help
That's the same thing that's happening to me.
nikki712
08-04-2009, 10:07 PM
I uninstalled the mod, cleaned up the databases, then reinstalled. I still get the same db error saying that the forum.linkback table doesn't exist. This is ridiculous.
Also, when I click on the sitemap reports link in admincp, I get a script error, which is new since installing 3.3. It says:
Line: 2
Char: 22
Error: Unterminated string constant
Code: 0
URL: http://mysite.com/forum/vbseo_sitemap/index.php?rlist=true
I'm running vb3.8.3, and vbseo3.3. Mysql 5.0.81, PHP 5.2.8.
Meola
08-07-2009, 06:10 PM
I can't remove downloads log records?! why?!
Biker_GA
08-07-2009, 09:41 PM
Sure you can. Although they will reset after so many pages, but you can delete via FTP on your server.
imported_silkroad
08-08-2009, 03:55 AM
Has anyone written an add-on module for vbSEO that will index the "Links and Downloads" vb module? I see one exists for Downloads II... but I'm using LDM...
Mike
We upgraded from 2.2 to 2.5 (of the addon) and it breaks the vBadvanced Links addon:
vbseo_sm_vba_links.php
With a database error (that provides no clues).
We had to remove the vBadvanced addon for links to get this mod version to work.
BTW Yandex dont appear on the bot list
Terry2424
08-08-2009, 02:31 PM
I installed vbseo and that part is working fine. It generates two files
Sitemap_index.xml.gz
Sitemap_1.xml.gz
When I use the google webmaster tools I add a site map pointing to these files.
I get a green checkmark for sitemap_index.xml.gz
I get. 404 error with sitemap_1.xml.gz
These files are in the same folder and have the same permissions.
I use IIS windows 2003
Thanks for the help.
Biker_GA
08-09-2009, 12:16 AM
Just point to the first one.
Terry2424
08-09-2009, 04:57 AM
Just point to the first one.
Thank you very much, it worked fine and no errors.
Lima Bean
08-09-2009, 05:17 AM
Ack. The calendar addon is tossing XML errors into the sitemap.
http://www.branchcountylive.com/BCL_03.gif
Any solution?
iojam
08-10-2009, 04:48 PM
You should replace "&" with "&" in the add-on code.
ChandlerDog
08-20-2009, 03:44 PM
Not only do I get a data base error, when I run mydomain.net/vb-root/vbseo_sitemap/ I get "Oops! This link appears to be broken."
When I run mydomain.net/vbseo_sitemap/ I get "Internal Server Error"
Any ideas?
ErrorLog
08-23-2009, 02:09 PM
Fixed.
mazazangy
08-24-2009, 10:55 AM
nice Topic ... Very Good
nardian
09-02-2009, 05:23 AM
Thanks!
saxahan
09-02-2009, 11:23 PM
I have a problem. Firstly, It was working, but now it isn't working when I look up my sitemap url.
This is the error message:
This page contains the following errors:
error on line 1 at column 1: Document is empty
Below is a rendering of the page up to the first error.
Why do this happen? What am I suppose to do? :(
vBsquad
09-08-2009, 09:40 PM
I'm running version 2.5 but it seems the scheduled task does not run. When I run it manually it runs fine and sends out the email as normal.
Any help is appreciated.
rlneutral
09-10-2009, 08:05 AM
I would like to add sitemap to Yandex search engine, but it does not see
Sitemap_index.xml.gz it needs Sitemap_index.xml file.
How to make it to generate 2 more files:
Sitemap_index.xml
Sitemap_1.xml
giyotin92
09-10-2009, 02:04 PM
Thanks :)
caliman
09-10-2009, 07:13 PM
I can't remove downloads log records?! why?!
Sure you can. Although they will reset after so many pages, but you can delete via FTP on your server.
I have 91 pages of download logs... can someone tell me specifically how to prune them? What dir is this stored in? It's not 'hits.'
MikesSite
09-12-2009, 05:22 AM
Anybody have any idea why the amount of URL's in the sitemap decreased by 50% from the previous sitemap?
Thanks!
AfterWorldForum
09-16-2009, 04:25 AM
Hey,
Installed and ran it for a few days, and have been keeping an eye on my WebMaster tools to see how effective this is. I just see a major difference between total urls and Indexed urls:
Format URLs in Sitemap Submitted Downloaded
Sitemap Index Total: 791, Indexed: 19
Sep 15, 2009 ? Resubmit Sep 15, 2009
Sitemap errors and warnings
Could anyone explain the difference between the two? How can I get more indexed urls of the total amount?
I still have to update my robots etc, and do some other standard seo tweaking, but was just curious about the huge difference between these two.
Thanks in advance :)
Peter
Chimpie
09-24-2009, 05:01 PM
A client of mine has developed an interesting situation that I can't figure out.
If I go under vBSEO Sitemap Reports, and run the generator I get this...
[homepage] [3,089.1Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [3,089.4Kb mem used] [0s (+0s)]
[SECTION START] showthread [3,089.6Kb mem used] [0s (+0s)]
[archive homepage] [3,089.8Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay archived [3,089.9Kb mem used] [0s (+0s)]
[SECTION START] showthread archived [3,090.0Kb mem used] [0s (+0s)]
[SECTION START] member [3,090.1Kb mem used] [0s (+0s)]
[SECTION START] polls [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] blogs [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] albums [3,096.3Kb mem used] [0s (+0s)]
[SECTION START] groups [3,096.4Kb mem used] [0s (+0s)]
[SECTION START] tags [3,102.8Kb mem used] [0s (+0s)]
Database errorThe The forum name edit database has encountered a problem.
But if I go under the Scheduled Tasks and run it, it goes through just fine, even sending me the confirmation email.
Everything was working just fine, for about 13 days, then during the scheduled task it would cause an error. Then it worked for one day after, then errors out again.
I have uninstalled the xml file and reinstalled, overwriting... no help.
I reuploaded and overrode the install files... no help.
I've turned off all the other mods and hacks... no help.
I'm really confused on this one.
donnie_ogm
10-03-2009, 07:37 AM
Hi guys,
are there any codes to be inserted in .htaccess in order to try to have html link in the sitemaps?
Thanks in advance
blackberry
10-03-2009, 09:42 PM
its not working for me
whenever i click on run sitemap generator
its gives me this error
any fix will be appreciated thanks
[SECTION START] tags [12,798.6Kb mem used] [5,405,634s (+191s)]
[create sitemap file] filename: sitemap_239.xml.gz, number of urls: 20000 [12,862.4Kb mem used] [5,405,644s (+10s)]
[create sitemap in text format] part #240 [12,862.4Kb mem used] [5,405,644s (+0s)]
[create sitemap file] filename: sitemap_240.xml.gz, number of urls: 20000 [12,865.6Kb mem used] [5,405,659s (+15s)]
[create sitemap in text format] part #241 [12,865.7Kb mem used] [5,405,659s (+0s)]
[create sitemap file] filename: sitemap_241.xml.gz, number of urls: 20000 [12,868.3Kb mem used] [5,405,677s (+18s)]
[create sitemap in text format] part #242 [12,868.3Kb mem used] [5,405,677s (+0s)]
[create sitemap file] filename: sitemap_242.xml.gz, number of urls: 20000 [12,869.8Kb mem used] [5,405,696s (+20s)]
[create sitemap in text format] part #243 [12,869.8Kb mem used] [5,405,696s (+0s)]
[create sitemap file] filename: sitemap_243.xml.gz, number of urls: 2982 [12,866.3Kb mem used] [5,405,700s (+3s)]
[create sitemap in text format] part #244 [12,866.3Kb mem used] [5,405,700s (+0s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 243 [12,926.6Kb mem used] [5,405,700s (+0s)]
Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 252049792 bytes) in /h****/sa****/p****/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 1537
its not working for me
whenever i click on run sitemap generator
its gives me this error
any fix will be appreciated thanks
Either just keep running it (it will pick up where it left off), or increase your memory_limit.
blackberry
10-04-2009, 02:48 PM
how to increase memory_limit?
Cloudrunner
10-04-2009, 04:05 PM
its not working for me
whenever i click on run sitemap generator
its gives me this error
any fix will be appreciated thanksIncrease your wait time between file making to 30, increase your total links per file to 40,000. Doing these *should* lower your memory usage. I am not a dev for this mod, so I could be wrong. These have helped me though.
Sitemap Settings -> Max URLs in Sitemap Files -> 40000
Sitemap Settings -> Delay Execution After Each Sitemap File -> 30
Also take a read on the following posts, because it looks to me like you are pushing entirely too much data to the engines (243 site files? Really?):
The original post can be found here with even more SEO information (http://www.vbseo.com/f2/briansols-ultimate-guide-vbseo-26058/)
In the sitemap, think lean. All you want is your main info. No bloat. The idea is not to index every little bit.. it's to index your important info. If you have more than 4 or 5 files per million posts, you're doing it wrong. I can't tell you how many times i've seen sub-million post forums with 70-odd sitemap files. Doing that is entirely counter productive. I recommend the following settings:
http://www.vbseo.com/attachments/f2/4597d1219039468-briansols-ultimate-guide-vbseo-sitemap_options.jpg
There is a problem introduced when you change your priorities to what Briansol has though (Sitemap will write the priorities wrong and mess up a tag within the sitemap causing google to get upset), so to avoid the issue I suggestion the following priorities (they meld with Briansol's, but avoid the issue that is introduced when using his priority settings):
Smart Frequency for Show Thread Pages: Yes
Priority Range - Show Post: 0.1-0.2
Priority Range - Member Profiles: 0.2-0.3
Priority Range - Forum Display: 0.6-0.7
Priority Range - Poll Results: 0.1-0.2
Priority Range - Show Thread: 0.9-1.0
Priority Range - Blog Entries: 0.2-0.3
Priority Range - Blog Tags: 0.2-0.3
Priority Range - Member Profile Albums: 0.2-0.3
Priority Range - Social Groups:0.3-0.4
Priority Range - Social Group Discussions: 0.3-0.4
Priority Range - Social Group Pictures: 0.3-0.4
Priority Range - Tags: 0.5-0.6
Smart Priority: Yes
Seriously, knock out a bunch of them links (most of which I'm sure are useless to you in terms of quality content in the eyes of the all seeing, all knowing Google (http://www.thechurchofgoogle.com)) out of your sitemap and not only will you see a more efficient crawl from the spiders, but since they have an easier time crawling the most important stuff, they then will have more time to spread out within your site and consume the other bits and you'll quit overloading your server's memory :D.
blackberry
10-04-2009, 06:50 PM
@cloudrunner
as per ur settings i finally get this
Thanks alot
[SECTION START] tags [11,545.9Kb mem used] [5,481,734s (+486s)]
[create sitemap file] filename: sitemap_287.xml.gz, number of urls: 40000 [11,598.7Kb mem used] [5,481,794s (+60s)]
[create sitemap file] filename: sitemap_288.xml.gz, number of urls: 1555 [11,594.7Kb mem used] [5,481,827s (+33s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 288 [11,665.8Kb mem used] [5,481,827s (+0s)]
Sitemap has been created. Click here to return [11,559.8Kb mem used] [5,481,828s (+1s)]
Cloudrunner
10-04-2009, 08:22 PM
Anytime my friend, I'm glad I could help :D.
Jeez, how long has your site been running LOL? 288 pages ... wow ... that's insane!
MagicThemeParks
10-04-2009, 09:48 PM
Just had the Live.com ping fail.
Live.com ping: FAILED
....what did I miss or what do I need to fix?
Chimpie
10-04-2009, 09:55 PM
Just had the Live.com ping fail.
....what did I miss or what do I need to fix?
This happens periodically. Run it again or watch it tomorrow to see if it happens again.
MagicThemeParks
10-04-2009, 10:06 PM
Thanks Chimpie, if it doesn't are there any 'common' issues that I might want to take a look at?
Chimpie
10-04-2009, 10:16 PM
Thanks Chimpie, if it doesn't are there any 'common' issues that I might want to take a look at?
Honestly, I've never had it happen to me enough for me to care. It may happen once every couple of months. The only recommendation I can think of is to reupload the files or uninstall and reinstall everything.
But I really don't think it will have to come to that.
Cloudrunner
10-05-2009, 02:34 AM
Don't worry about it unless it fails continuously for about 3 days. Due to the nature of this beast sometimes the ping times out, or you just caught the other server during a no response time.
blackberry
10-05-2009, 09:19 AM
Anytime my friend, I'm glad I could help :D.
Jeez, how long has your site been running LOL? 288 pages ... wow ... that's insane!
from feb 2008
lolz is it too much? good or bad for my site?? sorry i dont know much abt pages thingy :d
can i delete old files in vbseo_sitemap/data?
blackberry
10-05-2009, 09:29 AM
summary in email is not correct why is that so
this is what i receive
Summary:
============================
Forum Display: 4440
Show Thread: 142062
Show Post: 858830
Member Profiles: 4136
whereas i have
threads: 50,726
posts: 512,656
members: 2,694
Cloudrunner
10-05-2009, 04:11 PM
from feb 2008
lolz is it too much? good or bad for my site?? sorry i dont know much abt pages thingy :d
can i delete old files in vbseo_sitemap/data?Wow, that's a hell of a run boss. Good job! Depending on what your niche is (sounds to me like you've done well in picking yours) it could be good, it could be bad. I'm no expert in Search Engine Optimization. :D
Yes, you can delete old files in that directory, in fact:
summary in email is not correct why is that so
this is what i receive
whereas i have
threads: 50,726
posts: 512,656
members: 2,694
Yeah, that looks abit backwards I'd say. My suggestion would be to delete the following from your vbseo_sitemap/data directory:
sitemap_index.xml.gz
sitemap_XXX.xml.gz - the XXX are the numbers after the file names.
urllist.txt.gz - if it exists.
After you've deleted those files login to your admincp and then to the sitemap generator page and re-create the sitemap and see if that fixes the discrepancy.
blackberry
10-05-2009, 05:30 PM
this is wht i get now
the member profile is fine now but threads are still not correct
Summary:
============================
Forum Display: 2515
Show Thread: 80330
Show Post:
Member Profiles: 2697
Cloudrunner
10-05-2009, 09:32 PM
That is normal if you have any forums that are being ignored by the generator. If you have forums added to the exclude area you will see less than what you really have. Run the generator again and see if it raises. If you are not running vBSEO in conjunction with this addon as well, make sure the first option on the settings page is set to "NO". If it is set to "YES" and you don't have vBSEO installed you'll run into strange things with the generator.
Can you link me your sitemap_index.xml.gz?
donnie_ogm
10-08-2009, 07:44 AM
Hi guys,
are there any codes to be inserted in .htaccess in order to try to have html link in the sitemaps?
Thanks in advance
stupid question?
I've searched in the thread but I haven't understood if is possible via .htaccess or not.
blackberry
10-09-2009, 11:30 AM
That is normal if you have any forums that are being ignored by the generator. If you have forums added to the exclude area you will see less than what you really have. Run the generator again and see if it raises. If you are not running vBSEO in conjunction with this addon as well, make sure the first option on the settings page is set to "NO". If it is set to "YES" and you don't have vBSEO installed you'll run into strange things with the generator.
Can you link me your sitemap_index.xml.gz?
i dont have any excluded forums .. dont know why getting more than original show threads thingy :(
Cloudrunner
10-09-2009, 08:28 PM
stupid question?
I've searched in the thread but I haven't understood if is possible via .htaccess or not.
To do that you would need to hardcode the .htaccess for every page, and then redo vbulletin to spit out those rewritten URLs so that the .htaccess has somewhere to redirect folks to.
Wait, there's already something that does that, it's ... wait for it ... vBSEO.
Sorry, wasn't really picking fun, just had a sarcastic moment there. Seriously though, to do what you are asking to do you would need vBSEO installed and running. To my knowledge the other SEO mods are not compatible with this mod as the sitemaps will be generated with your .php settings (vBSEO not installed) or your vBSEO settings only.
thincom2000
10-10-2009, 04:18 AM
Since recent Google acts have resulted in my site dropping from 1200 indexed pages to 300, and a lot of important content pages were missing (pretty much only tag pages were in the index now), I gave in and tried this mod again.
Previously I was disappointed that there were no hooks or anything for me to modify URLs. I have some custom mods that use forum and thread tables, but have non-showthread URLs. Because of this, last time we just made our own sitemap manually, so it included only the most important pages.
This time around I spent about 3 hours doing file edits and making this work with Project Tools, which also accounts for a large portion of our site.
I guess I'll see if it works for us. The first generated sitemap has about 5000 URLs.
I suspect we lost a bunch of indexed pages recently because it's possible Google sandboxed us -- we released a product with a copyright link, so suddenly 980,000 links to the product page appeared on the web within 1 or 2 days -- which was way more linkbacks than we had to all other pages combined.
wswsh
10-10-2009, 09:54 PM
thanxx
wswsh.net
iardon
10-11-2009, 07:13 PM
I'm running version 2.5 but it seems the scheduled task does not run. When I run it manually it runs fine and sends out the email as normal.
Any help is appreciated.
Yep, same here. Anybody have a fix?
Yellow Slider
10-12-2009, 07:58 PM
I'm getting 2 errors in the google webmsater site,
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.
Problem detected on: Oct 12, 2009
and
Network unreachable: robots.txt unreachable
We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.
I can access both my robots.txt file and the sitemap files -
here - http://www.iatraf.co.il/sitemap_1.xml.gz
http://www.iatraf.co.il/sitemap_index.xml.gz
http://www.iatraf.co.il/robots.txt
what do you think I need to do? I've reinstalled it and generated the files again, but google bots can't download them (I do have google bots on my site, average of 5 bots all the time)
Thanks.
iardon
10-12-2009, 08:07 PM
Yep, same here. Anybody have a fix?
I applied the changes detailed in the post below and now it's working, go figure. :confused:
https://vborg.vbsupport.ru/showpost.php?p=1894684&postcount=387
donnie_ogm
10-13-2009, 04:43 AM
To do that you would need to hardcode the .htaccess for every page, and then redo vbulletin to spit out those rewritten URLs so that the .htaccess has somewhere to redirect folks to.
Wait, there's already something that does that, it's ... wait for it ... vBSEO.
Sorry, wasn't really picking fun, just had a sarcastic moment there. Seriously though, to do what you are asking to do you would need vBSEO installed and running. To my knowledge the other SEO mods are not compatible with this mod as the sitemaps will be generated with your .php settings (vBSEO not installed) or your vBSEO settings only.
Aahah don't worry and thank you for the answer... ;)
thincom2000
10-13-2009, 05:44 AM
Once I figured out how to write my own addons for this, I was quite pleased with the results.
I had some mods like VaultWiki and CES Site News which use customized forumdisplay and showthread URLs. Using global_setup_complete to update the "exclude forums" option, I was able to save those forums until the addons ran, so resources weren't wasted and 2 versions of their links weren't added.
Also, I had to write an addon for Project Tools, because apparently there wasn't one. Depending how many people actually need that, I may contribute it, but it currently has my custom URL format (/projects/id/, /issues/id/, /milestones/id/) hardcoded.
MagicThemeParks
10-13-2009, 10:08 AM
What are the steps to take if you're consistently getting a "FAILED" on one of the search engines?
kho91
10-13-2009, 11:45 AM
I'm getting 2 errors in the google webmsater site,
and
I can access both my robots.txt file and the sitemap files -
here - http://www.iatraf.co.il/sitemap_1.xml.gz
http://www.iatraf.co.il/sitemap_index.xml.gz
http://www.iatraf.co.il/robots.txt
what do you think I need to do? I've reinstalled it and generated the files again, but google bots can't download them (I do have google bots on my site, average of 5 bots all the time)
Thanks.
Hi
I have the same probleme
please help
jkcerda
10-13-2009, 03:48 PM
cool
Yellow Slider
10-13-2009, 05:16 PM
Hi
I have the same probleme
please help
Tried installing again, nothing.
What should we do?
blackberry
10-13-2009, 06:25 PM
I'm running version 2.5 but it seems the scheduled task does not run. When I run it manually it runs fine and sends out the email as normal.
Any help is appreciated.
Yep, same here. Anybody have a fix?
happens with me too
then i just manually set it in Scheduled Task Manager
i did mine like this
https://vborg.vbsupport.ru/
MarkD793
10-14-2009, 05:09 PM
I seem to have a problem with the product.
I have been using the product for 7 days and it has sent approx 7 reports to google. In the product it says that the googlebot have crawled and that the pings where successful.
When I go to my Google webmaster tools I recieve the following error:
Sitemaps
« Go back
Show sitemap: forum/sitemap_index.xml.gz
Error: The last attempt at downloading the Sitemap failed. The details below are representative of the last successful download. Resubmit?
See SitemapFormat URLs in Sitemap Submitted Downloaded
Sitemap Index Total: 3,231, Indexed: 133
Oct 14, 2009 – Error Oct 14, 2009
Sitemap errors and warnings
Line Status Details
- General HTTP error: 404 not found
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit. HTTP Error: 404
Problem detected on: Oct 14, 2009
Filename Status Format Downloaded URLs submitted Indexed URLs
forum/sitemap_1.xml.gz Sitemap Oct 14, 2009 3,231 133
© 2009 Google Inc. - Webmaster Central - Terms of Service - Privacy Policy - Webmaster Tools Help
Also in the webmaster tools it says only one sitemap has been submitted and it failed. While vbseo sitemap generator syas it has sent 7 and they were successful.
Also, when I try and view a sitemap either through the product or the address typed out in the taskbar ...google returns a broken link page
Any help would be greatly received
Thank you in advance
iojam
10-14-2009, 06:17 PM
Yellow Slider, kho91
Network unreachable: robots.txt unreachable
We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.
Please check this: http://www.vbseo.com/f67/google-sitemap-not-loaded-403-a-16179/#post98598
iojam
10-14-2009, 06:18 PM
vBsquad, iardon
I'm running version 2.5 but it seems the scheduled task does not run. When I run it manually it runs fine and sends out the email as normal.
Any help is appreciated.
Please checked scheduled tasks log to see if it is started or not. Also check if other tasks are still running correctly.
iojam
10-14-2009, 06:18 PM
MarkD793,
did you create .htaccess file as described in installation instruction?
MarkD793
10-14-2009, 06:52 PM
MarkD793,
did you create .htaccess file as described in installation instruction?
My host Gigapros did the install.
What specifically should I ask them?
iojam
10-14-2009, 07:06 PM
Make sure that "Step B" is completed:
Upload the vBSEO Google/Yahoo Sitemap .htaccess file (located in the 'htaccess' folder) to your forum root.
and check that your server supports mod_rewrite: http://www.vbseo.com/f77/how-check-if-mod_rewrite-working-my-site-21502/
MarkD793
10-14-2009, 08:29 PM
I have my Host looking into it ....Thank you
Additional info:
160 Invalid tag value
This XML tag has an invalid value. Please fix it and resubmit.
I also came across the above. Does this change your advice?
iojam
10-14-2009, 09:05 PM
What do you have on line 160 in your sitemap?
MarkD793
10-15-2009, 01:48 AM
What do you have on line 160 in your sitemap?
Actually that is the last line reported in google toolbox there are many more than that, a couple of dozen that all say the same:
"This XML tag has an invalid value. Please fix it and resubmit."
I can't access my actual site map as it tells me that the link is broken.
iojam
10-15-2009, 09:50 AM
What is your sitemap URL?
iardon
10-16-2009, 03:33 AM
vBsquad, iardon
Please checked scheduled tasks log to see if it is started or not. Also check if other tasks are still running correctly.
I see more started than created. It's on and off, sometimes it works, sometimes it doestn't. Always works when I manually run it.
donnie_ogm
10-16-2009, 05:11 AM
happens with me too
then i just manually set it in Scheduled Task Manager
i did mine like this
http://img122.imageshack.us/img122/4706/race003.gif
And now it works?
TosaInu
10-21-2009, 04:49 PM
Hello,
We had a working installation of vBSEO on our board, we didn't change settings, but vBSEO runs into an error now:
[SECTION START] member [5,611.8Kb mem used] [1,256,146,885s (+339,013s)]
[create sitemap file] filename: sitemap_42.xml.gz, number of urls: 20000 [5,619.8Kb mem used] [1,256,146,887s (+2s)]
[create sitemap in text format] part #43 [5,619.7Kb mem used] [1,256,146,887s (+0s)]
[SECTION START] polls [6,192.4Kb mem used] [1,256,146,890s (+3s)]
Warning: Invalid argument supplied for foreach() in /etc/httpd/mysite/vbseo_sitemap/vbseo_sitemap_functions.php on line 365
[SECTION START] blogs [6,192.4Kb mem used] [1,256,146,890s (+0s)]
[SECTION START] albums [6,193.7Kb mem used] [1,256,146,890s (+0s)]
[SECTION START] groups [6,251.6Kb mem used] [1,256,146,890s (+0s)]
[SECTION START] tags [6,507.2Kb mem used] [1,256,146,890s (+0s)]
Warning: implode() [function.implode]: Invalid arguments passed in /etc/httpd/mysite/vbseo_sitemap/vbseo_sitemap_functions.php on line 834
Does this have to do with a changed setting in PHP or is something in the database damaged and do we need to install the hack again?
MagicThemeParks
10-23-2009, 10:29 AM
One of my installs is having issues with Bing. Keeps coming back as 'failed'. Any reason why or how to fix it?
Rottimom
10-26-2009, 02:59 AM
Hello, can you help me here ?
I have installed the sitemap generator, ready ok, it but then prepares all files at it everything clicks the following data base error message comes onto report:
mysql_pconnect() [<a
href='function.mysql-pconnect'>function.mysql-pconnect</a>]: Access denied
for user: 'dob232537190@localhost' (Using password: YES)
/homepages/32/d232537190/htdocs/forum/includes/class_core.php on line 311
MySQL-Fehler :
Fehler-Nr. :
Fehler-Zeit : Monday, 26.10.2009 @ 01:52:22
Datum : Monday, 26.10.2009 @ 01:52:23
Skript :
http://forum.net/forum/vbseo_sitemap/index.php?rlist=true
Referrer : http://forum.net/forum/admincp/index.php?do=nav
IP-Adresse :
Benutzername :
Klassenname : vB_Database
MySQL-Version :
I don't use a vBSEO.
How can I eliminate this mistake ?
Best greetings, Rottimom
iojam
10-28-2009, 09:18 PM
TosaInu,
check that at least some of your subforums are visible to guests, it looks like error is related to the empty forums list.
Rottimom,
make sure that you have correct database connection parameters defined in config.php file.
Toupsx
10-29-2009, 12:39 PM
Trying to install VBSeo Sitemap Generator.. following the provided instructions I cannot seem to get it to work, I have also searched the thread for my problem and could not find the answer..
Currently when going to /vbseo_sitemap/
I get this: 500 Internal Server Error
The server encountered an unexpected condition which prevented it from fulfilling the request.
The script had an error or it did not produce any output. If there was an error, you should be able to see it in the error log.
Full url to it: http://www.puppycute.com/forum/vbseo_sitemap/
rizvihot
10-30-2009, 06:53 AM
dear Sir,
I did the installation exactly as per readme.txt. My server allow mod_rewrite and sitemap_index.xml.gz successfuly directed to /data folder. and i can view the xml.
the thing is that, why my site don't convert my url to e.g http://www.vbseo.com/forum/my-personal-success-story-605/ and still keep showing http://www.vbseo.com/forum/showthreadshowthread.php?t=229 ???
tq in advance. rgds
iojam
10-30-2009, 07:00 PM
Toupsx,
make sure that permissions for "vbseo_sitemap" folder are set to 0755.
rizvihot,
this product (free vBSEO Sitemap Generator) only creates xml sitemap for the forum. SEOed URLs and other seo-related features are included in vBSEO product (paid one): http://www.vbseo.com
Ohiosweetheart
11-06-2009, 02:34 AM
What are the steps to take if you're consistently getting a "FAILED" on one of the search engines?
One of my installs is having issues with Bing. Keeps coming back as 'failed'. Any reason why or how to fix it?this has been asked twice with no answer. I'd really like to see this addressed, as I'm having the same issue.
Thanks!
Ohiosweetheart
11-08-2009, 02:26 PM
Hello?
MagicThemeParks
11-08-2009, 02:47 PM
I'd love to have some support on this "Bing" issue.
djbaxter
11-08-2009, 03:08 PM
http://www.vbseo.com/f104/bing-com-34352/#post216857
http://www.vbseo.com/f67/live-com-not-index-34648/
http://www.vbseo.com/f67/live-search-engine-fail-37414/
MagicThemeParks
11-08-2009, 03:25 PM
Thanks
http://www.vbseo.com/f104/bing-com-34352/#post216857
TosaInu
11-08-2009, 05:23 PM
TosaInu,
check that at least some of your subforums are visible to guests, it looks like error is related to the empty forums list.
Hello iojam,
The subforums are visible to guests. It did work smoothly, but stopped for some reason.
Are there other things I can check?
iojam
11-09-2009, 08:22 AM
I would try to reinstall vBSEO sitemap generator.
TosaInu
11-09-2009, 04:47 PM
Hello iojam,
I downloaded a new copy here, copy the files to the server and overwrote: didn't work. I uninstalled the old copy and installed again, still didn't work.
I deleted the old data folder (including the sitemaps there) and that seems to have fixed it. I guess one or more of those files got damaged somewhere.
Edit: yes, it completed now.
djilou
11-10-2009, 09:18 AM
Hi
I have a problem with Reports List, no more *.log files are created in vbseo_sitemap/data/ since april 2009?!
mescalin
11-13-2009, 01:33 PM
I have vbseo and when i try to access /forum/sitemap_index.xml.gz it redirects to forumhome.
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
is allready in the htaccess file in the forum root. any idea?
iojam
11-14-2009, 10:25 AM
djilou,
make sure that data/ folder permissions are set to 0777.
mescalin,
check that mod_rewrite is enabled on your host: http://www.vbseo.com/f77/how-check-if-mod_rewrite-working-my-site-21502/
mescalin
11-15-2009, 12:39 PM
mod_rewrite is enabled ive tested it and im runing vbseo without problem. however when i try to redirect to sitemap it redirects to homepage and redirection doesnt work for that.
iojam
11-22-2009, 05:32 AM
Hello,
what is your full .htaccess file content?
I'm using this since 2007, but was checking now and have some error:
When clicking "Show SE Bots Activity Log", i get this error:
Warning: file(/home/gsm/public_html/vbseo_sitemap/data/hits/20080125.log) [function.file]: failed to open stream: Permission denied in /vbseo_sitemap/index.php on line 216
also, i don't see any new file in data/hits folder, since Jan 2008....
What am i doing wrong?
Duncan
11-23-2009, 06:55 AM
Basically, when this sends sitemaps to Yahoo/Google- does your CRAWLABILITY LINK get included with the information sent?
Months ago I installed this on a big-board of mine and my rankings took a huge drive in the search engine- and I was penalized. Yes, you could argue there are a number of factors that could lead to that. However, I just realized that this could be the issue.
djbaxter
11-23-2009, 11:32 AM
Basically, when this sends sitemaps to Yahoo/Google- does your CRAWLABILITY LINK get included with the information sent?
Months ago I installed this on a big-board of mine and my rankings took a huge drive in the search engine- and I was penalized. Yes, you could argue there are a number of factors that could lead to that. However, I just realized that this could be the issue.
1. Having your rankings take "a huge drive" (sic) and being penalized are two very different things. Whihc was it and if you were penalized, what for?
2. How could adding one outgoing link possibly cause what you seem to think it caused? Do you really think that is even remotely plausible?
sailnet
11-23-2009, 02:24 PM
I downloaded this and read the install instructions.
However my forum home is not my website root. It's one directory down from the website root and my .htaccess file is in my root, not my forums directory. I have php code that runs in the root and one of the links off the php code in the root leads to the forums directory.
therefore my question is as follows:
1) I assume that the .htaccess code that's included in this hack which follows should be changed from:
RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
to:
RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/forums/vbseo_getsitemap.php?sitemap=$1 [L]
is this correct?
thanks in advance.
sailnet
11-23-2009, 04:29 PM
your instructions on installing this mod say this:
The Yahoo sitemap must be manually submitted to http://submit.search.yahoo.com/free/request/.
However that page is outdated/
Does Yahoo still require a manual submission?
Duncan
11-23-2009, 04:32 PM
1. Having your rankings take "a huge drive" (sic) and being penalized are two very different things. Whihc was it and if you were penalized, what for?
My big board went from 350,000 indexed pages to 8,000- and from a pagerank 4 to a pagerank 0; thus suggesting to me that my site was indeed penalized. Penalization, the act of being penalized, DOES result in a huge DIVE in terms of search engine rankings. You may want to consult with an SEO forum if you are not aware how these correlate.
2. How could adding one outgoing link possibly cause what you seem to think it caused? Do you really think that is even remotely plausible?
What I was asking in the initial post was if the link gets added as a "sitewide" link on our "sitemap" which is sent to google. I was sending no accusations; however just asking if this is what may have caused my penalization and if this is the reason that a branding free liscense is not available on this script.
What I was asking in the initial post was if the link gets added as a "sitewide" link on our "sitemap" which is sent to google. I was sending no accusations; however just asking if this is what may have caused my penalization and if this is the reason that a branding free liscense is not available on this script.
No, it does not. The only thing that gets 'sent' to the SEs is notification that the .xml.gz has been updated.
Duncan
11-23-2009, 08:34 PM
Kall,
Thank you for addressing my issue! This is good news.
final kaoss
11-25-2009, 08:53 PM
Every time I run the sitemap generator I get this
[SECTION START] showthread [5,043.8Kb mem used] [1,543s (+1,538s)]
[archive homepage] [33,231.9Kb mem used] [1,547s (+3s)]
[SECTION START] forumdisplay archived [33,232.9Kb mem used] [1,547s (+0s)]
[SECTION START] showthread archived [32,759.5Kb mem used] [1,547s (+0s)]
Fatal error: Out of memory (allocated 62128128) (tried to allocate 2097152 bytes) in /home/-----/public_html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 1537
iojam
11-26-2009, 06:50 AM
GTX2,
make sure that you have 0777 permissions se tfor data/hits/ folder.
sailnet,
Yes, your modification for root .htaccess looks correct.
You should submit sitemap to Yahoo here: https://siteexplorer.search.yahoo.com/mysites
extreme-gaming,
you should increase memory_limit setting in your PHP configuration to resolve that.
sailnet
11-26-2009, 10:28 AM
the only problem I am having with this mod is when I do to deleted the downloads logs through the vbseo control panel I get the following errors:
Warning: fwrite(): supplied argument is not a valid stream resource in [path]/vbseo_sitemap/index.php on line 259
Warning: fclose(): supplied argument is not a valid stream resource in [path]/vbseo_sitemap/index.php on line 260
I've set the logs to 777 and the directory they're in is 777 also. My site generate over 60 gz files every day and the logs are growing out of hand in short order.
final kaoss
11-27-2009, 01:34 AM
I can't increase any setting for php as I'm on hostgator shared hosting, I made it pause 15 seconds in between each sitemap it makes though and that seems to work.
Professional2
11-29-2009, 05:40 PM
veryyyyyyyyy nice ,tnx
sudhi
11-30-2009, 02:48 PM
homepage] [7,371.0Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [7,372.3Kb mem used] [0s (+0s)]
[SECTION START] showthread [7,372.5Kb mem used] [0s (+0s)]
[SECTION START] member [7,372.0Kb mem used] [0s (+0s)]
[SECTION START] polls [7,652.4Kb mem used] [1s (+1s)]
[SECTION START] tags [7,652.4Kb mem used] [1s (+0s)]
Database Error Database error
why this database error
ho to fix it ??
thanks
SVTCobraLTD
12-02-2009, 01:33 AM
Do you have to have vbSEO for this to work?
djbaxter
12-02-2009, 01:46 AM
Do you have to have vbSEO for this to work?
No, you don't. It's entirely independent.
giorgiogagliano
12-02-2009, 04:01 AM
thanks.
iojam
12-02-2009, 01:47 PM
sudhi,
try to exclude Tags URLs from sitemap in options.
Skydiver10
12-06-2009, 03:31 AM
Hi there,
Thanks, installed. When I run site map generator from the sitemaps log in home, everything runs fine with no errors.
It shows this for the site map link: Your Google Sitemap Index URL .... when I click on the link to the site maps I get a page not found, but the site map was created and submitted successfully.
I hope this is not a stupid question but, when I go to my server and look in the "Data" directory folder the "sitemap_1.xml.gz" is there in a zip file? Is this correct? Is this the file I submit to yahoo?
Thank you in advance...:up:
Edit: Also there is an htaccess file that is there that says "deny from all" should I leave it there?
Skydiver10
12-07-2009, 09:39 PM
I just installed a fiew days ago and was wondering how often do the bots download the "sitemap_index.xml.gz"? I have checked the downloads log and are all empty.
Hi there,
Did you upload the .htaccess file that needs to go in your forum root?
Your comment that the sitemap URL gives a not found error leads me to suspect that you didn't.
Skydiver10
12-07-2009, 11:05 PM
Hi there Kall thanks for your response.
After combing through all of these posts I did see that quite a bit. I was not sure because I have many different htaccess files in different folders (including my "Admincp" folder) and in the root server, and I don't want to have any of them over command each other.
I added:
"RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]" to my htaccess file in the main index of the server. That did not work.
I know just uploaded a new htaccess file to my forums root with the same code in it, I can now access the data folder when I click on my sitemap URL from the ACP and get this:
This XML file does not appear to have any style information associated with it. The document tree is shown below.
Is this correct now?
One question that is burning in my mind is, does an htaccess file only control the folder that it is in? What if I have a folder that is below another folder that has another htacces file in it? Will the one in the upper folder have command over the lower folder or like I mention: the htaccess file controls only the folder that it is in?:confused:
Skydiver10
12-07-2009, 11:46 PM
When I go to: Sitemap Downloads Log
And try to delete logs I get this:
Warning: fwrite(): supplied argument is not a valid stream resource in [path]/vbseo_sitemap/index.php on line 259
Warning: fclose(): supplied argument is not a valid stream resource in [path]/vbseo_sitemap/index.php on line 260
Sitemap Downloads Log
Is this normal? And do I need to worry about deleting the logs? Do I have to change the htaccess file to delete logs?
Edit:
Never mind,
Found the fix for this at: http://www.vbseo.com/f67/sitemap-downloads-log-31344/index2.html#post197608
Why doesn't the coder fix the index.php file and upload it, so that the download is updated, and people do not have to manually change the code in the index file?
Do you know the answers for the htaccess questions that I stated in the previous thread?
Alan_SP
12-08-2009, 04:21 AM
When I started vBSEO Sitemap Generator for the first time, I got this error message:
Database error in vBulletin 3.8.4:
Invalid SQL:
INSERT INTO cronlog
(varname, dateline, description, type)
VALUES
('vbseo_sitemap_task',
1260252102,
'Google Sitemap Created',
0);
MySQL Error : MySQL server has gone away
Error Number : 2006
The waiting for page automatic reload was very long, about 40 seconds. At the end it said this error message. What went wrong?
dgparent
12-09-2009, 12:22 AM
Dang can't figure this out I did not change ANYTHING in the settings - the sitemaps get created OK they all go to /forum/vbseo_sitemap/data/ but in the sitemap_index.xml.gz all the URL's for the 150 sitemap files show the URL as forum/sitemap_148.xml.gz ???
Show Google says "it appears your sitemap is a HTML page..''
Any idea's ??
Skydiver10
12-09-2009, 12:52 PM
Did you put the .htaccess file in your forum root? This will redirect Google to these URL's!
After uploading the attached file to your forum directory, rename file (delete the ".txt") so that it can be read as a .htaccess file. After that the file should be ".htaccess" in your forum root. Try that and let me know.....
dgparent
12-09-2009, 06:21 PM
Thanks I figured it out I had to modify the vbseo_sitemap_config.php file to use forum root all is ok now
Skydiver10
12-09-2009, 08:08 PM
Oh yeah, I had to do that as well, if you scroll up you will see the link to edit the index.php file.
Here is the link: http://www.vbseo.com/f67/sitemap-downloads-log-31344/index2.html#post197608 is this what you mean?
rajubd
12-17-2009, 09:24 PM
is it working with vb4
rtyagis
12-18-2009, 10:53 AM
No. They are bringing a new version 2.6 for 4.0
No. They are bringing a new version 2.6 for 4.0
Bummer
I am getting this running 2.5 with 4.0 gold and SEO3.5 RC1
Database error in vBulletin 4.0.0:
Invalid SQL:
SELECT
count(*) as maxre
FROM tagthread
GROUP BY tagid
ORDER BY maxre DESC
LIMIT 0,1;
MySQL Error : Table 'photo79_cfor.tagthread' doesn't exist
Error Number : 1146
Request Date : Tuesday, December 22nd 2009 @ 08:38:04 AM
Error Date : Tuesday, December 22nd 2009 @ 08:38:05 AM
Script : http://www.cfohrr.com/vbseo_sitemap/vbseo_sitemap.php
Referrer : http://www.cfohrr.com/vbseo_sitemap/index.php?rlist=true
IP Address :
Username : Unregistered
Classname : vB_Database
MySQL Version :
================================================== ===
djbaxter
12-22-2009, 02:48 PM
Really, everyone should read and re-read the recommendations for installing vBulletin 4 over at vBulletin.com.
The majority of the add-ons you've been using with 3.x are NOT going to work with 4.0. That means you have a choice: uninstall any add-on not yet upgraded, or wait to upgrade to 4.0 until the add-ons you consider to be essential have been updated. Otherwise, you are just begging for grief.
Really, everyone should read and re-read the recommendations for installing vBulletin 4 over at vBulletin.com.
The majority of the add-ons you've been using with 3.x are NOT going to work with 4.0. That means you have a choice: uninstall any add-on not yet upgraded, or wait to upgrade to 4.0 until the add-ons you consider to be essential have been updated. Otherwise, you are just begging for grief.
I believe that is a given, I have a fresh install of 4.0 gold. I have no add ons out side of what I will be testing as a tester for various like VBseo. I am looking to get 2.6 and am waiting for addons to be updated
Very good Point though :up:
Generator 2.6 Works Perfectly :up:
Tigatoday
12-28-2009, 11:57 AM
Hi,
I installed it and get this error:
[homepage] [3,322.3Kb mem used] [0s (+0s)]
[SECTION START] forumdisplay [3,322.4Kb mem used] [0s (+0s)]
[SECTION START] showthread [3,322.4Kb mem used] [0s (+0s)]
[SECTION START] polls [3,322.4Kb mem used] [0s (+0s)]
[SECTION START] tags [3,322.8Kb mem used] [0s (+0s)]
Database error
The xxx database has encountered a problem.
Please try the following:
Load the page again by clicking the Refresh button in your web browser.
Open the www.xxx.com home page, then try to open another page.
Click the Back button to try another link.
The www.xxx.com forum technical staff have been notified of the error, though you may contact them if the problem persists.
I'm running 3.8.3 without vbSEO. Can anybody help? Thx in advance!
lordi
12-29-2009, 09:44 AM
hello
I put the hack on my forum...3.8.4 PL2
Everything worked fine...knowing that my config.php files name is changed, so i editted some files in the hack to make it work
-Everything is fine now....BUT, When I click on RUN SITEMAP GENERATOR
it takes me to a page full of links like this one:
[create sitemap file] filename: sitemap_5.xml.gz, number of urls: 10 [3,975.6Kb mem used] [1,262,086,665s (+0s)]
and then the page stops loading without giving any excuse or reason
and it gives me ERRORS in the TOP of the page like this one:
[homepage] [3,969.3Kb mem used] [1,262,086,664s (+1,262,086,664s)]
[SECTION START] forumdisplay [3,969.7Kb mem used] [1,262,086,664s (+0s)]
Warning: Invalid argument supplied for foreach() in /home/content/MyPath/html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 164
[SECTION START] showthread [3,970.1Kb mem used] [1,262,086,664s (+0s)]
Warning: Invalid argument supplied for foreach() in /home/content/MyPath/html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 240
[archive homepage] [3,970.5Kb mem used] [1,262,086,664s (+0s)]
[SECTION START] forumdisplay archived [3,970.8Kb mem used] [1,262,086,664s (+0s)]
Warning: Invalid argument supplied for foreach() in /home/content/MyPath/html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 164
[SECTION START] showthread archived [3,971.3Kb mem used] [1,262,086,664s (+0s)]
Warning: Invalid argument supplied for foreach() in /home/content/MyPath/html/forum/vbseo_sitemap/vbseo_sitemap_functions.php on line 240
and no sitemap is generated
PLEASE HELP
d0zer
12-31-2009, 06:17 AM
Thanks You
VBUsers
01-02-2010, 05:32 AM
when i click run report , it gives me this error
Database error in vBulletin 3.8.4:
Invalid SQL:
SELECT COUNT(*) as cnt,max(lastpost) as lastupdate
FROM thread AS thread
INNER JOIN tagthread AS tagthread ON
(tagthread.tagid = 1 AND tagthread.threadid = thread.threadid)
WHERE thread.forumid IN()
AND thread.visible = 1
AND thread.sticky IN (0, 1)
AND thread.open <> 10
GROUP BY tagthread.tagid;
MySQL Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')
AND thread.visible = 1
AND thread.sticky IN (0, 1)' at line 5
Error Number : 1064
Request Date : Saturday, January 2nd 2010 @ 06:24:39 AM
Error Date : Saturday, January 2nd 2010 @ 06:24:40 AM
Script : http://www.hydrocanna.com/vbseo_site...eo_sitemap.php
Referrer : http://www.hydrocanna.com/vbseo_site...php?rlist=true
IP Address : 000000000
Username : Unregistered
Classname : vB_Database
MySQL Version :
enginethatcan't
01-05-2010, 01:49 PM
Having a DB error when trying to run.....It worked fine in the past...
Database error in vBulletin 3.8.4:
Invalid SQL:
INSERT INTO cronlog
(varname, dateline, description, type)
VALUES
('vbseo_sitemap_task',
1262706291,
'Google Sitemap Created',
0);
MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Tuesday, January 5th 2010 @ 09:44:51 AM
Error Date : Tuesday, January 5th 2010 @ 09:46:29 AM
Script : http://chataboutcars.com/forum/admincp/cronadmin.php?do=runcron&cronid=21
Referrer : http://chataboutcars.com/forum/admincp/cronadmin.php?do=modify
IP Address : -------------
Username : ------------
Classname : vB_Database
MySQL Version :
Hi,
I would like to uninstall and remove the sitemap generator from my VB. Can someone please provide me the exact steps I should take in order to do so?
Thanks!
lycheepassion
01-10-2010, 07:58 AM
I can use this w/o vbseo, or not? thanks
Alan_SP
01-10-2010, 02:01 PM
I would like to uninstall and remove the sitemap generator from my VB. Can someone please provide me the exact steps I should take in order to do so?
As with any other, go to AdminCP->Plugins & Products->Manage Products. Here, under Controls (on the right side) you have options, default is Edit. Choose Uninstall for the product (any one you want to uninstall). After that, you can remove leftover files, if there are any (with vBSEO Sitemap Generator are). To do that check files you had to upload. The same ones you need to delete. You don't need to delete files, if you don't want to.
I can use this w/o vbseo, or not? thanks
Hello,
Yes, you can run this without vBSEO.
drjdh
01-13-2010, 04:09 AM
I'm running 3.8.4
I downloaded all of the files as indicated by the instructions.
The vBSEO control panel seems to be working well.
When I choose vBSEO Sitemap reports from the Admin control panel I get:
"The server encountered an unexpected condition which prevented it from fulfilling the request.
The script had an error or it did not produce any output. If there was an error, you should be able to see it in the error log. "
The data folder is set to "777"
.htaccess contains:
RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
I've been racking my brain trying to figure out what I'm doing wrong :eek:
Any ideas?:confused:
drjdh
01-14-2010, 06:39 PM
Here is the error message that I'm getting on my server now:
Invalid SQL:
SELECT COUNT(*) as cnt,max(lastpost) as lastupdate
FROM thread AS thread
INNER JOIN tagthread AS tagthread ON
(tagthread.tagid = 1 AND tagthread.threadid = thread.threadid)
WHERE thread.forumid IN()
AND thread.visible = 1
AND thread.sticky IN (0, 1)
AND thread.open <> 10
GROUP BY tagthread.tagid;
MySQL Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')
AND thread.visible = 1
AND thread.sticky IN (0, ' at line 5 Error Number : 1064 Request Date : Thursday, January 14th 2010 @ 03:29:26 PM
HeyMe
01-22-2010, 08:14 AM
Will the vb 4 compatible version be free?
solidlink
01-26-2010, 08:06 AM
i have a problem.......... how do i login to the vBSEO Sitemap Interface Access Password?
I cant remember the password............. i cant even remember setting the password?
anyone know about this error ??
Database error in vBulletin 3.8.4:
Invalid SQL:
INSERT INTO cronlog
(varname, dateline, description, type)
VALUES
('vbseo_sitemap_task',
1264298425,
'Google Sitemap Created',
0);
MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Sunday, January 24th 2010 @ 02:00:25 AM
Error Date : Sunday, January 24th 2010 @ 02:02:14 AM
Script : hxxp://www.myforum.com/forums/cron.php?rand=1264298423
Referrer : hxxp://www.myforum.com/forums/kbox-discussions/6820-kbox-file-release-read.html
IP Address : xxx.xxx.xxx.xxx
Username : Unregistered
Classname : vB_Database
MySQL Version :
djbaxter
01-30-2010, 01:05 PM
anyone know about this error ??
Database error in vBulletin 3.8.4:
Invalid SQL:
INSERT INTO cronlog
(varname, dateline, description, type)
VALUES
('vbseo_sitemap_task',
1264298425,
'Google Sitemap Created',
0);
MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Sunday, January 24th 2010 @ 02:00:25 AM
Error Date : Sunday, January 24th 2010 @ 02:02:14 AM
Script : hxxp://www.myforum.com/forums/cron.php?rand=1264298423
Referrer : hxxp://www.myforum.com/forums/kbox-discussions/6820-kbox-file-release-read.html
IP Address : xxx.xxx.xxx.xxx
Username : Unregistered
Classname : vB_Database
MySQL Version :
Not sure about the first one (Invalid SQL) but it may be related to the second (MySQL server has gone away) which tells you you've lost the connection to the MySQL server, a common and saqdly frequent occurrence with shared hosting.
Try breaking up the sitemap into smaller files in the options.
Not sure about the first one (Invalid SQL) but it may be related to the second (MySQL server has gone away) which tells you you've lost the connection to the MySQL server, a common and saqdly frequent occurrence with shared hosting.
Try breaking up the sitemap into smaller files in the options.
well, for what it is worth it is VPS.
djbaxter
01-30-2010, 02:00 PM
well, for what it is worth it is VPS.
Then my guess is your cron job is timing out. Try the suggestion of
setting Max URLs in Sitemap Files to something lower, perhaps 20000 or 25000, and
increasing the pause at Delay Execution After Each Sitemap File (I use 15 seconds on a VPS)
yes the one was 20000 i think it was default.
the 0 to 15 seconds seemed to do the trick thanks !!!
7shashatop
01-31-2010, 03:29 AM
very good
vBulletin® v3.8.12 by vBS, Copyright ©2000-2025, vBulletin Solutions Inc.