vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Board Optimization - vBSEO Search Engine XML Sitemap (https://vborg.vbsupport.ru/showthread.php?t=253516)

bzcomputers 07-08-2013 11:58 AM

Don't confuse this product with vBSEO. This is vBSEO Sitemap (a separate and free mod) it has officially been unsupported for a long time.

About the only place you are going to get support on it now is right here from fellow vB users. If you have a question or issue just ask. There are more people familiar with the product here than almost anywhere else.

Kirk93 07-19-2013 09:42 PM

I've only just noticed that this mod doesn't work for me. According to the logs, there is no bot activity on my site (even know I see them on "Who's Online"); how do I fix this?

Are you supposed to manually submit vbseo_sitemap/data/sitemap_forum_1.xml.gz etc to Webmasters?

Also, which ones should you submit?

bzcomputers 07-19-2013 11:44 PM

Quote:

Originally Posted by Kirk93 (Post 2434503)
I've only just noticed that this mod doesn't work for me. According to the logs, there is no bot activity on my site (even know I see them on "Who's Online"); how do I fix this?

Are you supposed to manually submit vbseo_sitemap/data/sitemap_forum_1.xml.gz etc to Webmasters?

Also, which ones should you submit?

Yes, you need to submit the index file ONLY to search engines (namely Google & Bing). Submitting the other files won't hurt but there will also be no benefit. The other files are linked through the index file and will be automatically scanned as long as the index file is submitted to the search engines.


Submittion url should look like:
Code:

http://www.yoursitename.com/forums/sitemap_index.xml.gz

Once submitted the first time, search engines will know where it is and continually look for it and search for changes/updates. You can also set up VBSEO Sitemap to automatically notify search engines each time it is updated (it is a setting). This may get your site updates indexed a few hours quicker depending on how often your site is already being scanned by the search engines. The auto-notify currently only works for Google & Bing. They are the two largest search engines anyway and where probably 90+% of your search engine traffic is coming from, so it is a handy feature.

Kirk93 07-20-2013 05:21 AM

I'm getting errors with this.

sitemap_index.xml.gz is located in /vbseo_sitemap/data/..., but when I link to it the search engines can't find the additional xml's because they're reportedly supposed to be in the root folder.

How do I fix this aside from manually adding each one? Thanks for your help by the way. :)

bzcomputers 07-20-2013 04:55 PM

Quote:

Originally Posted by Kirk93 (Post 2434529)
I'm getting errors with this.

sitemap_index.xml.gz is located in /vbseo_sitemap/data/..., but when I link to it the search engines can't find the additional xml's because they're reportedly supposed to be in the root folder.

How do I fix this aside from manually adding each one? Thanks for your help by the way. :)

You are correct the actual file locations for all sitemaps are in /vbseo_sitemap/data/ but that is not where you link to them. You link to the index file in the forum root.


Code:

http://www.yoursitename.com/forums/sitemap_index.xml.gz
The index sitemap file does not reside there but it and all other sitemap files are accessed there. For this to work correctly, this line should be in your forum root .htaccess .


Code:

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

Delfi_r 07-20-2013 08:36 PM

Where is the information to run on 4.21? I uninstalled the plugin as it ceased to work and I understand that should run if I make some changes.

Kirk93 07-20-2013 10:24 PM

Quote:

Originally Posted by bzcomputers (Post 2434594)
You are correct the actual file locations for all sitemaps are in /vbseo_sitemap/data/ but that is not where you link to them. You link to the index file in the forum root.


Code:

http://www.yoursitename.com/forums/sitemap_index.xml.gz
The index sitemap file does not reside there but it and all other sitemap files are accessed there. For this to work correctly, this line should be in your forum root .htaccess .


Code:

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

Hello,

That rewrite rule was already present in HT access, but Google is still throwing up errors when I try to submit "sitemap_index.xml.gz" as a sitemap.

Any ideas/suggestions?

bzcomputers 07-21-2013 12:18 AM

Quote:

Originally Posted by Kirk93 (Post 2434631)
Hello,

That rewrite rule was already present in HT access, but Google is still throwing up errors when I try to submit "sitemap_index.xml.gz" as a sitemap.

Any ideas/suggestions?

Message me your site address and I'll see if I can't track down the issue.

Easelm 07-21-2013 02:44 PM

I have had this installed for a few months now and it's working great. The only thing
I don't receive is the SE Bots Activity Log, it's just blank.. Any ideas?

(I have the robots.txt added along with the meta tag for it)

I get plenty of spider bots on the site, just nothing in the log. Any suggestions or help
will be greatly appreciated

fxdigi-cash 08-09-2013 02:49 PM

There is something strange in here showed up after my web hosting "Bluehost" had been down for almost 1 day. I get this error:
PHP Code:

The component "Zend Optimizer" is not installed on the Web Server and therefore cannot service encoded filesPlease download and install the Zend Optimizer (available without chargeon the Web Server

as if my web hosting doesn't support Zend optimizer, but I could see the feature is ON.

I use PHP 5.4 (FastCGI) and I'm wondering if everyone is the same or different on this!!

any idea ??

Update: I had to copy some zend opimizer url path from php5.2 fast-cgi to php5.4 fast-cgi and it works perfect!!

Black Tiger 08-12-2013 12:18 AM

Quote:

Auto-notifies Search Engines when a new sitemap is generated (optional)
This is not working anymore.
Can this be fixed?

smirkley 08-16-2013 04:46 PM

I have the issue with the malformed cms pages in the cms sitemap file. The trailing slash after the root url is missing.

I have just downloaded the install and this is installed today. But the problem seems to be back from a previous version.

Does anyone have the two files bolded below from the fixed version they could give me?

Quote:

Originally Posted by Chuta (Post 2242317)
Hello,

The issue has been corrected. Please download the package again and follow the upgrade instructions supplied within the readme.html file, which is located inside the docs (do not upload) folder.

Quote:

Originally Posted by Chuta (Post 2249611)
The only files that have been updated are: vbseo_sitemap_functions.php and md5_sums_crawlability_sitemap.php (this one because of the checksum).

We can't just add them as separate files, because new people downloading the package may get confused about what to download and how to install what they've downloaded.


lasalle6969 08-25-2013 10:27 PM

Muy bueno. Lo utilizaré a ver qué tal

ozzy47 08-25-2013 10:32 PM

Please keep posts in English.

ip-ip 08-29-2013 09:39 PM

I have this error after Run Generator :

[SECTION START] tags [25,482.5Kb mem used] [61,254,440s (+61,254,440s)]

friendlymela 09-07-2013 02:35 PM

I have installed this mod today after then i try to submit it on manually on google web master but it saying /sitemap_index.xml.gz not found on server . but it was already in data folder then i try to submit sitemap with full extension but still same issue i face after then i download manually sitemap_index.xml.gz on my pc and then upload it on root then it working and then i have submit it into google webmaster. i dont know whats happening please guide me whats right or wrong?

crazyboy1661 09-07-2013 03:05 PM

Quote:

Originally Posted by ip-ip (Post 2441907)
I have this error after Run Generator :

[SECTION START] tags [25,482.5Kb mem used] [61,254,440s (+61,254,440s)]

I too got this message. Then I had removed those files from root Dir. Please any reply is appreciated.

bzcomputers 09-07-2013 06:53 PM

Quote:

Originally Posted by friendlymela (Post 2443955)
I have installed this mod today after then i try to submit it on manually on google web master but it saying /sitemap_index.xml.gz not found on server . but it was already in data folder then i try to submit sitemap with full extension but still same issue i face after then i download manually sitemap_index.xml.gz on my pc and then upload it on root then it working and then i have submit it into google webmaster. i dont know whats happening please guide me whats right or wrong?

The rules setup for VBSEO folders will deny direct access to the files (intentionally for security reasons).


I would assume your issues are with your .htaccess file(s) not being setup correctly.


Try this link: http://www.vbseo.com/f67/vbseo-htaccess-file-47787/
or Google VBSEO .htaccess rules.

smirkley 09-07-2013 11:58 PM

Plus if you have a reference to your sitemap in robots.txt, you may want to check that is for the proper filename as this mod has a unique one for sitemap index, even if you dont use vbseo like me.

(and note, this mod works best if you let the sitemap reside in its natural directory. And also note, go ahead and disable the post setting in this mod as all it does is create 404 errors for google)

friendlymela 09-08-2013 09:24 AM

Thanks both of u i have add this

RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

now its working and i have submit sitemap on google webmaster.

hey i need to submit it also on bing and i need to submit it again on google webmaster or it will work automatically ?

bzcomputers 09-08-2013 03:09 PM

Quote:

Originally Posted by friendlymela (Post 2444097)
hey i need to submit it also on bing and i need to submit it again on google webmaster or it will work automatically ?

It you have it setup to run automatically both Google and Bing will be notified that there is a new sitemap. You will see all their activity in the "Sitemap Downloads Log". This is an easy way to confirm they are receiving the update notifications. After a short time even if you don't send update notifications they will still check for changes in your sitemap automatically. You will typically see download activity from both Google (Googlebot) and Bing (msnbot) once a day.


If you run the sitemap creation manually, there will be no notifications sent to Google or Bing and this is when you'll need to make sure to submit/resubmit your sitemaps.

friendlymela 09-10-2013 06:05 AM

Quote:

Originally Posted by bzcomputers (Post 2444162)
It you have it setup to run automatically both Google and Bing will be notified that there is a new sitemap. You will see all their activity in the "Sitemap Downloads Log". This is an easy way to confirm they are receiving the update notifications. After a short time even if you don't send update notifications they will still check for changes in your sitemap automatically. You will typically see download activity from both Google (Googlebot) and Bing (msnbot) once a day.


If you run the sitemap creation manually, there will be no notifications sent to Google or Bing and this is when you'll need to make sure to submit/resubmit your sitemaps.

Thanks for it dear. would u like to tell me why is not active on yahoo?

friendlymela 09-10-2013 06:07 AM

Is there i need to edit robots.txt after install this mod?

bzcomputers 09-10-2013 02:13 PM

Quote:

Originally Posted by friendlymela (Post 2444572)
Is there i need to edit robots.txt after install this mod?

It's always good practise to reference your sitemap in robots.txt.


I personally do it on the first line. In my case the first line looks like this:


Code:

Sitemap: http://www.mysite.com/forums/sitemap_index.xml.gz

ged 10-04-2013 05:47 PM

Two weeks ago, I've uninstalled VBSEO. After this, I started using vBulletin's own SEO system.

Now, everytime I check Google Webmaster Tools, it says "this file does not contain any urls."

Do you get the same error and if it is so, how did you solve it?

smirkley 10-04-2013 07:23 PM

Did you change the robots.txt sitemap reference to the new sitemap url?

DemOnstar 10-05-2013 03:51 AM

Where does one find the robots.txt?

friendlymela 10-05-2013 03:49 PM

Quote:

Originally Posted by bzcomputers (Post 2444652)
It's always good practise to reference your sitemap in robots.txt.


I personally do it on the first line. In my case the first line looks like this:


Code:

Sitemap: http://www.mysite.com/forums/sitemap_index.xml.gz

Google webmaster showing me this following error i dont know what should i do now

We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting

smirkley 10-05-2013 04:30 PM

Quote:

Originally Posted by DemOnstar (Post 2450054)
Where does one find the robots.txt?

In your root directory. You may want to seach around for a good example robots.txt to use with vB to give you a head start on getting it right.

Quote:

Originally Posted by friendlymela (Post 2450203)
Google webmaster showing me this following error i dont know what should i do now

We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting

If you have just submitted your new sitemap url to google, give it a week or so to settle the data. It seems that happened to me until everything got settled with my sitemaps and with google reading it properly.

smirkley 10-05-2013 04:32 PM

edit to add, remember that the vbseo sitemap resides in the vbseo_sitemap directory. That will need to be in robots.txt as well as submitted to google.

edit the edit, I just reaslized I am not sure about the url structure, but just as long as it is properly entered it will work.

DemOnstar 10-05-2013 04:36 PM

Quote:

Originally Posted by smirkley (Post 2450227)
In your root directory. You may want to seach around for a good example robots.txt to use with vB to give you a head start on getting it right.

Yes, i am guessing that you are right but from somebody that has very little idea, searching round for a good example doesn't really mean much..

Is it possible to provide a good example?

And also a bad example?

Thanks..............

Edit: I cannot find a robots.txt in my root directory, it isn't there..

I also do not have vbseo as a mod. If it is part of the vB 4.2.1 core, I wouldn't know that either...

bzcomputers 10-05-2013 06:54 PM

Quote:

Originally Posted by DemOnstar (Post 2450229)
Yes, i am guessing that you are right but from somebody that has very little idea, searching round for a good example doesn't really mean much..

Is it possible to provide a good example?

And also a bad example?

Thanks..............

Edit: I cannot find a robots.txt in my root directory, it isn't there..

I also do not have vbseo as a mod. If it is part of the vB 4.2.1 core, I wouldn't know that either...

If robots.txt isn't there create a new one. Good example can be found here:
https://vborg.vbsupport.ru/showthread.php?t=302570




vbSEO is not part of vB 4.2.1

smirkley 10-05-2013 09:26 PM

Yes, I have been using vb for some time, and forgot robots.txt doesnt come with the bundle.

And yes, its no big deal to make one and uploasd to your root.
It is just a flat txt file anyway.

smirkley 10-05-2013 09:27 PM

Quote:

Originally Posted by bzcomputers (Post 2450249)
If robots.txt isn't there create a new one. Good example can be found here:
https://vborg.vbsupport.ru/showthread.php?t=302570

That is a good example.

And just append the sitemap url and reference to the header or footer.

friendlymela 10-06-2013 04:14 AM

Quote:

Originally Posted by smirkley (Post 2450227)
In your root directory. You may want to seach around for a good example robots.txt to use with vB to give you a head start on getting it right.



If you have just submitted your new sitemap url to google, give it a week or so to settle the data. It seems that happened to me until everything got settled with my sitemaps and with google reading it properly.

I have submit it before 15 or 20 day ago, it was working fine but from last 7 days its showing said error

CAG CheechDogg 10-06-2013 05:36 AM

I for what ever reason decided to go to my manage domains page and just decided to click away to see how google was doing with crawling my site and such..

Well I noticed that for some reason google was saying that there is an error and was not able to crawl my site and forums as well as not being able to access the sitemap...

I believe its something to do with google themselves, I wouldn't worry to much about it, wait a few days maybe a couple of weeks and then see if they are still having problems with the sitemaps....

Please not, that was the issue with me it could of course be something completely different with you.

CAG CheechDogg 10-06-2013 05:42 AM

One more thing, make sure you add this to your robots.txt


User-agent: *
Allow: /
sitemap:http://www.yourdomain.com/path/to/your/sitemap-file


This instructs them to allow access to your sitemap at the path indicated here...

friendlymela 10-06-2013 11:37 AM

Quote:

Originally Posted by CAG CheechDogg (Post 2450325)
One more thing, make sure you add this to your robots.txt


User-agent: *
Allow: /
sitemap:http://www.yourdomain.com/path/to/your/sitemap-file


This instructs them to allow access to your sitemap at the path indicated here...

i have done this but still same problem in google webmaster

bzcomputers 10-06-2013 12:50 PM

Quote:

Originally Posted by friendlymela (Post 2450384)
i have done this but still same problem in google webmaster


There are some characters that Google does not like to see in sitemaps and will error out when trying to read them. vBSEO Sitemap should encode all urls correctly so this isn't an issue but I've have run across at least a couple characters that aren't coded correctly. Offhand I can't remember exactly the ones I've personally run into but I believe the ampersand was one of them ("&" should be changed to "&" in any url reference). I remember the ampersand was definitely an issue for me if it wasn't coded as "&" I ran across this error a couple times when I was adding urls to the "extra-urls.txt" file.

Whenever Google would give me a sitemap error, my solution was to check my latest sitemap manually and see if there was an odd character in any thread/post title url. Usually I would find one, then I would just go to the forum edit the thread title, recreate the sitemap and all was good.

smirkley 10-06-2013 01:45 PM

Also, do not use all the settings in vbseo sitemap.

Indexing the "post" settings as on, may produce considerable 404 errors in webmaster tools. That settings will list incorrect url's in sitemaps. (I am using pretty urls)


All times are GMT. The time now is 02:53 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02132 seconds
  • Memory Usage 1,863KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (7)bbcode_code_printable
  • (1)bbcode_php_printable
  • (21)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete