View Full Version : vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.6.x, 3.5.x & 3.0.x
kailew
01-06-2006, 09:45 PM
finally, maybe after 50 tries I did it also ...
thx so far
Kai
SchottenHammel
01-07-2006, 08:57 AM
iojam,
the server supports mod_rewrite. It seems as if the .htaccess would simply block all access to the forum.
Weird, isn't it?
iojam
01-07-2006, 09:22 AM
Yes, it is weird. Have you checked with your hosting support that mod_rewrite configuration is allowed within .htaccess files? Did you tried any rewrite rules entered in .htaccess ?
firstrebel
01-07-2006, 01:55 PM
Yes, it is weird. Have you checked with your hosting support that mod_rewrite configuration is allowed within .htaccess files? Did you tried any rewrite rules entered in .htaccess ?
I have the same problem. We have our own leased server, how can I find out if mod_rewrite configuration is allowed within .htaccess files? We have Apache 2.0.52.
Bob
Confusion
01-07-2006, 04:24 PM
Hi,
First of all I want to say thanks for the wonderful hack. However, I'm having problems with it. The first two nights I had it installed, it worked perfectly (ran good, sent me e-mails, etc.)...but for some reason, all of the sudden, it stopped working. Do you know the cause?
Masiello
01-07-2006, 04:50 PM
Hi,
First of all I want to say thanks for the wonderful hack. However, I'm having problems with it. The first two nights I had it installed, it worked perfectly (ran good, sent me e-mails, etc.)...but for some reason, all of the sudden, it stopped working. Do you know the cause?
Look about Cron set in schedule tasks
iojam
01-07-2006, 06:54 PM
firstrebel,
first, please ensure that mod_rewrite module is loaded (you will see that at phpinfo page).
Another important requirement is to have "Options +FollowSymLinks" in httpd.conf for your web files directory.
Confusion,
please enable the logging for vBSEO Sitemap Generator scheduled task in vB admincp and check the log next time if an error repeats.
Code Monkey
01-08-2006, 03:36 PM
Is there anything I need to change in the .htaccess when I run the vba addon and vba is installed in the root / directory and vb is installed in /forums directory?
iojam
01-08-2006, 03:50 PM
JumpD,
if you have vba installed in the root and vB in forums/ subfolder, you should create the .htaccess file in root folder (not in vb folder):
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ forums/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
And then manually submit the sitemap to your Google Webmatser account:
http://www.example.com/sitemap_1.xml.gz
Code Monkey
01-08-2006, 04:03 PM
So the auto submit won't work then?
Thanks for the info. I had a fealing it was wrong.
iojam
01-08-2006, 04:09 PM
JumpD,
auto submit will not be required once sitemap URL is manually entered in google webmaster account. Google will keep downloading your sitemap anyway and you can turn off the "google notify" option.
Code Monkey
01-08-2006, 04:15 PM
And what about this in the vba addon script?
// uncomment the line below if your vbadvanced root URL is in upper level relative to vB url
//$vba_url = preg_replace('#[^/]*/$#', '', $vba_url);
Also, I run a second vba front page in a subdomain. Is that going to get left out?
One thing I notice is the links to the files in the admin script still show them as being under the forum dir.
Code Monkey
01-08-2006, 04:16 PM
JumpD,
auto submit will not be required once sitemap URL is manually entered in google webmaster account. Google will keep downloading your sitemap anyway and you can turn off the "google notify" option.
Gotcha. I had a feeling that was the case.
iojam
01-08-2006, 05:50 PM
And what about this in the vba addon script?
You should uncomment this line as desribed (or enter it manually like $vba_url = 'http://www.example.com'; )
Also, I run a second vba front page in a subdomain. Is that going to get left out?The sitemap should not contain URLs from different domains. So, if you have the page from other subdomain at your site, don't include it.
One thing I notice is the links to the files in the admin script still show them as being under the forum dir.The relative URL for vBadvanced pages is defined using $vba_url variable - so, when it is corrected as specified above, it should be ok.
Code Monkey
01-08-2006, 05:57 PM
By the way, this app is totally useless on servers that have short tags off.
CompuJonathan
01-09-2006, 09:06 PM
I'm having some problems running the tool.
This is what I have in the config file:
// vBSEO Installed?
'vbseo_sm_vbseo' => '',
// Run from vB Scheduled Tasks Manager ONLY
'vbseo_sm_crononly' => '',
When I try to run it directly, I get a 500 Internal Server Error.
When I run it from vbulletin, I get:
vBSEO - Create Google/Yahoo Sitemap
Cannot run sitemap generator directly: you should set "Run from vB Scheduled Tasks Manager ONLY" to "No" in admincp to allow this.
Not sure what I have done wrong. It wasn't hard to install.
baerwurz
01-09-2006, 09:20 PM
Hi google takes the sitemap every night at 2 o clock, but there are no spiders at my Board?
The first sitemap google hast taken was 03.01.06, is it normally, that it takes so much time?
vBSEO
01-09-2006, 11:50 PM
By the way, this app is totally useless on servers that have short tags off.
Thanks for reporting, this has been fixed in the next version (v.1.7)
@CompuJonathan - Are you using vB3.0.x? vbseo_sm_config30x.php is used for these versions only. Also, if you let me know your vbseo_sitemap URL, I can try to help you out further :rolleyes:.
@baerwurz - How are you tracking spider visits? The "SE Bots Activity Log" is available only when using vBSEO. Otherwise, once the sitemap is generated and google downloads it, the the generator job is done. It depends on googlebot when/how often to download forum pages.
Thanks @ all!
HaYLaZ
01-11-2006, 10:35 AM
tested with 3.5.3 works perfectly
thanks very much this very beatifull mod
ı want to ask this
vbseo generates sitemaps in data folder or self folder
can we change folder path because evey time we must move sitemap.xml.gz file to forums root directory.
Can we change vbseos xml creating directory to forums root directory so it can be overwrite old gz files:)
Nigh7mar3
01-11-2006, 10:36 AM
It's compatible with vbb 3.5.3?
iojam
01-11-2006, 02:36 PM
HaYLaZ
the files are stored in the vbseo_sitemap/data/ folder, but the link to sitemap still points to forums root, when you enter the specified rewrite rules in .htaccess. You don't need to move the files! :)
Nigh7mar3
yes, it is compatible with vB 3.5.3
HaYLaZ
01-12-2006, 09:50 AM
thanks but what must ı write htaccess file for creating xml file to forums root
aciurczak
01-12-2006, 03:33 PM
I think you may be missing the point. The file that needs to be written to may need pretty open permissions to work. Yet the search engines assume that this file will be in the forum root. This hack includes instructions on how to deal with both of these. It puts the file within the vbseo folders, you can open up permissions on that subfolder without opening up permissions on your higher level forums directory. Then the htaccess rule points browsers and search engines looking for that specific file in the forums directory, and feeds them the file (transparently) from the subdirectory. Yes, you probably can get this hack to work by writing the file directly to the forums directory, but you don't want to; you just don't know that yet.
firstrebel
01-12-2006, 05:16 PM
I have installed this and ran cron manually and got this
<blockquote>
<blockquote>
<p><strong>There seems to have been a problem with the Volvo Community database.</strong><br />
Please try again by clicking the <a href="#" onclick="window.location = window.location;">Refresh</a> button in your web browser.</p>
<p>An E-Mail has been dispatched to our <a href="mailto:email at domian dot com">Technical Staff</a>, whom you can also contact if the problem persists.</p>
<p>We apologise for any inconvenience.</p>
<!--
Database error in vBulletin 3.5.3:
Invalid SQL:
SELECT * FROM vb_adv_setting;
MySQL Error : Table 'vb_forum.vb_adv_setting' doesn't exist
Error Number : 1146
Date : Thursday, January 12th 2006 @ 07:03:52 PM
Script : http://
Referrer :
IP Address : xxxxxxxxxxxx
Username : Unregistered
Classname : vb_database
-->
</blockquote>
</blockquote>
</body>
What has gone wrong please?
Bob
iojam
01-12-2006, 06:59 PM
Bob
have you enabled the vbseo_sm_vba.php add-on module for vBSEO Sitemap Generator in the options? It is only useful when you have vBadvanced installed.
Please try to disable the mentioned add-on. :)
firstrebel
01-12-2006, 07:28 PM
That fixed it, thanks.
Bob
firstrebel
01-12-2006, 07:39 PM
Tried to submit the .txt.gz file to Yahoo but got this error
Your submission request was not accepted because:
The following resulted when trying to access your document:
403 - Forbidden
I read the previous threads on the 403 error and htaccess file.
This is my htaccess in the forum root
Options +FollowSymLinks
RewriteEngine On
RewriteRule ^$ index.php
RewriteRule (^[-_A-Za-z0-9\ ]*$) userpage.php?do=main&username=$1
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
and this is the htaccess in /vbseo_sitemap/datadeny from all.
Are these correct?
Bob
iojam
01-12-2006, 08:43 PM
Bob,
Yes, the .htacess entries are correct.
Which sitemap URL do you submit to Yahoo? It should be http://yourforumsroot/sitemap.txt.gz
(NOT vbseo_sitemap/data/..)
firstrebel
01-12-2006, 08:50 PM
sitemap.txt.gz (size=459,644) is in /forum/vbseo_sitemap/data along with the other .xml.gz files.
Bob
iojam
01-12-2006, 09:07 PM
Yes, but you should use links to forums root instead of direct urls (both xml.gz and txt.gz sitemaps). It is achieved transparently using the rewrite rules in .htaccess and it was discussed few times in this thread. :)
firstrebel
01-12-2006, 09:11 PM
Yes, but you should use links to forums root instead of direct urls (both xml.gz and txt.gz sitemaps). It is achieved transparently using the rewrite rules in .htaccess and it was discussed few times in this thread. :)
I don't mean to be ungratefull, but this thread is a nightmare to read through. You have to scroll through a huge section of info, install and stuff on each page before getting to the posts, and there are now 36 pages.
Bob :tired:
Code Monkey
01-13-2006, 04:23 AM
Ok, heres the scoop. I have long been frustrated with google. My sites show up well in yahoo searches, yet google has always been aloof. Since I installed this a couple weeks ago, I see their spiders crawling my site at regular intervals. They never did that before. Yahoo did, msn did, but not google.
They are downloading the sitemap a at least twice every 24 hours and the bots are crawling the new threads. So hopefully this will help. It will be interesting to see if it changes the pr's. I believe that gets updated this month. We'll see.
So, to make a long story short. good job guys. This hack does what it says it does and does it well. My hats off to you. *tips hat*
Jump
800fsbgang
01-13-2006, 09:34 AM
Sorry,Is there anyone that could tell me what ive done,ive installed this hack,and when i try and run in create google/yahoo sitemap scheduled task manager I get this message
vBSEO - Create Google/Yahoo Sitemap
Im running vbulletin version 3.5.2 and have installed this hack as a plugin
Warning: main(/home/mknforum/public_html/./vbseo_sitemap/vbseo_sitemap.php): failed to open stream: No such file or directory in /admincp/cronadmin.php on line 64
Warning: main(): Failed opening '/home/mknforum/public_html/./vbseo_sitemap/vbseo_sitemap.php' for inclusion (include_path='.:/usr/lib/php:/usr/local/lib/php') in /admincp/cronadmin.php on line 64
Done
First is this installed incorrectly,is google not able to recieve automatic sitemap updates.
Code Monkey
01-13-2006, 12:26 PM
public_html/./vbseo_sitemap/ Why is there a period in your directory structure? Could that be the problem?
800fsbgang
01-13-2006, 12:56 PM
Thanks for your quick response,but am really a complete nube and am struggling to understand what you mean.sorry
firstrebel
01-13-2006, 02:17 PM
Originally Posted by iojam
Yes, but you should use links to forums root instead of direct urls (both xml.gz and txt.gz sitemaps). It is achieved transparently using the rewrite rules in .htaccess and it was discussed few times in this thread.
links to forums root instead of direct urls
Don't understand what you are saying here. Where do these go?
I sat down with a large pot of tea and read through the thread and I think this is the correct understanding.
The xml.gz and txt.gz files really are in http://www.volvoclub.org.uk/forum/vbseo_sitemap/data, but when I submit to Yahoo I put http://www.volvoclub.org.uk/forum/sitemap.txt.gz in the feed submission box. Is this the only file to submit to Yahoo?
I presume I do nothing for the Google submissions.
Thanks.
Bob
iojam
01-13-2006, 03:07 PM
800fsbgang,
does it work correctly from vBSEO Sitemap interface (vbseo_sitemap/index.php)? Please PM me your forums URL.
Bob,
The xml.gz and txt.gz files really are in http://www.volvoclub.org.uk/forum/vbseo_sitemap/data, but when I submit to Yahoo I put http://www.volvoclub.org.uk/forum/sitemap.txt.gz in the feed submission box. Is this the only file to submit to Yahoo?
Yes, exactly.
The google sitemap urls are:
http://www.volvoclub.org.uk/forum/sitemap_index.xml.gz
http://www.volvoclub.org.uk/forum/sitemap_1.xml.gz
It is submitted automatically (when corresponding option is enabled), but you can add them manually to your google webmaster account to track their status.
firstrebel
01-13-2006, 03:14 PM
Thanks. *click install*
Bob
Nigh7mar3
01-13-2006, 03:54 PM
800fsbgang,
does it work correctly from vBSEO Sitemap interface (vbseo_sitemap/index.php)? Please PM me your forums URL.
Bob,
Yes, exactly.
The google sitemap urls are:
http://www.volvoclub.org.uk/forum/sitemap_index.xml.gz
http://www.volvoclub.org.uk/forum/sitemap_1.xml.gz
It is submitted automatically (when corresponding option is enabled), but you can add them manually to your google webmaster account to track their status.
sitemap1?
I submitted sitemap_index.xml.gz to my google sitemap
I need to add
sitemap_1.xml.gz
sitemap_2.xml.gz
sitemap_3.xml.gz
sitemap_4.xml.gz
sitemap_5.xml.gz
sitemap_6.xml.gz
???
another little question, I think cronjob is better, If I active cronojob I must delete the schedule of task manager
iojam
01-13-2006, 06:10 PM
Nigh7mar3,
It is noticed that it takes less time for Google to download individual sitemap files when they're entered manually to google webmaster account as compared to submitting sitemap index only.
Yes, you can use system cron service instead of vB scheduler.
Great mod actually since like most of us that my site is on dynamic pages.
But could it be that the mod is wrecking up the admin cp? Cause atm my admincp seems to be totally unviewable no matter what AdminCP template I'm using and this only happend after I've installed the mod as a plugin.
I even emptied my browsers cache to see if was a wrong image loadout.
The attachment tells you how I'm looking at my admincp.
Weird thing is that my template hasnt been change or been uninfected (http://www.the-darks.com/forums/)
iojam
01-14-2006, 10:54 AM
Hello EuT,
it should not be related to vBSEO Sitemap Generator, however it is possible that you have enetered an incorrect rewrite rule in .htaccess file. Please try to remove it temporary and check if that helps.
stinger2
01-15-2006, 08:25 PM
hi
great hack
when i try to extract the sitemap.txt from the gz it says file is corrupted.....is that normal??
i am using winrar.........i know i should not extract....but just something i wanted to see inside the text file.
iojam
01-15-2006, 08:49 PM
Hello stinger2,
is it opened correctly when opening from your browser? Please PM me your sitemap url.
msimonds
01-17-2006, 04:45 PM
if we get this error from yahoo
Your submission request was not accepted because:
The following resulted when trying to access your document: timeout
Please correct and resubmit the form below.
what do we need to do to correct this?
ConqSoft
01-17-2006, 04:49 PM
Keep re-submitting it. It can take MANY tries to get Yahoo to accept it.
msimonds
01-17-2006, 05:18 PM
Keep re-submitting it. It can take MANY tries to get Yahoo to accept it.
which URL do we submit, the text.gz file?
ConqSoft
01-17-2006, 05:20 PM
Yes.
msimonds
01-17-2006, 05:22 PM
Yes.
Thanks dude
I appreciate it
msimonds
01-17-2006, 05:47 PM
I have tried so many times, I give up
Guest0321
01-20-2006, 03:25 PM
The mod_rewrite parms for this don't work for my site for some reason, although I know mod_rewrite works because I rewrite the www subdomain.
So... you can try this if you can't access your sitemap files from your vbroot folder. This is what I do...
(Note, you'll need access to cron to do this).
1) Remove the 2 line change to the .htaccess file from the instructions
2) Set up a cron job to run daily 1 hour after vbseo site map runs. For instance, I run my vbseo sitemap at noon each day, and I run this cron an hour later (1300 hours)
NOTE: Change "{vbroot}" to where your vbulletin forum is located on your server.
0 13 * * * cp {vbroot}/vbseo_sitemap/data/sitemap*.gz {vbroot}/
This copies your sitemap files to your forums root once a day at 01:00pm.
firstrebel
01-20-2006, 07:50 PM
At the time of installing this hack Google had 228,000 pages indexed for us. It is now falling and is at 198,000. Also Yahoo only has ~16,000 pages indexed.
Can someone offer an explanation please?
Bob
Okay...maybe I found the problem. As usual, it is probably the result of not completely reading the instructions. I had it set to run once per night but had the minutes still set to *. So...I suppose it was trying to run every minute of that hour. I'll find out tonight and maybe this will help somebody else who is having the same problem.
Don
Good question, I was getting the same thing here too. You would figure that default would be set to 0 by default when you create a task. Pretty silly if you ask me. I have other tasks that will be going crazy aswell if this is the case.
Thanks
Jaks
funinthesun
01-23-2006, 02:53 PM
I've had this mod installed for ages and yet my indexed pages on google haven't gone up at all! In fact, I only have 2 page on google and they are the two url's pointing to my forum. Does this really work or what? Also, reading google's guidelines it says that this sort of automated thing will cause your website to NOT be indexed. Can someone please elaborate? Thanks :)
funinthesun
01-23-2006, 02:55 PM
Also, whenever I recieve the email update of the sitemap it's always blank for showpost even though I've set it to index these from my admincp?
ConqSoft
01-23-2006, 03:10 PM
Well, since it was only released in November of last year, you couldn't have had it installed "for ages". ;)
It can take a while (months) for your newly indexed pages to start showing up in Google. Are you showing that Google is downloading your sitemaps? (this hack has a log that shows everytime they have been downloaded)
firstrebel
01-23-2006, 05:33 PM
Is a daily submission really necessary? Would once or twice a week not be enough?
Bob
iojam
01-23-2006, 07:41 PM
I've had this mod installed for ages and yet my indexed pages on google haven't gone up at all! In fact, I only have 2 page on google and they are the two url's pointing to my forum. Does this really work or what? Also, reading google's guidelines it says that this sort of automated thing will cause your website to NOT be indexed. Can someone please elaborate? Thanks Hello,
you should check that googlebot downloads your sitemap (look at "Show Sitemap Downloads Log" page).
It is not guaranteed that Google will index all URLs included into sitemap. More details:
https://www.google.com/webmasters/sitemaps/docs/en/faq.html
Also, whenever I recieve the email update of the sitemap it's always blank for showpost even though I've set it to index these from my admincp?
Make sure that you have the latest version of vBSEO Sitemap Generator installed.
iojam
01-23-2006, 07:46 PM
firstrebel
Is a daily submission really necessary? Would once or twice a week not be enough?
Practically, it is not mandatory to submit daily.
Moreover, if you will manually add sitemap URL to your google webmaster account, you will notice that google downloads it daily even if you turn off "notify google" in Sitemap Generator options.
firstrebel
01-24-2006, 03:14 PM
Thank you.
Bob
DementedMindz
01-25-2006, 04:52 PM
question in the data folder is a htaccess with deny from all how can google pull info if its denied?
iojam
01-25-2006, 05:02 PM
DementedMindz,
the data/ folder is not accessed directly - you should submit http://yourforumsroot/sitemap_1.xml.gz URL (not http://yourforumsroot/vbseo_sitemap/data/sitemap_1.xml.gz)
DementedMindz
01-25-2006, 05:07 PM
thank you i just wasnt sure if the htaccess in root allows them to grab the sitemap
darkdiver
01-26-2006, 02:06 PM
one Problem with the Time an Date in the Highscore
absoluter Highscore: darkdiver schaffte 160 Punkte am d.m.Y
and here
# Benutzername Punkte Kommentar Zeit Dauer
1 jamesbond
Snake Champion!
59 No Comment d.m.Y, H:i 4 Sek.
2 jamesbond 0 No Comment d.m.Y, H:i 3 secs
nguyenvuan
01-26-2006, 02:11 PM
Hello,
I installed this plugin but in my Google acc, it show error "Unsupported file format".
How can I sold it out?
Thank you very much
iojam
01-27-2006, 12:08 AM
darkdiver,
one Problem with the Time an Date in the Highscore
absoluter Highscore: darkdiver schaffte 160 Punkte am d.m.Y
Perhaps this is about another hack, not vBSEO Sitemap Generator? :)
nguyenvuan,
please let me know the URL you are submitting to Google.
EricaJoy
01-27-2006, 11:33 AM
At the time of installing this hack Google had 228,000 pages indexed for us. It is now falling and is at 198,000. Also Yahoo only has ~16,000 pages indexed.
Can someone offer an explanation please?
BobMega ditto. My pages indexed are steadily falling. If this trend continues, I'm going to have to uninstall. Also, the pages that Google has aren't the ones in the sitemap. What gives?
T2DMan
01-27-2006, 11:59 AM
Mega ditto. My pages indexed are steadily falling. If this trend continues, I'm going to have to uninstall. Also, the pages that Google has aren't the ones in the sitemap. What gives?
Have you recently upgraded to vbulletin 3.5. There are many rel=nofollows on the new version that means that many duplicate url's are no longer available to the search engines. This would reduce the urls reported on Google/Yahoo. But this is nothing to worry about.
You have to understand what a sitemap is. Its just a list of url's of your existing forum. It lets Google/Yahoo know the url's that you have, and the new ones that have been added.
How many pages are reported on google compared to the url's in the sitemap? If you have an old site, and less url's in Google than the sitemap, then you possibly need more inbound links/Google Pr, and better onpage SEO.
A site map does not SEO your pages, does not make each page any more unique than any other regards duplicate content... A sitemap can do no harm, and Google still spiders your site normally.
Do you have the vbSEO rewrite installed?
Do you have any other url rewrite hack installed?
Since rewrite hacks will have a big effect on the url's this would give some answers. You would need to make sure that the sitemap was doing the rewritten urls properly (certainly would work with vbseo url rewriter).
Apart from the above, just put it down to the ups and downs of how Google and Yahoo report pages.
I recommend that you look at the onpage SEO template changes I recommend on my thread Search Engine Optimize vBulletin 3.5. (http://forum.time2dine.co.nz/seo-vbulletin/search-engine-optimize-vbulletin-3-5-a-2460.html) With vBSEO, and my onpage changes, sites generally get to the top of the SERPS for many forums and threads.
All the best.
EricaJoy
01-27-2006, 11:20 PM
We upgraded near the end of December and we have a non vbSEO url rewrite solution. i will implement your ideas on SEO for vb 3.5 and let you know how it goes.
thanks!
T2DMan
01-27-2006, 11:29 PM
With a non vbseo rewrite, you will need to make sure that the sitemap shows the rewrites. Be very careful using the vbseo sitemap as this will only list the old default vBulletin url's (unless you have customised the vbseo sitemap program)
All the rewrites that I have seen have very big problems. You should not be able to see the old url's at all on your forum. If you can see old url's and these are not 301 redirected to the new, then you have duplicate content, and you are losing out on Google PR and link text value to those pages.
vbseo is the only rewrite that I have seen that does a 100% job (apart from several sites that I have manually coded). In fact, with the new vbseo just out, there are just so many extras over and above plain rewrites, that it is well worth having a look.
EricaJoy
01-28-2006, 03:24 AM
i would love to use vbseo but i just can't justify the price of it. my site has no ads save some adsense on the archives that never gets looked at so everything on it, so everything on it is paid for either out of my pocket or with donations. i can't afford to spend that amount of money. i'll see what happens if i turn the rewrites off though.
joefitz
01-28-2006, 07:26 AM
I'm not sure if this has already been stated but I didn't see it in the 20 some-odd pages I read nor in a search of this thread so... To get the product working with IIS, simply download the "lite" version of ISAPI_Rewrite and then use the following rewrite command:
RewriteCond Host: hostname.domain.name
RewriteRule ^/(sitemap.*\.(xml|txt)(\.gz)?)$ /forums/vbseo_sitemap/vbseo_getsitemap.php\?sitemap=$1 [L]
RewriteRule ^/forums/(sitemap.*\.(xml|txt)(\.gz)?)$ /forums/vbseo_sitemap/vbseo_getsitemap.php\?sitemap=$1 [L]
Note the leading '/' after the start of the regular expression (^); the rewrite rule wasn't working for me without it. I added two rewrite rules; one for root of my website and one for the root of my forums. I wasn't entirely sure which was appropriate so I figured I'd put both in just in case. In essence, the sitemap will now be found whether it is accessed at the webroot or my forum root...
Looking at the output of the actual sitemap_index.xml file I think the /forums rewrite is definitely required. I'm not sure if there is a reason to have the webroot rewrite in there or not; I'm guessing not... If someone in the know would like to chime in with a response that would be great.
In the meantime, everyone should know that there is a free utility (ISAPI_Rewrite the "lite" version) which enabled you to configure this plug-in completely using IIS and Windows.
T2DMan
01-28-2006, 05:35 PM
i'll see what happens if i turn the (non vbseo) rewrites off though.
I didn't say to turn them off. Yes that is one option. My first thought was to make sure that you had hacked the vbseo sitemap program to display the rewritten url's on the sitemap.
I dont know what rewrite program you have, but it may be that even though there are some deficiencies in it, it may be better than the base vBulletin package which has lots of duplicate url's of its own.
Changing url's is not something to be taken lightly. People start quoting the url's in your forum and so changing url's means those quoted url's go no where.
T3MEDIA
01-28-2006, 05:44 PM
odd mine says saved to my forum root but nothing is there.
iojam
01-29-2006, 01:30 AM
T3MEDIA,
sitemap files are physically stored in /vbseo_sitemap/data/ folder.
And sitemap links point to forums root using mod_rewrite entry added in .htaccess.
jlaine
01-29-2006, 04:33 AM
Anyone notice this wording @ yahoo?
A text file containing a list of URLs, each URL at the start of a new line. The filename of the URL list file must be urllist.txt; for a compressed file the name must be urllist.txt.gz.
I've had yahoo grab the data before when it says sitemap.txt.gz, but perhaps it may be prudent to change the name to urllist.txt.gz per the above?
vBSEO
01-29-2006, 04:42 AM
Anyone notice this wording @ yahoo?
A text file containing a list of URLs, each URL at the start of a new line. The filename of the URL list file must be urllist.txt; for a compressed file the name must be urllist.txt.gz.
I've had yahoo grab the data before when it says sitemap.txt.gz, but perhaps it may be prudent to change the name to urllist.txt.gz per the above?
Will be updated in v.1.7 (to be released shortly) :) - Thanks
ChuanSE
01-29-2006, 10:20 AM
why do i have a sitemap.txt.gz in the data folder instead of sitemap.txt? or can yahoo read the gz file?
aacircle
01-29-2006, 10:21 AM
Yahoo can read the sitemap.txt.gz file. It's a compressed text file.
iojam
01-29-2006, 10:22 AM
ChuanSE,
yes, Yahoo can read sitemap files compressed with gzip.
mbader71
01-30-2006, 04:54 AM
Thank you for this awesome hack
installed
ChuanSE
01-30-2006, 05:16 AM
Another q: do we need this if we have vBSEO (is it included there?) or is this a addon to vBSEO as well as it is a standalone feature to non vBSEO users?
T2DMan
01-30-2006, 05:24 AM
Another q: do we need this if we have vBSEO (is it included there?) or is this a addon to vBSEO as well as it is a standalone feature to non vBSEO users?
You need to have this vBSEO sitemap program in addition to the vBSEO rewrites.
vBSEO does the rewrites, the sitemap tells Google/Yahoo about those rewritten url's, and keeps the SE's updated with new url's.
Trana
01-31-2006, 03:52 AM
What impact will this have on my current Yahoo/Google directory listing? My site is indexed as www.xxxxxxx.com, and I have CMPS providing the homepage index in the root folder.
The script seems to point to my /forum folder, will this cause Google or Yahoo to ignore my CMPS index in the root and start ranking other pages about the root?
What are people's experiences with this sort of configuration and what advice can you lend?
Thanks!
KarateKid
01-31-2006, 04:26 AM
Just a question: Does anyone of you guys has problems with unusual memory allocation and not freeing the used memory, so that the script is terminating as memory limit is reached? With the up-to-date versions...? :banana:
helo....we are using it...
but we are a bit confused that.....
sitemap gen..points to .php & url-rewriter rewrite to .html
does that create any problem??
iojam
01-31-2006, 08:42 PM
Trana,
google sitemap submission should not affect indexing/crawling state of pages which are not included in sitemap. You will find more details here: https://www.google.com/webmasters/sitemaps/docs/en/faq.html
KarateKid,
we have no known issues with memory allocation in the recent version of vBSEO Sitemap Generator (except of your case, of course - and we will follow up with it :) )
If someone else have the same problem, please let us know.
Zia,
if you are using vBSEO, you just need to turn on "vBSEO Installed" option for Sitemap Generator. It will create URLs accordingly.
With "vBSEO Installed" option turned off, original (dynamic) vB URLs are added to sitemap.
Trana,
Zia,
if you are using vBSEO, you just need to turn on "vBSEO Installed" option for Sitemap Generator. It will create URLs accordingly.
With "vBSEO Installed" option turned off, original (dynamic) vB URLs are added to sitemap.
helo....hope u wont mind to xplain
we are not using Vbseo(vbseo.com)
we Used vbranking,after using it 2 days we uninstall it cause..after posting..it take 3-4min to display the thread..sometime it causes automerged..
now we are thinking to use vrewrite.that will convert all the url to *.html .
After install vrewrite
hack Google Site Map Generator will face any problem? or it will generate site map with url as *.html ??
can u suggest which re-write will work nice amoung vrewrite,Dcurl re-writer ?
and some other site map generator are found for other search engine
like www.rorweb.com also have ror-sitemap generator.
does bot sitemap generator create any problem or any conflict?
thankx.
T2DMan
02-01-2006, 05:14 PM
My suggestion is to have a good read of the threads about each rewrite product and then make up your mind. In my opinion there is only one that is fully developed and stable, and fast.
With sitemaps, I recommend that you use one that is created via the database, rather than by spidering your site. There are many url's in a forum, not all of which you want or need ranked by the search engines. You will have a lot cleaner sitemap if it is generated from the database.
nguyenvuan
02-01-2006, 05:20 PM
nguyenvuan,
please let me know the URL you are submitting to Google.
I double-check and could not download file named sitemap_1.xml.gz which placed in forums/vbseo_sitemap/data/. I don't know why???
One stupid question:
What is char. I can put in to field named Direct Script Execution Code?
Sorry, I'm a n00b
iojam
02-01-2006, 06:03 PM
nguyenvuan,
you should access forums/sitemap_1.xml.gz instead of vbseo_sitemap/data/*.
What is char. I can put in to field named Direct Script Execution Code?
This code is the password that allows to protect the vbseo_sitemap/ interface from unauthorized access.
redspider
02-04-2006, 06:31 AM
when submit my site how the link goes ?
www mydomain.com/forums/vbseo_sitemap/ ?
T3MEDIA
02-04-2006, 07:52 AM
T3MEDIA,
sitemap files are physically stored in /vbseo_sitemap/data/ folder.
And sitemap links point to forums root using mod_rewrite entry added in .htaccess.Yes thank you for your reply but its not there. 1.5 used to work.
No files are saved. Its a very simple install why would that happen?
Screen just goes white. Mine is for 3.0.x
iojam
02-04-2006, 01:28 PM
redspider
www.mydomain.com/forums/sitemap_index.xml.gz
T3MEDIA
please make sure that you have .htaccess file provided with vBSEO Sitemap Generator in your forum/ folder on the server.
sdp777
02-05-2006, 01:22 PM
iojam, I have read all 40 pages and found little bits here and there, but I have still, yet to get this to work. It was so simple OMG..
First off, I am using vbulletin's last upgrade for the 3.0.X series, 3.0.12
Just so I don't get this wrong...
In my /forums/ folder is the .htaccess (supplied version) and a file vbseo_sitemap.xml
In my /forums/vbseo_sitemap/ there are two folders addons and data...with data being chmod to 777.
In my /forums/vbseo_sitemap/ there are 6 files as follows:
1. extra-urls.txt
2. index.php
3. vbseo_getsitemap.php
4. vbseo_sitemap.php
5. vbseo_sitemap_functions.php
6. vbseo_sm_config30x.php
Of those files, the only one edited was number 6.
Within that file, I edited lines 30, email notify, 68, turn off crononly to '0' and
70, for the run code.
I have setup this both via a cron job in PLESK...and nothing, and then re-reading all of these posts, realized my error and removed that cron, and added a scheduled task in vbadmincp 3.0.12 I can't tell if its run or not. Like others have mentioned, it just posts a blank screen or it tells me to set the value to no in the admincp which obviously is for 3.5.X...and looking at the http://www.mysite.com/forums/vbseo_sitemap/index.php to see if mine reflects what yours shows in the screenshots...I have nothing.
I dunno what I did wrong. Any of the vbseo guys, pm me and I will let you have a look. I really would like to get this up and running.
Thanks for any assistance you can provide.
iojam
02-05-2006, 05:39 PM
sdp777,
Hello!
you don't need vbseo_sitemap.xml file in the forums/ folder (all files are stored in vbseo_sitemap/data/).
Are you able to generate sitemap from your Sitemap Generator interface (http://www.mysite.com/forums/vbseo_sitemap/index.php)? (there is "Run Sitemap Generator" link)
If the problem still exists, please PM me the URL of your vBSEO Sitemap Generator so that I can have a look :)
sdp777
02-05-2006, 06:04 PM
I removed the vbseo_sitemap.xml file completely from the /forums/
Unfortunately, when I run the sitemap generator, all I get is a done in FF and blank white page.
PM'ing ya. Thanks.
mbader71
02-06-2006, 10:54 AM
I have a problem with google sitemap. Could you help me please?
The problem is that google needs to verify the website for their spider to crawl. They asked me to create an empty file names google#.html and put that in the root of my website and according to my website provider I am not allowed to upload files to the root of my website!!!! Is there a way to make this SiteMap generator consider www.mywebsite.com\vb\ as the website instead of www.mywebsite.com ?
iojam
02-06-2006, 03:00 PM
mbader71
the verification in google webmaster account is NOT a required step to submit google sitemap (it is related to seeing the stats for your site, not to sitemaps).
mbader71
02-06-2006, 03:33 PM
mbader71
the verification in google webmaster account is NOT a required step to submit google sitemap (it is related to seeing the stats for your site, not to sitemaps).
:o :o :o
sorry :nervous:
thanks :up:
mikeB
02-06-2006, 04:04 PM
when I run the site map generator all I get is a page of:
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php
I have checked and rechecked that I did everything right, can anyone tell me what they think is wrong? thank you
iojam
02-06-2006, 05:39 PM
mikeB,
please make sure that you set correct permissions for vbseo_sitemap/data/ folder (this is where all files are saved).
cgchris99
02-08-2006, 02:41 AM
Well, I have this installed and have it working for the most part.
Except, when I click the Show Reports List and click the links for the sitemap, they do not show up.
The link shows /forums/sitemap_index.xml.gz
This produces a 404 error when I click on it.
When I remove the /forums and manually enter the url mydomain.com/sitemap_index.xml.gz
It display fine.
Is this a bug or do I have something configured wrong.
aciurczak
02-08-2006, 04:28 PM
After using this for a few weeks, I could not be happier with how well it is working. The rankings for my site in Google have skyrocketed to the top, and I'm almost embarrassed to be listed as the first link for some of the searches (but it is definitely driving traffic). I run a motorcycle forum, and one of the subforums is a news forum that pulls in RSS feeds from various motorcycle news sites. This sitemap generator is so effective, that even when web users put in the exact title of the article, often the link to the post on my site is higher than the link to the actual article on the original site. Also, it shows up on Google no more than a day or two behind the posting on my site (showing that Google is definitely using the sitemaps to update their site a heck of a lot quicker than the typical 8-week full cycle of their web bot). Thanks for putting this together....
iojam
02-08-2006, 07:10 PM
cgchris99,
the sitemap files are linked to your forums root. So, in case if your vb root is "mydomain.com/forums", sitemap URL is "mydomain.com/forums/sitemap_index.xml.gz". Please make sure that your .htaccess file resides in forums/ folder too.
aciurczak,
thank you for your comments! :)
mikeB
02-09-2006, 01:40 AM
cgchris99,
the sitemap files are linked to your forums root. So, in case if your vb root is "mydomain.com/forums", sitemap URL is "mydomain.com/forums/sitemap_index.xml.gz". Please make sure that your .htaccess file resides in forums/ folder too.
aciurczak,
thank you for your comments! :)
I feel like crying ahha after uninstalling this 3 times and reading the instructions with a maginifyning glass I still just get this when I run it:
[homepage] [2,088.0Kb mem used] [0s (+0)]
[SECTION START] forumdisplay [2,088.0Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 4, total threads: 37664, pages: 942 [2,088.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 63, total threads: 0, pages: 1 [2,483.9Kb mem used] [0s (+0)]
[SECTION START] showthread [2,484.1Kb mem used] [0s (+0)]
Warning: gzopen(/home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Permission denied in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 412
Warning: gzopen(/home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/data/sitemap.txt.gz): failed to open stream: Permission denied in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 415
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 423
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
this goes on about 40,000 times aghhh
----
amykhar
02-09-2006, 01:43 AM
Did you chmod the directory?
mikeB
02-09-2006, 01:46 AM
Did you chmod the directory?
I did "CHMOD 777 the 'vB-root/vbseo_sitemap/data/' folder"
so that means only that one folder right?
iojam
02-09-2006, 06:11 PM
Hi,
/home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/data/ folder should have 0777 permissions. Please check that.
mikeB
02-09-2006, 07:48 PM
Hi,
/home/webadmin/bakermedia.com/html/learn/vbseo_sitemap/data/ folder should have 0777 permissions. Please check that.
I do not kow why but today when I try I get to this point:
[homepage] [2,089.6Kb mem used] [0s (+0)]
[SECTION START] forumdisplay [2,089.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 4, total threads: 37697, pages: 943 [2,089.7Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 86, total threads: 245, pages: 7 [2,486.3Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 65, total threads: 1683, pages: 43 [2,489.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 12, total threads: 5238, pages: 131 [2,507.6Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 45, total threads: 1169, pages: 30 [2,141.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 77, total threads: 37, pages: 1 [2,152.9Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 74, total threads: 314, pages: 8 [2,153.4Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 13, total threads: 979, pages: 25 [2,156.2Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 63, total threads: 0, pages: 1 [2,165.1Kb mem used] [0s (+0)]
[forumdisplay] forum_id: 85, total threads: 14, pages: 1 [2,165.6Kb mem used] [0s (+0)]
[SECTION START] showthread [2,165.8Kb mem used] [0s (+0)]
[create sitemap file] filename: sitemap_1.xml.gz, number of urls: 20000 [2,149.3Kb mem used] [16s (+16)]
[create sitemap in text format] part #2 [2,149.2Kb mem used] [16s (+0)]
[create sitemap file] filename: sitemap_2.xml.gz, number of urls: 20000 [2,149.2Kb mem used] [29s (+13)]
[create sitemap in text format] part #3 [2,149.2Kb mem used] [29s (+0)]
[create sitemap file] filename: sitemap_3.xml.gz, number of urls: 20000 [2,150.7Kb mem used] [39s (+10)]
[create sitemap in text format] part #4 [2,150.6Kb mem used] [39s (+0)]
[create sitemap file] filename: sitemap_4.xml.gz, number of urls: 20000 [2,159.6Kb mem used] [51s (+13)]
[create sitemap in text format] part #5 [2,159.5Kb mem used] [51s (+0)]
[create sitemap file] filename: sitemap_5.xml.gz, number of urls: 20000 [2,160.5Kb mem used] [62s (+11)]
[create sitemap in text format] part #6 [2,160.4Kb mem used] [62s (+0)]
[create sitemap file] filename: sitemap_6.xml.gz, number of urls: 20000 [2,161.0Kb mem used] [73s (+11)]
[create sitemap in text format] part #7 [2,160.9Kb mem used] [73s (+0)]
There seems to have been a problem with the BakerMedia Community database.
Please try again by clicking the Refresh button in your web browser.
An E-Mail has been dispatched to our Technical Staff, whom you can also contact if the problem persists.
We apologise for any inconvenience.
errors every time at part #7
any idea what that is?
thank you for all of your help!!
iojam
02-09-2006, 08:28 PM
mikeB,
An E-Mail has been dispatched to our Technical Staff, whom you can also contact if the problem persists.
Please check this email for the details, including the query that leads to a problem.
mikeB
02-09-2006, 09:57 PM
mikeB,
Please check this email for the details, including the query that leads to a problem.
Database error in vBulletin 3.5.3:
Invalid SQL:
SELECT p.dateline,p.postid,p.threadid
FROM post AS p
WHERE p.threadid = 16161
ORDER BY p.dateline;
I deleted this renegade thread and now it was able to finish! phewww thank you for helpng me get this bulit!
please forgive my inexperience, now what do I do?
iojam
02-09-2006, 10:03 PM
Great! :)
vBSEO Sitemap Generator will ping google with your sitemap URL if you have "Google Notify" option enabled, but you can add your sitemaps to your google webmaster account to track their stats.
And check "Sitemap Downloads Log" in vbseo_sitemap/ interface after that to make sure they are downloaded.
mikeB
02-09-2006, 10:09 PM
Great! :)
vBSEO Sitemap Generator will ping google with your sitemap URL if you have "Google Notify" option enabled, but you can add your sitemaps to your google webmaster account to track their stats.
And check "Sitemap Downloads Log" in vbseo_sitemap/ interface after that to make sure they are downloaded.
does this look normal?
http://www.bakermedia.com/blog/uploads/mikeb_dl.jpg
so I don't need to do anything aside from just let this be? there's 750,000 urls ... is that normal? seems like a lot and Yahoo and Google will just "know" its there?
thank you for your help!!
iojam
02-09-2006, 10:21 PM
You will see "googlebot" in the "Bot" column when sitemap is downloaded by google. These entries are most likely the ones downloaded by yourself :)
Justr submit your sitemap URLs to google webmaster account and you will see their entries after some time.
mikeB
02-09-2006, 10:25 PM
ok one last question.. what ARE the url's to submit?
iojam
02-09-2006, 10:29 PM
They're displayed on the sitemap report details page.
Basically:
http://yourforumsroot/sitemap_index.xml.gz
http://yourforumsroot/sitemap_1.xml.gz
http://yourforumsroot/sitemap_2.xml.gz
etc, depending on the number of sitemap files created.
mikeB
02-09-2006, 10:31 PM
They're displayed on the sitemap report details page.
Basically:
http://yourforumsroot/sitemap_index.xml.gz
http://yourforumsroot/sitemap_1.xml.gz
http://yourforumsroot/sitemap_2.xml.gz
etc, depending on the number of sitemap files created.
so if I submit the index, the rest will get picked up automatically? (I have 38 files)
iojam
02-09-2006, 10:39 PM
According to google sitemaps protocol, yes. But individual sitemaps will be download faster if you will submit them too.
GamerJunk.net
02-09-2006, 10:49 PM
This is really great, so if I have a google sitemaps account already do I need to modify anything about it?
iojam
02-09-2006, 11:20 PM
RasMasta,
Google Webmaster Account info should not be modified. You only need to add your sitemap URLs in it.
More info: https://www.google.com/webmasters/sitemaps/docs/en/submit.html
GamerJunk.net
02-10-2006, 03:24 PM
Now when I log into my account, I had a sitemap.xml file in my forums before this hack, and now in google sitemap it says there was an error downloading my stemap for my forums the sitemap.xml was not found.
mikeB
02-10-2006, 04:08 PM
all of my files have been taken down by google.. how long does it ususally take to start spidering?
also, is robots.txt necessary? or any other meta tages that can help this along?
iojam
02-13-2006, 02:08 PM
RasMasta,
please explain the problem in more details.
mikeB,
all of my files have been taken down by google.. how long does it ususally take to start spidering?
it depends on the google. Please also check this for more info: https://www.google.com/webmasters/sitemaps/docs/en/faq.html
bashy
02-13-2006, 08:18 PM
Hi peeps
I have had this running for quite sometime now....
I have only just noticed that its no longer generating the sitemap
Well as far as i know it aint, its no longer producing the email to say
it has done it?
Any ideas as to what may have caused this to stop....
I have not done anything to this hack...No settings have been changed
The plugins are all active still
Yes the hack is turned on :)
Please advise?
EDIT:
I have just upgraded to 1.6 (only had 1.5) although this would not have stopped it working, but i have done it anyway...I must have blinked when the Update email came out :o
I will let ya know tomoz if its working again as its meant to do it about 2 am and i will hopefully be dreaming then lol
Damn...perhaps clicking install helps with updates :o
Sorry i had not realised i hadnt done so....Anyway, i have now :)
I installed this on my test box and it worked fine. I installed on my live server for one site and it doesn't work.
I get this error
[13-Feb-2006 21:53:39] PHP Fatal error: Call to undefined function vbseo_get_last_tpl_update() in C:\Inetpub\ms-os.com\vbseo_sitemap\vbseo_sitemap.php on line 60
and then it spits out the raw php.
This is on Windows and IIS with php 5.1.1. The test box is identical as the live server.
Benedict
02-14-2006, 02:50 PM
Do I need vBSEO to run this mod?
I've searched for vBSEO btw but cant find the software. :o
bashy
02-14-2006, 03:42 PM
Right ok back to my previous post....this is no longer working, It is not sending an email for 1 to let me know that its done the biz....
Please advise?
jluerken
02-15-2006, 07:02 AM
Do I need vBSEO to run this mod?
I've searched for vBSEO btw but cant find the software. :o
www.vbseo.com
jluerken
02-15-2006, 07:03 AM
I've checked the "Show Sitemap Downloads Log" but it seems that the logs are not downloaded cause there is no entry listed.
How long will it normally take before bots pass by to download those lists?
iojam
02-15-2006, 12:27 PM
AWS,
could you please PM me your URL so that I can take a look?
Benedict
Do I need vBSEO to run this mod?
I've searched for vBSEO btw but cant find the software. You can find vBSEO at vbseo.com, although it is not required to run vBSEO Sitemap Generator.
bashy,
do you receive an email if you generate the sitemap manually from vbseo_sitemap/ interface (not scheduled execution).
jluerken
basically, it should be downloaded immediately after submission. Have you posted your sitemap at Yahoo sitemap submit page and do you have "Google notify" option enabled? With Google, you can also manually submit your sitemaps to the google webmaster account.
jluerken
02-15-2006, 12:59 PM
jluerken
basically, it should be downloaded immediately after submission. Have you posted your sitemap at Yahoo sitemap submit page and do you have "Google notify" option enabled? With Google, you can also manually submit your sitemaps to the google webmaster account.
Yes I have done this but
Show Sitemap Downloads Log
and
Show SE Bots Activity Log
are still empty.
I have no idea what I could have done wrong. Please assist.
cgchris99
02-15-2006, 03:18 PM
Any limit to the number of records in the sitemap?
when I do a google site:mydomain.com/forums it only shows 200 records. We have over 3000+ posts and over 1000 members. Sitemap has only been running for about 10 days though.
With my added urls the Sitemap Downloads Log report shows 18000 records.
Thanks for any advice
bruss
02-15-2006, 04:28 PM
Yes I have done this but
Show Sitemap Downloads Log
and
Show SE Bots Activity Log
are still empty.
I have no idea what I could have done wrong. Please assist.
I had the same problem... I fixed it by looking at (actually looking for)my .htaccess file at root... for some reason it didnt get uploaded :confused: now i am tracking the downloads
bashy
02-15-2006, 04:35 PM
bashy,
do you receive an email if you generate the sitemap manually from vbseo_sitemap/ interface (not scheduled execution).
No i dont....not anymore
Well it looks like the problem is with my install of vbulletin. I have this running on a couple other sites and it runs just fine. I'm going to see if I can track the problem and if I can't I'll PM you the url.
Found the problem.
On my server I have short_open_tag = Off in php.ini. I have it off so I don't get lazy by using them. It also makes it easy for me to find blocks of php code in files.
I modified the scripts so that <?php is used instead of <?.
Works fine now.
vBulletin version 3.0.8
when i execute the "Run Sitemap Generator"
all i get is a blank page and no output in the data folder.
I have vbseo running as well....
Any ideas as to what the issue could be?
iojam
02-15-2006, 07:26 PM
cgchris99
[/QUOTE]Any limit to the number of records in the sitemap?
when I do a google site:mydomain.com/forums it only shows 200 records. We have over 3000+ posts and over 1000 members. Sitemap has only been running for about 10 days though.[QUOTE]The maximum number of URLS per sitemap file is 50,000 (multiple files are created if you have more URLs). However, the number of *indexed* pages in google is not related directly to number of URLs in sitemap. *Ideally*, they will be the same, but it depends on google only :)
bashy
is generation completed successfully though?
AWS
ah, ok. Yes, we are aware of this and we've fixed this problem (it will work with vBSEO Sitemap Generator v1.7)
iojam
02-15-2006, 07:42 PM
TSR
have you tried to setup a cron job for Sitemap Generator and check if it works correctly?
TSR
have you tried to setup a cron job for Sitemap Generator and check if it works correctly?
Just through the task manager in admincp.
but still, no output after two hours... :ermm:
* 2 * * * vBSEO - Create Google/Yahoo Sitemap 02-16-2006 08:00 AM
i'll report back in the a.m. i did try running it from there via RUN NOW function but get
vBSEO - Create Google/Yahoo Sitemap
Cannot run sitemap generator directly: you should set "Run from vB Scheduled Tasks Manager ONLY" to "No" in admincp to allow this.
Ive modified the file, and if i direct access it the output is blank. Anyways, ill report back in the am of my findings.
TSR
As of this morning, still no site maps were generated. So it appears when it ran the Sched. Task it didnt work as well.
iojam
02-16-2006, 04:39 PM
TSR,
PM sent
Scheduled task via vbulletin or via task scheduler in Windows doesn't work. I have to manually run the tasks for it to generate the maps.
T3MEDIA
02-17-2006, 02:28 PM
This is just not working I still get a white screen.
my htaccess
Options +FollowSymLinks
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml\.gz|txt))$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteBase /
RewriteCond %{REQUEST_FILENAME} -f [OR]
RewriteCond %{REQUEST_FILENAME} -d
RewriteCond %{HTTP_HOST} ^members.mysite.com$
RewriteRule ^$ http://www.mysite.com/forums/index.php (http://www.sprnch.com/forums/vbindex.php)
RewriteRule (^[-_A-Za-z0-9\ ]*$) http://www.mysite.com/forums/member.php?&username=$1 [nc]
RewriteRule (^[-_0-9\ ]*$) http://www.mysite.com/forums/member.php?userid=$1 [nc]
iojam
02-17-2006, 09:03 PM
AWS,
have you tried to enable Log in vB Scheduler and see what it has logged?
T3MEDIA
This is just not working I still get a white screen.
when do you get a white screen - when trying to open your sitemap file?
AWS,
have you tried to enable Log in vB Scheduler and see what it has logged?
T3MEDIA
when do you get a white screen - when trying to open your sitemap file?
Yes. I get Started repeated many times. Alsmost as if the script starts and stops until it finally dies. I run it manually I have no problem andin task log after run is has the completed message. Here is an excert from the log:
2147 SiteMap 06:01, 17th Feb 2006 Google Sitemap [Started]
2146 SiteMap 05:54, 17th Feb 2006 Google Sitemap [Started]
2145 SiteMap 05:49, 17th Feb 2006 Google Sitemap [Started]
2144 SiteMap 05:48, 17th Feb 2006 Google Sitemap [Started]
2143 SiteMap 05:47, 17th Feb 2006 Google Sitemap [Started]
2142 SiteMap 05:44, 17th Feb 2006 Google Sitemap [Started]
2141 SiteMap 05:42, 17th Feb 2006 Google Sitemap [Started]
2140 SiteMap 05:41, 17th Feb 2006 Google Sitemap [Started]
2139 SiteMap 05:40, 17th Feb 2006 Google Sitemap [Started]
2138 SiteMap 05:39, 17th Feb 2006 Google Sitemap [Started]
2137 SiteMap 05:38, 17th Feb 2006 Google Sitemap [Started]
2136 SiteMap 05:33, 17th Feb 2006 Google Sitemap [Started]
2135 SiteMap 05:29, 17th Feb 2006 Google Sitemap [Started]
This repeats itself at the time it is set to start every morning and sitemap is never generated.
ConqSoft
02-18-2006, 02:40 AM
It looks like you have the job set to run every minute. Do you have a * for the minute?
It looks like you have the job set to run every minute. Do you have a * for the minute?
Day of the Week *
Day of the Month *
Hour 5
Minute *
It looks like it starts, stops and then starts again multiple times. When I run via Windows task Manager it never completes and I have no way of knowing what is happening when it runs. It will run if I start the task manually.
cellarius
02-18-2006, 07:52 AM
Hi,
I don't succeed in downloading my sitemaps (if I click the links to the files at Sitemap Reports -> 404) and neither Google Sitemaps nor Yahoo are able to find them. I double- and tripkechecked the following
- dir "data" chmod 777 (definitely)
- .htaccess at http://www.mydomain.de/forum/, at the moment containing only the 2 lines provided for this:
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
- yes, mod_rewrite does work on my server, and there are no conflicts with .htaccess at root level (only permanent redirs of obsolete pages there)
- sitemaps are generated and right there to see and download via ftp, and if I point Google Sitemaps to the full path -> Success.
- anyway: http://www.mydomain.de/forum/vbsesitemap.txt.gz (or sitemap_index.xml.gz) returns a 404
What might be the issue? Don't know where to look anymore.
Thanks for your help
Sven
iojam
02-18-2006, 08:36 AM
AWS,
you should have "0" (or other number) for the minutes. "*" means to start the task EVERY minute.
cellarius,
Please try to add the following after "RewriteEngine on" line:
RewriteBase /forum/
bashy
02-18-2006, 08:44 AM
Hi
Yes this is correct...
I have just remembered that i upgraded to vb 3.5.3 and i dont think its
worked since then.... :o
bashy
is generation completed successfully though?
iojam
02-18-2006, 03:18 PM
bashy,
please check that you have correct email address specified in vBSEO Sitemap Generator options for notifications.
bashy
02-18-2006, 03:31 PM
Yip thats correct m8...its the same addy that its always been even when it used to work :)
bashy,
please check that you have correct email address specified in vBSEO Sitemap Generator options for notifications.
hello...any one can say ,
its generation sitemap in .gz format we are unzipping it & placing it in root folder
now--
how to realize that "this site map is working properly & google is readind it & there is no problem in it?
& if we use any url re-writer (like vRewriter) & it re-write the the url to .html
but this sitemap generator create sitemap on .php
plz some one clearly tell me... there any conflict if this Sitemap generator & re-writer togetherly installed?
Thnkx
cellarius
02-19-2006, 01:07 PM
cellarius,
Please try to add the following after "RewriteEngine on" line:
:nervous: So simple... Really should have thought of this myself. Anyway, works perfectly now, thank you!
Sven
iojam
02-19-2006, 06:42 PM
bashy,
PM sent
Zia,
how to realize that "this site map is working properly & google is readind it & there is no problem in it?You will see in " Sitemap Downloads Log" if it works correctly.
plz some one clearly tell me... there any conflict if this Sitemap generator & re-writer togetherly installed?vBSEO Sitemap Generator can only include either original vBulletin URLs or vBSEO URLs.
cellarius
Excellent :)
bashy
02-19-2006, 07:03 PM
Oh dear oh dear oh dear......
Me is really stupid.....
after your last PM lojam, i checked my junk mail in the hotmail account
i dont need to say anymore do i....
I am really sorry, I didnt even think to check that :o
Thanks again for your help!!
iojam
02-19-2006, 07:09 PM
bashy,
no problem, I'm glad we sorted this out :)
bashy
02-19-2006, 07:11 PM
Cheers again...me feels like a plank now lol...
You will see in " Sitemap Downloads Log" if it works correctly.
vBSEO Sitemap Generator can only include either original vBulletin URLs or vBSEO URLs.
hmm that means it does'nt include the urls re-written by any free url-rewriter(found in vb.org) ?
that means install a url-rewiter is meaning less with this(this thread's) sitemap generator? But no conflicts at all ?
do we need to put a button on homepage/everypage that will linked to
www.site.com/sitemap.xml or www.site.com/sitemap.xml.gz
no offence.. buildtolearn.com they did similar thing(so im asking) they put an xml button on navbar that linked to there sitemap.xml.gz
maybe its a fools qustion..but to learn thins thing im agreed to be fool :disappointed:
thankx in advance.
bruss
02-20-2006, 02:18 PM
I have installed and everything looks good... However when i look at my stats i am only see the google bot crawl the index. Not the forums.. Any thoughts?
trigon
02-20-2006, 02:54 PM
Hi,
I don't succeed in downloading my sitemaps (if I click the links to the files at Sitemap Reports -> 404) and neither Google Sitemaps nor Yahoo are able to find them. I double- and tripkechecked the following
- dir "data" chmod 777 (definitely)
- .htaccess at http://www.mydomain.de/forum/, at the moment containing only the 2 lines provided for this:
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
- yes, mod_rewrite does work on my server, and there are no conflicts with .htaccess at root level (only permanent redirs of obsolete pages there)
- sitemaps are generated and right there to see and download via ftp, and if I point Google Sitemaps to the full path -> Success.
- anyway: http://www.mydomain.de/forum/vbsesitemap.txt.gz (or sitemap_index.xml.gz) returns a 404
What might be the issue? Don't know where to look anymore.
Thanks for your help
Sven
cellarius,
Please try to add the following after "RewriteEngine on" line:
Quote:
RewriteBase /forum/
Tried the same, but by me no go.
Have the same problem, sitemap was created succesfully, also the cronjob works good, but the side is not in the /forum/ folder, its in the /forum/vbseo_sitemap/data/ folder.
Also google cant find it.
bruss
02-20-2006, 05:37 PM
I have installed and everything looks good... However when i look at my stats i am only see the google bot crawl the index. Not the forums.. Any thoughts?
I had the vbSEO Installed option checked in ACP.... OOPS.. What would the result of this be?
I have deleted my sitemaps changed it ran the generator again. Once i had new sitemaps with this configured right i re-subbmitted my sitemaps. I guess i just have to wait and see if i get spidered on more than my index.
lawahdy
02-20-2006, 06:40 PM
hey there guys..
i'm currently using this htaccess file
RewriteEngine On
RewriteRule ^$ index.php
RewriteRule ^f([0-9]+)-([A-Za-z0-9\-]+)\.html$ forumdisplay.php?f=$1 [L]
RewriteRule ^u-(.*)-(.*).html member.php?u=$2 [L]
RewriteRule ^t([0-9]+)(((-p)([0-9]+))?)([A-Za-z0-9\-]+)\.html$ showthread.php?t=$1&page=$5&pp=10 [L]
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteRule (^[-_A-Za-z\ ]*$) member.php?username=$1 [L]
RewriteRule (^[-_0-9\ ]*$) member.php?userid=$1 [L]
and it is working fine with me..
now i have a modified htaccess that covers more areas in vb.. but when i install it .. nothing works.. they same old html extentions and names but it is not linking to them.. i'm using vbseo 1.6
RewriteEngine On
RewriteRule ^(.*)/t-(.*)-(.*)/go=(.*) showthread.php?t=$3&goto=$4&is_vrewrite=yes[L]
RewriteRule ^(.*)/p-(.*)-(.*).html showthread.php?p=$3&is_vrewrite=yes[L]
RewriteRule ^f-(.*)-(.*)-page(.*).html forumdisplay.php?f=$2&page=$3&order=desc&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html/page(.*)daysprune(.*)-order(.*)-sort(.*) forumdisplay.php?f=$2&page=$3daysprune=$4&order=$5&sort=$6&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html/daysprune(.*)-order(.*)-sort(.*) forumdisplay.php?f=$2&daysprune=$3&order=$4&sort=$5&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html forumdisplay.php?f=$2&is_vrewrite=yes [L]
RewriteRule ^u-(.*)-(.*).html member.php?u=$2&is_vrewrite=yes [L]
RewriteRule ^(.*)-(.*)-newpost.html showthread.php?goto=newpost&t=$2 [L]
RewriteRule ^(.*)/t-(.*)-(.*)-page(.*).html showthread.php?t=$3&page=$4&is_vrewrite=yes [L]
RewriteRule ^(.*)/t-(.*)-(.*).html showthread.php?t=$3&is_vrewrite=yes [L]
RewriteRule ^markread.html forumdisplay.php?do=markread [L]
RewriteRule ^(.*)/p-(.*)-(.*).html#(.*) showthread.php?p=$3#post$4 [L]
RewriteRule ^print-(.*)-(.*).html printthread.php?t=$2 [L]
RewriteRule ^sendtofriend-(.*)-(.*).html sendmessage.php?do=sendtofriend&t=$2 [L]
RewriteRule ^search-(.*).html search.php?do=$1 [L]
RewriteRule ^(.*)-(.*)/newthread.php newthread.php?do=newthread&f=$2[L]
RewriteRule ^(.*)/newpostnoquote-(.*).php newreply.php?do=newreply&noquote=1&p=$2[L]
RewriteRule ^(.*)/newpost-(.*).php newreply.php?do=newreply&p=$2[L]
RewriteRule ^p-(.*).html showpost.php?p=$1&postcount=$1 [L]
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
do you have an idea of what would be going wrong.>?
bruss
02-20-2006, 08:57 PM
hey there guys..
i'm currently using this htaccess file
RewriteEngine On
RewriteRule ^$ index.php
RewriteRule ^f([0-9]+)-([A-Za-z0-9\-]+)\.html$ forumdisplay.php?f=$1 [L]
RewriteRule ^u-(.*)-(.*).html member.php?u=$2 [L]
RewriteRule ^t([0-9]+)(((-p)([0-9]+))?)([A-Za-z0-9\-]+)\.html$ showthread.php?t=$1&page=$5&pp=10 [L]
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteRule (^[-_A-Za-z\ ]*$) member.php?username=$1 [L]
RewriteRule (^[-_0-9\ ]*$) member.php?userid=$1 [L]
and it is working fine with me..
now i have a modified htaccess that covers more areas in vb.. but when i install it .. nothing works.. they same old html extentions and names but it is not linking to them.. i'm using vbseo 1.6
RewriteEngine On
RewriteRule ^(.*)/t-(.*)-(.*)/go=(.*) showthread.php?t=$3&goto=$4&is_vrewrite=yes[L]
RewriteRule ^(.*)/p-(.*)-(.*).html showthread.php?p=$3&is_vrewrite=yes[L]
RewriteRule ^f-(.*)-(.*)-page(.*).html forumdisplay.php?f=$2&page=$3&order=desc&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html/page(.*)daysprune(.*)-order(.*)-sort(.*) forumdisplay.php?f=$2&page=$3daysprune=$4&order=$5&sort=$6&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html/daysprune(.*)-order(.*)-sort(.*) forumdisplay.php?f=$2&daysprune=$3&order=$4&sort=$5&is_vrewrite=yes [L]
RewriteRule ^f-(.*)-(.*).html forumdisplay.php?f=$2&is_vrewrite=yes [L]
RewriteRule ^u-(.*)-(.*).html member.php?u=$2&is_vrewrite=yes [L]
RewriteRule ^(.*)-(.*)-newpost.html showthread.php?goto=newpost&t=$2 [L]
RewriteRule ^(.*)/t-(.*)-(.*)-page(.*).html showthread.php?t=$3&page=$4&is_vrewrite=yes [L]
RewriteRule ^(.*)/t-(.*)-(.*).html showthread.php?t=$3&is_vrewrite=yes [L]
RewriteRule ^markread.html forumdisplay.php?do=markread [L]
RewriteRule ^(.*)/p-(.*)-(.*).html#(.*) showthread.php?p=$3#post$4 [L]
RewriteRule ^print-(.*)-(.*).html printthread.php?t=$2 [L]
RewriteRule ^sendtofriend-(.*)-(.*).html sendmessage.php?do=sendtofriend&t=$2 [L]
RewriteRule ^search-(.*).html search.php?do=$1 [L]
RewriteRule ^(.*)-(.*)/newthread.php newthread.php?do=newthread&f=$2[L]
RewriteRule ^(.*)/newpostnoquote-(.*).php newreply.php?do=newreply&noquote=1&p=$2[L]
RewriteRule ^(.*)/newpost-(.*).php newreply.php?do=newreply&p=$2[L]
RewriteRule ^p-(.*).html showpost.php?p=$1&postcount=$1 [L]
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
do you have an idea of what would be going wrong.>?
Do i need all this stuff in my .htaccess file?
iojam
02-21-2006, 06:26 AM
Zia,
hmm that means it does'nt include the urls re-written by any free url-rewriter(found in vb.org) ?
Yes, that is correct.
do we need to put a button on homepage/everypage that will linked to
www.site.com/sitemap.xml or www.site.com/sitemap.xml.gz This is not required - you are informing the search engines about your sitemap location directly instead.
trigon,
although sitemap files are physically located in vbseo_sitemap/data/ folder, you should link to them as http://yourforumsroot/sitemap_index.xml.gz etc (it is achieved by using mod_rewrite rules in .htaccess)
bruss
I have installed and everything looks good... However when i look at my stats i am only see the google bot crawl the index. Not the forums.. Any thoughts?You may want to manually submit your individual sitemap files to Google webmaster account if you have only index file downloaded by the SE bots.
lawahdy,
now i have a modified htaccess that covers more areas in vb.. but when i install it .. nothing works.. they same old html extentions and names but it is not linking to them.. i'm using vbseo 1.6
Do you mean that sitemap files are not opened correctly for you? If so, you can try to move "(sitemap.*\.(xml|txt)..." line to the top of .htaccess (right *after* "RewriteEngine on" line)
bruss
02-21-2006, 03:11 PM
I am finally getting indexed it seems.. My problem was i had the vbSEO option enabled and i dont have vbSEO... lol
cgchris99
02-22-2006, 01:49 AM
bruss, how long did it take for the index to start appearing after you turned of the vbSEO option? I just noticed I had the same thing.
T3MEDIA
02-22-2006, 03:17 AM
AWS,
have you tried to enable Log in vB Scheduler and see what it has logged?
T3MEDIA
when do you get a white screen - when trying to open your sitemap file?When I run the software to make the sitemap. Never makes it page goes white. 3.0.x board. however the older version before this worked.
trigon
02-22-2006, 03:06 PM
trigon,
although sitemap files are physically located in vbseo_sitemap/data/ folder, you should link to them as http://yourforumsroot/sitemap_index.xml.gz etc (it is achieved by using mod_rewrite rules in .htaccess)
how can i made the change in .htaccess? Sorry but i dont get the point what to do. :nervous:
how can i made the change in .htaccess? Sorry but i dont get the point what to do. :nervous:
Just an update. It is working fine for me now.
One suggestion is you should use <?php instead of short tags. An out of the box install of php has short tags off by default and it is advised to keep them off for portabilty across other systems.
bruss
02-22-2006, 05:08 PM
bruss, how long did it take for the index to start appearing after you turned of the vbSEO option? I just noticed I had the same thing.
I noticed a few more stats on my google sitemap stats in google sitemap site. I also run a spider watcher and started seeing the google bot going to different parts of my site instead of just the index..
EFairy
02-22-2006, 07:37 PM
EDIT: Never mind. :)
rinkrat
02-23-2006, 12:55 AM
My sitemaps are being generated in my /bbs/ subdirectory which is where my vbulletin is BUT Google wants it in the root directorn of the site. How should I handle this?
Thanks
mz
SouthernTn
02-23-2006, 07:46 AM
nm.. figured it all out :rolleyes: , clicking install
bruss
02-23-2006, 01:20 PM
Im am still curious as to if I am being indexed properly
I still see http://example.com/showpost.php?p=820&postcount=12 showing up as a sample of denied urls from google. Is anyone else seeing this?
Timan
02-23-2006, 01:30 PM
What is the news on this working with the latest updated of vB 3.5.4?
iojam
02-23-2006, 01:41 PM
T3MEDIA,
PM sent
trigon,
as described in installation instructions,
C. Open your 'vbroot/.htaccess' file and enter the following code:
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
AWS,
great :)
(this problem will be fixed with v 1.7)
rinkrat,
it is not required to put sitemap into the root folder - as far as it contains only URLs starting with "/bbs/", it's ok to put it in bbs/ folder.
trigon
02-23-2006, 03:46 PM
trigon,
as described in installation instructions,
:
C. Open your 'vbroot/.htaccess' file and enter the following code:
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
i put it in: here you can see my htaccess:
RewriteEngine On
RewriteBase /forum/
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
Btw: put it in /public_html/.htaccess, is that right?
iojam
02-24-2006, 10:14 AM
bruss,
most likely you had a temporary problems with your site at the time when google bot has attempted to retrieve these pages.
Timan,
there are no known issues related to a new version of vB with vBSEO Sitemap Generator
trigon,
this should be in /public_html/forum/.htaccess
trigon
02-25-2006, 02:29 AM
trigon,
this should be in /public_html/forum/.htaccess
ok, delete this:
RewriteBase /forum/
and my htaccess is in /public_html, but no go. :disappointed:
DefenceTalk
02-25-2006, 04:10 AM
With this mod installed, shouldn't the number of indexed pages INCREASE in google search? Ours dropped from 39,000+ to 600s since the mod was installed.... I am looking at this very closely and if it does not improve, the mod will have to come down.
iojam
02-25-2006, 03:35 PM
trigon,
and my htaccess is in /public_html, but no go.
.htaccess should be in forums root (/public_html/forum/)
DefenceTalk,
With this mod installed, shouldn't the number of indexed pages INCREASE in google search?
you can find the detailed info on Google Sitemaps here: http://www.google.com/webmasters/sitemaps/docs/en/faq.html
jluerken
02-25-2006, 04:04 PM
The sitemap system is working fine with vbSEO 2.4.0 but on the SE Bots Activity Log Page the SHOW POST column is always empty.
Whats wrong there?
DefenceTalk
02-25-2006, 05:20 PM
Iojam,
I know about that page but it doesn't answer the question which i asked. We've installed this on three boards and the number of pages INDEXED have dropped from thousands to hundreds.
Results 1 - 10 of about 701 from domain.com/forums/ for
which use to be:
Results 1 - 10 of about 39,000+ from domain.com/forums/ for
This has happened across the board on all three websites.
R34GTT
02-25-2006, 05:52 PM
Hi,
I have installed this hack. After the task has been run, I get a report with this info in it.
Database error in vBulletin 3.5.2:
Invalid SQL:
SELECT * FROM adv_setting;
MySQL Error : Table 'soc-forum.adv_setting' doesn't exist Error Number : 1146
Date : Saturday, February 25th 2006 @ 03:33:18 AM
Script : http://www.skyline-owners-club.com/forums/cron.php?&rand=76530
Referrer : http://www.skyline-owners-club.com/forums/index.php
IP Address : 88.104.216.87
Username :
Classname :
Also, when looking in the /index.php file and login in. there is no info under any of the headings. (Its run twice now)
Any help would be good.
Thanks
bugman
02-26-2006, 11:05 AM
It gives me concern to install this if less pages are being indexed. What's up with that !?
iojam
02-26-2006, 12:00 PM
jluerken,
is this column empty for a long time already? Are other page types non-empty?
DefenceTalk,
sitemap protocol has no commands to remove pages from the index, so it can't force the number of indexed pages to drop.
There are, however, other factors (not related to sitemap) that may cause this (these changes may be related to a google update).
You can also add your sitemap files URLs to the google webmaster account to check if there is a parse error.
R34GTT,
make sure that yo have no vbseo_sm_vba.php in the vB AdminCP->vBSEO Sitemap generator Options->Addons List if you don't have vBadvanced installed.
R34GTT
02-26-2006, 03:36 PM
R34GTT,
make sure that yo have no vbseo_sm_vba.php in the vB AdminCP->vBSEO Sitemap generator Options->Addons List if you don't have vBadvanced installed.
Thanks, I will try that.
khaleel
02-26-2006, 05:42 PM
Really good mod, good idea, and fantastic mod, thankyou
PING1434a
02-28-2006, 03:10 AM
Hmm, When i try to run the sitemap generator, it gives me 500 Internal Server Error :ermm: am I missing something from my php build? It dosn't give me any other error.
I'm on vb3.0.8
PHP Version 4.4.0
Apache/1.3.31 (Unix) DAV/1.0.3 mod_fastcgi/2.4.2 mod_gzip/1.3.26.1a PHP/4.3.10 mod_ssl/2.8.19 OpenSSL/0.9.6c
I followed the instructions, and I have the configuration:
// vBSEO Installed?
'vbseo_sm_vbseo' => '',
// Run from vB Scheduled Tasks Manager ONLY
'vbseo_sm_crononly' => '',
should it be this?
// vBSEO Installed?
'vbseo_sm_vbseo' => '0',
// Run from vB Scheduled Tasks Manager ONLY
'vbseo_sm_crononly' => '0',
actually tried both, but still no go :ermm:
The CHMOD 777 to the datafolder has been done, heck i tried even chmod 777 the entire vbseo_sitemap folder.
esology
02-28-2006, 11:04 PM
I have my vBulletin site since March 2005 and right away had used this sitemap hack. At one time I had search results in the high 2,xxx but ever since I have installed vBSEO it has been rapidly decreasing. Last Friday I did a search for "stockhideout" and it was pulling 397 today I have been checking and it is 333. That is a huge drop and the only thing I have changed (besides vB upgrades) is vBSEO.
Any thoughts?
BTW, when I log into Google it says my sitemap is fine and my Yahoo numbers have been growing.
bangthebook
03-01-2006, 01:36 AM
Does the extra Url text file have to be submitted seperatley? or does it get called in the generated file?
Thanks
Ryan
firstrebel
03-01-2006, 03:08 PM
I have my vBulletin site since March 2005 and right away had used this sitemap hack. At one time I had search results in the high 2,xxx but ever since I have installed vBSEO it has been rapidly decreasing. Last Friday I did a search for "stockhideout" and it was pulling 397 today I have been checking and it is 333. That is a huge drop and the only thing I have changed (besides vB upgrades) is vBSEO.
Any thoughts?
BTW, when I log into Google it says my sitemap is fine and my Yahoo numbers have been growing.
Our site dropped for a while from ~200,000 to around 22,000 but is now back up. Maybe it's the way Google works during reindexing.
Bob
T3MEDIA
03-01-2006, 05:57 PM
hey there guys..
i'm currently using this htaccess file
RewriteEngine On
RewriteRule ^$ index.php
RewriteRule ^f([0-9]+)-([A-Za-z0-9\-]+)\.html$ forumdisplay.php?f=$1 [L]
RewriteRule ^u-(.*)-(.*).html member.php?u=$2 [L]
RewriteRule ^t([0-9]+)(((-p)([0-9]+))?)([A-Za-z0-9\-]+)\.html$ showthread.php?t=$1&page=$5&pp=10 [L]
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteRule (^[-_A-Za-z\ ]*$) member.php?username=$1 [L]
RewriteRule (^[-_0-9\ ]*$) member.php?userid=$1 [L]
and it is working fine with me..
Hi you seem to know what your doing with .htaccess... how do you do exactly what you have here but for http://members.yoursilte.com/username?
Thanks. (with out loosing the seo commands.) also I want it so it does not effect users who which to change thier passwords. some htaccess commands force everything to member.php which I dont want.
forumthemes
03-01-2006, 06:04 PM
All i can say is.. thank you thank you thank you :)
iojam
03-02-2006, 01:43 AM
PING1434a,
please check your server's error log for more details on the error.
bangthebook,
the text sitemap file is generated to submit to Yahoo ( http://submit.search.yahoo.com/free/request )
Reeve of shinra
03-02-2006, 01:46 AM
Can the sitemap be incrementally updated? I have a large db and it seems that things ground to an almost halt when the cron is run.
(its a great hack btw!)
iojam
03-02-2006, 02:21 AM
Reeve of shinra,
the next version of Sitemap Generator (will be released soon) has a "resume generation" feature implemented.
xtreme-mobile
03-02-2006, 07:36 AM
slight problem with mine here
its working fine but it creates the sitemap 5 times in about 5 mins!!!
i get 5 emails in short succession saying its been updated
this would be classed as bad on googles behalf wouldnt it cos it keeps repeating itself?
any ideas?
agiacosa
03-02-2006, 10:07 AM
I'm getting the email that the sitemap was generated and sent to Google. I have it generated in /vbseo_sitemap/data/ but when I log into my webmaster account and try to submit it manually, I get an error from Google saying:
"We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit."
Any thoughts?
iojam
03-02-2006, 09:00 PM
xtreme-mobile,
please check your scheduled task settings - make sure that you DON'T have '*' for the minutes pulldown, because it means running it every minute.
agiacosa,
you should submit http://yourforumsroot/sitemap_index.xml.gz file , which is accessed using mod_rewrite rule (do not submit vbseo_sitemap/data/sitemap_index.xml.gz).
KW802
03-03-2006, 05:57 PM
A few things...
- The install instructions have the mod_rewrite going to sitemap.(txt|xml).(gz) but I could only get it to work by going to sitemap_index.(txt|xml).(gz), and iojam's thread above this one says to point to sitemap_index as well. Am I supposed to be seeing a "sitemap.xml.gz" file somewhere or are the instructions supposed to be saying "sitemap_index. ...."?
- In vbseo_sm_vba.php I had to change the value of $vba_url to be blank to get the vBa page links working correctly. If I left it at the default, and uncommented out the next line per the instructions, I was ending up with links like "http://www.coolscifi.com/forumshttp://www.coolscifi.com/index.php?page={pagename}". My guess is that it's because the script is assuming that vBadvanced CMPS URL is set to just "/index.php" but the user is actually instructed to place the full URL in that value but either the truncated version or the full URL works fine for most people.
- Also in vbseo_sm_vba.php, any chance of having the permissions of the page looked at instead of just the inactive flag? I have several pages on some of my sites that are active but are turned off to guests (for example, games & downloads that are only available to registered members) but right now the default script would pick up those pages anyway and submit them to Google/Yahoo only to get hit with a CMPS 'no permissions' error.
Thanks. :)
iojam
03-03-2006, 06:31 PM
Hello,
- The install instructions have the mod_rewrite going to sitemap.(txt|xml).(gz) but I could only get it to work by going to sitemap_index.(txt|xml).(gz), and iojam's thread above this one says to point to sitemap_index as well. Am I supposed to be seeing a "sitemap.xml.gz" file somewhere or are the instructions supposed to be saying "sitemap_index. ...."?
Rewrite rule to use is:
^(sitemap.*\.(xml|txt)(\.gz)?)$
and it matches sitemap_index.xml.gz, sitemap_1.xml.gz, sitemap_2.xml.gz etc. The files are stored in vbseo_sitemap/data/ folder, but are linked to forums root using this rewrite rule :)
Regarding other 2 points: sure, we'll adjust the vba add-on module code accordingly in the next vBSEO Sitemap Generator release.
Thank you for feedback! :)
Floris
03-03-2006, 06:37 PM
Installed on the omgboards.com network :) works great. tnx again!
KW802
03-03-2006, 06:55 PM
Rewrite rule to use is:
^(sitemap.*\.(xml|txt)(\.gz)?)$
and it matches sitemap_index.xml.gz, sitemap_1.xml.gz, sitemap_2.xml.gz etc. The files are stored in vbseo_sitemap/data/ folder, but are linked to forums root using this rewrite rule :)I just tried again... I really must step away from the keyboard after midnight. :p Uh, nevermind... I realize now, after much caffiene, what I was misreading last night.
Regarding other 2 points: sure, we'll adjust the vba add-on module code accordingly in the next vBSEO Sitemap Generator release.Cool.
Thanks! :banana:
BluSmurf
03-04-2006, 11:29 AM
I logged into http://www.example.com/forums/vbseo_sitemap/ without supplying any password, even tried on another PC and it didn't ask for password authentication, I'm using 3.5.4, any help?
ConqSoft
03-04-2006, 11:32 AM
Did you define a password in the AdminCP for the Sitemap Generator? (It's called "Run Code" I think.)
BeaLzeBuB
03-04-2006, 07:51 PM
hi
i am using 3.5.4
i intstalled generator but i have some problems
firstly, http://www.xxxxx.com/sitemap_index.xml.gz
is this my sitemap location? google couldn't find that
and when i looked at my ftp, i didn't see anything about sitemap (txt or smth else)
also is someting else needed for using this?
iojam
03-04-2006, 08:10 PM
BeaLzeBuB,
sitemap index file URL is http://yourforumsroot/sitemap_index.xml.gz
Please make sure that you've created .htaccess file in vB root folder as described in installation instructions (and check that your server has mod_rewrite support).
BluSmurf
03-04-2006, 09:09 PM
ahhh yes.. forgotten about that one.. silly me :p
BeaLzeBuB
03-05-2006, 01:00 AM
BeaLzeBuB,
sitemap index file URL is http://yourforumsroot/sitemap_index.xml.gz
Please make sure that you've created .htaccess file in vB root folder as described in installation instructions (and check that your server has mod_rewrite support).
thx its work
i have one more question
in sitemap file url's
<loc>http://www.xxxx.com/forum/forumdisplay.php?f=176</loc>
<priority>0.8</priority>
<lastmod>2006-03-05T00:25:08+00:00</lastmod>
<changefreq>daily</changefreq>
they are not html, like
<loc>http://www.xxxx.com/forum/anything_else.html</loc>
<priority>0.8</priority>
<lastmod>2006-03-05T00:25:08+00:00</lastmod>
<changefreq>daily</changefreq>
so, nobody search "forumdisplay.php?f=159", they search "anything else" ...
If i mistake sorry.. But i get confused :surprised:
Algren_San
03-05-2006, 08:41 AM
one question... mmm if i put the site map on google site map to track it (how many pages on google, querys ETC) i do not need to auto notify google with this plugin right? cuz it will make double content right? just that thanks
caliman
03-06-2006, 04:04 AM
I forgot my direct run code password so I can't login. Oops. How can I reset it?
ConqSoft
03-06-2006, 04:05 AM
In the AdminCP options for the sitemap generator.
ConqSoft
03-06-2006, 04:06 AM
thx its work
i have one more question
in sitemap file url's
<loc>http://www.xxxx.com/forum/forumdisplay.php?f=176</loc>
<priority>0.8</priority>
<lastmod>2006-03-05T00:25:08+00:00</lastmod>
<changefreq>daily</changefreq>
they are not html, like
<loc>http://www.xxxx.com/forum/anything_else.html</loc>
<priority>0.8</priority>
<lastmod>2006-03-05T00:25:08+00:00</lastmod>
<changefreq>daily</changefreq>
so, nobody search "forumdisplay.php?f=159", they search "anything else" ...
If i mistake sorry.. But i get confused :surprised:
Do you also own, and have installed, vBSEO? If not, then your URLs won't have the .html extension. If you do have vBSEO installed, make sure you change the Sitemap option to tell it so.
Algren_San
03-06-2006, 10:37 AM
i saw something here on sitemap_index.xml.gz i thing this could not harm but i should tell you about it:
<?xml version='1.0' encoding='UTF-8'?>
<sitemapindex xmlns="http://www.google.com/schemas/sitemap/0.84"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.google.com/schemas/sitemap/0.84
http://http://www.google.com/schemas/sitemap/0.84/siteindex.xsd">
<sitemap>http://forums.example.com/sitemap_1.xml.gz</sitemap>
</sitemapindex>
look at the BOLD text :) and you check it tell me if it is only me.
incurable
03-06-2006, 01:39 PM
Help !! i have the following error when i run the sitemap .
[forumdisplay] forum_id: 32, total threads: 3, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 31, total threads: 0, pages: 1 [0s (+0)]
[SECTION START] showthread [0s (+0)]
[archive homepage] [1s (+0)]
[SECTION START] forumdisplay archived [1s (+0)]
[SECTION START] member [1s (+0)]
Warning: gzopen(/home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Toegang geweigerd in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 412
Warning: gzopen(/home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/data/sitemap.txt.gz): failed to open stream: Toegang geweigerd in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 415
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 423
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
How can i fix it ? what's wrong ?
MANY MANY THANK YOU IN ADVANCE!!!!
tintin
BeaLzeBuB
03-06-2006, 01:44 PM
Do you also own, and have installed, vBSEO? If not, then your URLs won't have the .html extension. If you do have vBSEO installed, make sure you change the Sitemap option to tell it so.
ohh where i can get vBSEO ? is it on sale? :surprised:
EDIT : I saw, thx
Algren_San
03-06-2006, 08:56 PM
Help !! i have the following error when i run the sitemap .
[forumdisplay] forum_id: 32, total threads: 3, pages: 1 [0s (+0)]
[forumdisplay] forum_id: 31, total threads: 0, pages: 1 [0s (+0)]
[SECTION START] showthread [0s (+0)]
[archive homepage] [1s (+0)]
[SECTION START] forumdisplay archived [1s (+0)]
[SECTION START] member [1s (+0)]
Warning: gzopen(/home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Toegang geweigerd in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 412
Warning: gzopen(/home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/data/sitemap.txt.gz): failed to open stream: Toegang geweigerd in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 415
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 423
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 434
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/tintin/domains/belleclique.com/public_html/vbseo_sitemap/vbseo_sitemap_functions.php on line 437
How can i fix it ? what's wrong ?
MANY MANY THANK YOU IN ADVANCE!!!!
tintin
did you follow the readme file? what ver. of vbulletin are you using?
caliman
03-06-2006, 09:49 PM
In the AdminCP options for the sitemap generator.
Thanks Buddy.
caliman
03-06-2006, 09:52 PM
When I upgraded from 1.5 to 1.6, the map generation time nearly doubled, anyone else get this?
Sitemap Generator History
No Date Run Time Total URLs Change Google Notify Details
4 2006-03-02 03:00 24.66 s 66,308 +101 Yes View details | Remove record
5 2006-03-03 03:00 23.69 s 66,558 +250 Yes View details | Remove record
6 2006-03-04 03:02 22.71 s 66,667 +109 Yes View details | Remove record
7 2006-03-05 03:04 36.15 s 66,760 +93 Yes View details | Remove record
8 2006-03-06 03:00 38.26 s 66,951 +191 Yes View details | Remove record
incurable
03-06-2006, 11:26 PM
did you follow the readme file? what ver. of vbulletin are you using?
Yes i followed it .. And i'm using 3.5.4 :ermm:
Does Toegang whateveritis mean Access Denied?
Are the files in the /sitemap/ folder correctly chmodded?
jjj0923
03-07-2006, 07:52 PM
my problem with this is that I installed it over two weeks ago and although it generates fine every night and I've submitted everything to google - not a single visit yet from google and it does not send me a report like it's supposed to although my server is sending all other email just fine.
here's the path of my site to the file produced...
http://www.mysite.com/forums/vbseo_sitemap/data/sitemap_index.xml.gz
???
iojam
03-07-2006, 09:40 PM
Algren_San,
thank you for letting us know, we'll correct this in the next version :)
incurable,
make sure that permissions are set correctly for the data/ folder.
jjj0923,
you should submit http://www.mysite.com/forums/sitemap_index.xml.gz sitemap URL (NOT the one with vbseo_sitemap/data/).
Have you defined email address to receive email notifications in vB admincp->vBSEO Sitemap Generator options?
caliman
03-07-2006, 09:41 PM
Oleg did you see this?
https://vborg.vbsupport.ru/showpost.php?p=917668&postcount=723
iojam
03-07-2006, 09:46 PM
caliman,
yes, I've replied to your post with the same request at vbseo.com: http://www.vbseo.com/f67/sitemap-generation-time-3832/#post21067
Algren_San
03-08-2006, 12:00 AM
kk thanks to you iojam and i will like to know about this https://vborg.vbsupport.ru/showpost.php?p=917193&postcount=718 :) thanks again for the support :)
SouthernTn
03-08-2006, 03:12 AM
Im having a problem for some reason when running the generator
I get ALOT of errors..
Warning: gzopen(/home/hyped/public_html/forums/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Permission denied in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 412
Warning: gzopen(/home/USERNAME/public_html/forums/vbseo_sitemap/data/sitemap.txt.gz): failed to open stream: Permission denied in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 415
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 423
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/USERNAME/public_html/forums/vbseo
I re-installed it to see what would happen and I still get this error
incurable
03-08-2006, 04:13 AM
Algren_San,
thank you for letting us know, we'll correct this in the next version :)
incurable,
make sure that permissions are set correctly for the data/ folder.
jjj0923,
you should submit http://www.mysite.com/forums/sitemap_index.xml.gz sitemap URL (NOT the one with vbseo_sitemap/data/).
Have you defined email address to receive email notifications in vB admincp->vBSEO Sitemap Generator options?
Oh..it works now . THANK YOU VERY MUCH!!!
incurable
03-08-2006, 04:14 AM
Im having a problem for some reason when running the generator
I get ALOT of errors..
Warning: gzopen(/home/hyped/public_html/forums/vbseo_sitemap/data/sitemap_1.xml.gz): failed to open stream: Permission denied in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 412
Warning: gzopen(/home/USERNAME/public_html/forums/vbseo_sitemap/data/sitemap.txt.gz): failed to open stream: Permission denied in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 415
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/USERNAME/public_html/forums/vbseo_sitemap/vbseo_sitemap_functions.php on line 423
Warning: gzwrite(): supplied argument is not a valid stream resource in /home/USERNAME/public_html/forums/vbseo
I re-installed it to see what would happen and I still get this error
try to chmod the data directory to 777 dude.
SouthernTn
03-08-2006, 12:58 PM
already did/is
SouthernTn
03-08-2006, 01:00 PM
oh i see you had the same error.. hmm... wondering why its not working... ill check again in a bit
already did/is
And all of the files in the directory? Are they all writable by the server?
SouthernTn
03-08-2006, 05:20 PM
Yea.. It was running at first. But then, all of a sudden it quit.. I must have did something without realizing what I did.. I'll go back over the steps in a minute and update.
iojam
03-10-2006, 07:07 PM
Update: an issue in SouthernTn's case has been resolved by chaning the file owner value (additional to permissions setting).
Holidazed
03-10-2006, 11:58 PM
I installed this on my vbb3.54 and I when I run the cron task, I get the following error:
Table 'hidingplace_com_vbb350.adv_setting' doesn't exist
Now, I installed it according to your instructions and everything installed fine.
Ideas?
Holidazed
03-12-2006, 04:08 AM
OK, I got this installed and now have no error messages. The real question is:
How do I know if it is working? I see nothing new on my site to give evidence.
Ideas?
iojam
03-12-2006, 09:45 PM
bitg,
you can check the Sitemap Downloads Log in vbseo_sitemap/ interface to make sure that googlebot downloads your sitemap files.
Phrost
03-13-2006, 04:32 PM
--Nevermind-- Fixed myself. Still a great hack though!
Phrost
03-14-2006, 12:29 AM
Is there any way to remove the [archive] bit that's added to archived threads from the script? I'm assuming this hack adds it because I've never seen it before today when I installed it.
iojam
03-14-2006, 03:17 PM
Phrost,
could you please clarify your request? Do mean there is a problem with archived showthread URLs added to the sitemap?
Phrost
03-14-2006, 03:20 PM
That's what it seemed. When doing a google site search the results for the archive were tagged [archive]. Is this a feature of the hack? If so, can it be disabled?
If not, please disregard.
Fuzzy Orange
03-15-2006, 08:17 AM
Guys im having a big problem
Installed and got it running fine but it is producing invalid sitemaps
<?xml version="1.0" encoding="UTF-8" ?>
<sitemapindex xmlns="http://www.google.com/schemas/sitemap/0.84" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.google.com/schemas/sitemap/0.84 http://http://www.google.com/schemas/sitemap/0.84/siteindex.xsd">
<sitemap>http://www.performancecarclub.co.uk/forum/sitemap_1.xml.gz</sitemap>
<sitemap>http://www.performancecarclub.co.uk/forum/sitemap_2.xml.gz</sitemap>
<sitemap>http://www.performancecarclub.co.uk/forum/sitemap_3.xml.gz</sitemap>
</sitemapindex>
Thats my top level sitemap but it has no <loc> tags so google is reporting an error
Google says the file should look like this
<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.google.com/schemas/sitemap/0.84">
<sitemap>
<loc>http://www.example.com/sitemap1.xml.gz</loc>
<lastmod>2004-10-01T18:23:17+00:00</lastmod>
</sitemap>
<sitemap>
<loc>http://www.example.com/sitemap2.xml.gz</loc>
<lastmod>2005-01-01</lastmod>
</sitemap>
</sitemapindex>
So what have I done wrong?
buro9
03-15-2006, 09:11 AM
I'm also getting the missing <loc> tag error on Google sitemaps.
Same problem about tag <loc>
Everything was ok until the last days ...
For "sitemap_index.xml.gz" Google give me :
Missing XML tag (Line 6) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit.
Any fix ?
SIINSI
03-15-2006, 09:47 PM
Yup, just started getting the error today....
Missing XML tag (Line 6) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 7) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 8) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 9) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 10) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 11) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 12) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 13) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 14) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
Missing XML tag (Line 15) The required tag <loc> describing tag <sitemap> is missing. Please add it and resubmit. More
rossco_2005
03-15-2006, 11:04 PM
I just started getting same error.
Did google just start requiring this?
vBulletin® v3.8.12 by vBS, Copyright ©2000-2024, vBulletin Solutions Inc.