vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.6 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=194)
-   -   Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=144730)

iojam 09-01-2007 08:31 PM

You should click "errors" link to see the details.

djbaxter 09-01-2007 08:48 PM

What this add-on BADLY needs is an easy way to prune all the outdated reports it leaves behind, without having to go through a gazillion screens.

Even better would be to have it automated so that it only keeps say a week's worth.

skunker 09-02-2007 04:10 PM

Hi guys, love this mod. I have a question:

Is there a reason to make member profiles crawlable? I turned that part off because I wasn't sure if there was a reason to let the spiders crawl that. Got any good reasons why I should use it? Thanks.

djbaxter 09-02-2007 05:39 PM

Quote:

Originally Posted by skunker (Post 1330823)
Hi guys, love this mod. I have a question:

Is there a reason to make member profiles crawlable? I turned that part off because I wasn't sure if there was a reason to let the spiders crawl that. Got any good reasons why I should use it? Thanks.

The only reason would be to encourage even more spammers to sign up and never post anything just for the privilege of dropping a link back to their sites in the member profile. The best thing you can do is NOT include that in the sitemap and in fact shut it off to viewing for everyone except logged in members.

baghdad4ever 09-03-2007 05:42 PM

Quote:

Originally Posted by iojam (Post 1330350)
You should click "errors" link to see the details.

Network unreachable: robots.txt unreachable
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

We require your Sitemap file to be UTF-8 encoded (you can generally do this when you save the file). As with all XML files, any data values (including URLs) must use entity escape codes for the characters listed in the table below.

iojam 09-03-2007 07:01 PM

djbaxter,

thank you for suggestion.

baghdad4ever,

try to temporarily remove robots.txt file from your domain root.

ThorstenA 09-03-2007 07:13 PM

After joining a new host, CHMOD 777 the 'forum-root/vbseo_sitemap/data/' folder again, I am getting these errors
Code:

............
[forumdisplay] forum_id: 1053, total threads: 0, pages: 1 [11,653.9Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 1251, total threads: 0, pages: 1 [11,654.7Kb mem used] [0s (+0s)]
[forumdisplay] forum_id: 1746, total threads: 0, pages: 1 [11,655.5Kb mem used] [0s (+0s)]

Warning: gzopen(/vbseo_sitemap/data/sitemap_1.xml.gz) [function.gzopen]: failed to open stream: Permission denied in /vbseo_sitemap/vbseo_sitemap_functions.php on line 540

Warning: gzopen(/vbseo_sitemap/data/urllist.txt.gz) [function.gzopen]: failed to open stream: Permission denied in /vbseo_sitemap/vbseo_sitemap_functions.php on line 544

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 554

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 568

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 565

Warning: gzwrite(): supplied argument is not a valid stream resource in /vbseo_sitemap/vbseo_sitemap_functions.php on line 568
.........................................


steven s 09-03-2007 10:06 PM

I don't want /vbseo_sitemap viewable to the world.
Did I miss something in the instructions?
If I password protect that directory, will the script still work?

djbaxter 09-03-2007 10:19 PM

Quote:

Originally Posted by 1996 328ti (Post 1331715)
I don't want /vbseo_sitemap viewable to the world.
Did I miss something in the instructions?
If I password protect that directory, will the script still work?

If you password protect the directory, how will Google and Yahoo be able to readi it?

steven s 09-03-2007 11:35 PM

Quote:

Originally Posted by djbaxter (Post 1331722)
If you password protect the directory, how will Google and Yahoo be able to readi it?

I believe the .htaccess takes care of that since the url for the sitemap is not pointing directly to the vbseo directory.

djbaxter 09-04-2007 12:03 AM

Quote:

Originally Posted by 1996 328ti (Post 1331715)
I don't want /vbseo_sitemap viewable to the world.
Did I miss something in the instructions?
If I password protect that directory, will the script still work?

Quote:

Originally Posted by djbaxter (Post 1331722)
If you password protect the directory, how will Google and Yahoo be able to read it?

Quote:

Originally Posted by 1996 328ti (Post 1331759)
I believe the .htaccess takes care of that since the url for the sitemap is not pointing directly to the vbseo directory.


Unless you've done something non-standard, .htaccess points to a file in a subdirectory of /vbseo_sitemap/ - specifically to /home/psychlin/public_html/forum/vbseo_sitemap/data/.

If the top folder is password protected, I don't think the subfolder is accessible.

steven s 09-04-2007 12:12 AM

Quote:

Originally Posted by djbaxter (Post 1331774)
Unless you've done something non-standard, .htaccess points to a file in a subdirectory of /vbseo_sitemap/ - specifically to /home/psychlin/public_html/forum/vbseo_sitemap/data/.

If the top folder is password protected, I don't think the subfolder is accessible.

You're right. I thought it was working but didn't realize it was working because I had entered my password. :o
And to show my other dumb observation. I guess once you use your password to go to the report page, it is stored.
So I guess people don't have access to the reports page afterall.

djbaxter 09-04-2007 12:22 AM

That's correct. It's only stored on your computer - or more naccurately whatever computers you use to access the site.

baghdad4ever 09-04-2007 03:31 PM

i delete the robot.txt

and still google give me error

iojam 09-04-2007 10:21 PM

ThorstenA,

try to remove all files from vbseo_sitemap/data/ folder.

1996 328ti,

vbseo_sitemap/ interface pages are password protected (password is defined in the options), while your sitemap files and logs data/ folder has "deny from all" in .htaccess by default.

ThorstenA 09-04-2007 10:34 PM

Quote:

Originally Posted by iojam (Post 1332520)
ThorstenA,

try to remove all files from vbseo_sitemap/data/ folder.

I have deleted all vbseo files, deinstalled it and after install it again, everything works fine! Thank you very much!

baghdad4ever 09-05-2007 12:34 PM

i delete the robot.txt

and still google give me error

note: the safe mod is enabled on the server

is that affect the hack???

Mecho 09-05-2007 03:58 PM

is there anyway that we can included all the links in close sections for guests in sitemaps ??

iojam 09-05-2007 08:43 PM

Mecho,

if you mean including thread URLs form private subforums, Google will still be unable to access those pages, so there is no reason to include them in sitemap.

baghdad4ever 09-06-2007 06:10 AM

Quote:

Originally Posted by baghdad4ever (Post 1332864)
i delete the robot.txt

and still google give me error


note: the safe mod is enabled on the server

is that affect the hack???


why there is no one answer me???:(:(:(

Mecho 09-06-2007 08:32 AM

Quote:

Originally Posted by iojam (Post 1333132)
Mecho,

if you mean including thread URLs form private subforums, Google will still be unable to access those pages, so there is no reason to include them in sitemap.

even if i install this mod Member Bots they can not access to those pages ? i dunno maybe i wrong but i think it is good if we have links in google but ppl need to register to see them ! we will get more users . as i said i dunno it s good or bad in Google Rank , so plz guide me .

thanks

GYSMO 09-06-2007 02:07 PM

Has vBSEO released that BRAND FREE option for used of its module or still are we cripple and slaved to see it seen on our forums homepages
I dont mind paying the extra but then I most like me paying great prises dont like to be crippled in
guess I have no other choice then wait till they fixed this issue ... snifff ... UN INSTALLED

djbaxter 09-06-2007 02:32 PM

Quote:

Originally Posted by GYSMO (Post 1333599)
Has vBSEO released that BRAND FREE option for used of its module or still are we cripple and slaved to see it seen on our forums homepages
I dont mind paying the extra but then I most like me paying great prises dont like to be crippled in guess I have no other choice then wait till they fixed this issue ... snifff ... UN INSTALLED

*cough* This isn't vBSEO. This is a free add-on developed by the same people but it doesn't require vBSEO, doesn't require payment, and doesn't add any "branding" or even credit links when installed.

Yes, I'm sure they offer this as an advertising/marketing strategy and I'm sure they hope that you'll like this add-on enough to look into buying their other product but it's not a requirement.

iojam 09-07-2007 02:15 AM

Mecho,

I would not suggest to allow search engine bots visiting your threads while requiring registration for regular visitors since that is "cloaking":
http://www.google.com/support/webmas...n&answer=35769

baghdad4ever,
your issue may be related to the one described in http://www.homewithandrew.com/index....achable-error/

Mecho 09-07-2007 08:30 AM

thank u iojam for info , got it :)

baghdad4ever 09-07-2007 04:19 PM

Quote:

Originally Posted by iojam (Post 1334013)
baghdad4ever,
your issue may be related to the one described in http://www.homewithandrew.com/index....achable-error/



thanks dear

but plz help me

he said that

Quote:

I had modified my .htaccess file to solve canonicalization problems by redirecting :

redundant URLs to new URLs
non-www URLs to www URLs
index.php to root
I theorize that since these redirections involved hundreds of URLs it?s possible that when I deployed the changes in my .htaccess file in mid July, it triggered the ?increase? in concurrent connections as the bots were redirected to the correct pages. In other words Googlebot attempted to make 2 connections for every page - once to the old/non-www URL and then to the new/www URL. As the concurrent connections increased, it triggered the automated mechanism that blocked Googlebot?s IP address. This in turn caused more time-out errors. The spikes in the Googlebot Download Time chart (above) indicates long download times which eventually ended in timeouts. Unfortunately, this affected one of the most important files - the robots. txt file - which every bot needs to before it accesses a site?s pages. These time-outs also made my sitemap inaccessible, so since Googlebot could not access these 2 important pages, it could not confirm my site still existed!


what should i do??:(:(:(

MissKalunji 09-07-2007 04:54 PM

anyone has a Mobile sitemap generator?

GYSMO 09-07-2007 08:35 PM

Quote:

Originally Posted by djbaxter (Post 1333613)
*cough* This isn't vBSEO. This is a free add-on developed by the same people but it doesn't require vBSEO, doesn't require payment, and doesn't add any "branding" or even credit links when installed.

Yes, I'm sure they offer this as an advertising/marketing strategy and I'm sure they hope that you'll like this add-on enough to look into buying their other product but it's not a requirement.

Smiles and yes I had bought there product and had it intalled on that few days that followed after being fully paid in and was disapointed that the only left issue was about leaving there prints on main pages ... guess lots wouldnt mind after all if they did paid just rent there vBulletin and dont mind having pub all over thats fine and understand yet are the ones that do pay lots over thoses issue and still respected autho's copyrights and will respected there conditions leaving it on ... so comes to this issue removing it becomes the best solution as i did then ... got to wait till a well programmers come along and gives as much as compitition openings then set on them

djbaxter 09-07-2007 09:41 PM

Quote:

Originally Posted by GYSMO (Post 1334467)
Smiles and yes I had bought there product and had it intalled on that few days that followed after being fully paid in and was disapointed that the only left issue was about leaving there prints on main pages ... guess lots wouldnt mind after all if they did paid just rent there vBulletin and dont mind having pub all over thats fine and understand yet are the ones that do pay lots over thoses issue and still respected autho's copyrights and will respected there conditions leaving it on ... so comes to this issue removing it becomes the best solution as i did then ... got to wait till a well programmers come along and gives as much as compitition openings then set on them

I don't think you understood what I was saying. This sitemaps add-on doesn't leave footer links anywhere. Those links come from vBSEO. If you want to get rid of those, uninstalling the sitemaps add-on won't help. You'll have to uninstall vBSEO.

ThorstenA 09-08-2007 08:02 AM

Suggestion: Include blog entries :D

toejam 09-08-2007 08:25 PM

i have everything working or at least i think i do, no error messages. what does this mean CHMOD 777, i don't understand what thats for or what i have to change to use that.

CraiovaOnLine 09-09-2007 03:37 PM

i've tried subminting to google the sitemap via Google webmasters
http://www.sitename.com/vbseo_sitema...p_index.xml.gz

but i am gettin this : General HTTP error: 4xx error
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

also if i try to view that file i get this erorr:
403 Permission Denied
You do not have permission for this request /vbseo_sitemap/data/sitemap_index.xml.gz


is this normal?
where did i screw it up?

iojam 09-09-2007 07:17 PM

baghdad4ever,

the conclusion in that post was:
Quote:

Our firewall has an automated mechanism which will block IP addresses deemed to be making too many concurrent connections to our server in a short time. Our security department has whitelisted the google network range that is noticed to make these connections. On top of that we have made the firewall less stringent in the sense we will allow a higher threshold of concurrent connections compared to previously. Based on your feedback, the configuration is just right.
Please check that with your hosting support.


toejam,

chmod 0777 means changing file access permissions (you can do that using your FTP software).


CraiovaOnLine,

you should submit http://www.sitename.com/sitemap_index.xml.gz (without vbseo_sitemap/data/), make sure that you created .htaccess as described in installation instructions.

JIoiiiJI 7gJoo 09-11-2007 01:28 AM

nice .. :)

toejam 09-12-2007 02:14 AM

do i need vb seo 3.0 for this mod to work or will it work by itself. its been a week now with vBSEO Google/Yahoo Sitemap Generator v.2.0 installed on a new forum but not sure when or if google will ever post my site. control panel show googlebot having 13 hits but isnt doing anything from it.

toejam 09-12-2007 03:20 PM

Do I need a robot.txt with this setup? I found with my setup i only allowed the folder 777 and not the files inside of it so iam hopping this fixes my problem.

Beermonster 09-13-2007 05:53 AM

Google won't accept domain:/vbseo_sitemap/data/sitemap_index.xml.gz as a path, what am I doing wrong? or is there a way to have them created in the root?

toejam 09-13-2007 11:19 AM

Quote:

Originally Posted by Beermonster (Post 1338125)
Google won't accept domain:/vbseo_sitemap/data/sitemap_index.xml.gz as a path, what am I doing wrong? or is there a way to have them created in the root?

try using this instead www.example.com/sitemap_index.xml.gz

Also read this http://www.vbseo.com/f44/robots-txt-...ap-file-12814/
i think you need to create a robots.txt in your root with http://www.example.com/sitemap_index.xml.gz included.
if iam wrong someone please step in. i hope this helps you, that site has alot more info on this topic.

Beermonster 09-13-2007 11:26 AM

Quote:

Originally Posted by toejam (Post 1338241)
try using this instead www.example.com/sitemap_index.xml.gz



I would if it was there, thats why I wanted to know if there was a way to copy it to the root
Quote:

Originally Posted by toejam (Post 1338241)
Also read this
http://www.vbseo.com/f44/robots-txt-...ap-file-12814/
i think you need to create a robots.txt in your root with http://www.example.com/sitemap_index.xml.gz included.
if iam wrong someone please step in. i hope this helps you, that site has alot more info on this topic.

Thanks I will have a look at it

mark99 09-14-2007 12:44 PM

Installed it, generated the report but the .htaccess file I'm required to upload makes the sitemap 403 (forbidden):

http://www.domain.co.uk/forum/vbseo_...p_index.xml.gz

I try:

http://www.domain.co.uk/forum/vbseo_...p_index.xml.gz

..but that doesn't work either (404), same with..

http://www.domain.co.uk/forum/sitemap_index.xml.gz

Everything installed correctly as per instruction but outside of installation there's no real FAQ for stuff like this, help appreciated.


All times are GMT. The time now is 05:52 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.02198 seconds
  • Memory Usage 1,852KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_code_printable
  • (20)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (40)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete