vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB3 General Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=111)
-   -   Google indexing by means of sitemap (https://vborg.vbsupport.ru/showthread.php?t=216817)

Bosetto 06-22-2009 04:23 PM
Google indexing by means of sitemap
 
Dear all,
this is my forum:

http://lnx.scaricone.it/forums

I have big issues with Google because:
1) the spider is always on calendar pages and members profile
2) the indexed pages are few (about 500) in comparison with the high number of discussions (more than 400.000)
3) about 1 week ago I have added in my forum the "vbseo sitemap generator" : now in my google account I can see that the "url sent" are more than 450.000 but the "url indexed" are about 400 and each day this number seems to be updated starting again from zero. But never it is more than 450.

In my opinion the problem is in the point no.1

Could you please help me???

Thanks in advance!!!

Bosetto 06-23-2009 06:05 PM
Please, could anyone help me?
pleaseeeeee :(

HMBeaty 06-23-2009 06:15 PM
One way to stop them from crawling pages you don't want them to is by creating a new text file and saving it as robots.txt. Then add the following text inside the robots.txt file:
Quote:
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
And upload this to your root directory. So basically it would come up as www.yoursite.com/robots.txt

Bosetto 06-25-2009 05:34 PM
Dear Redline,
I uploaded the robots file and it was succesfully read by google (I checked on my webmaster tool account) but the situation is not changed!!! Google is still on calendar and profiles pages!!!!
What have I to do??
Please can anyone help me??????? Please!!!!!!!!

Bosetto 06-26-2009 07:19 PM
Please,
is there an expert who can help me????

--------------- Added [DATE]1246132907[/DATE] at [TIME]1246132907[/TIME] ---------------

Quote:
Originally Posted by Bosetto (Post 1838031)
Please,
is there an expert who can help me????
I cannot believe that nobody can solve this issue!!!
please!!!

Bosetto 06-27-2009 07:41 PM
I cannot believe that nobody can solve this issue!!!
please!!!


All times are GMT. The time now is 12:15 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01039 seconds
  • Memory Usage 1,724KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (6)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete