Log in

View Full Version : Google indexing by means of sitemap


Bosetto
06-22-2009, 04:23 PM
Dear all,
this is my forum:

http://lnx.scaricone.it/forums

I have big issues with Google because:
1) the spider is always on calendar pages and members profile
2) the indexed pages are few (about 500) in comparison with the high number of discussions (more than 400.000)
3) about 1 week ago I have added in my forum the "vbseo sitemap generator" : now in my google account I can see that the "url sent" are more than 450.000 but the "url indexed" are about 400 and each day this number seems to be updated starting again from zero. But never it is more than 450.

In my opinion the problem is in the point no.1

Could you please help me???

Thanks in advance!!!

Bosetto
06-23-2009, 06:05 PM
Please, could anyone help me?
pleaseeeeee :(

HMBeaty
06-23-2009, 06:15 PM
One way to stop them from crawling pages you don't want them to is by creating a new text file and saving it as robots.txt. Then add the following text inside the robots.txt file:
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
And upload this to your root directory. So basically it would come up as www.yoursite.com/robots.txt

Bosetto
06-25-2009, 05:34 PM
Dear Redline,
I uploaded the robots file and it was succesfully read by google (I checked on my webmaster tool account) but the situation is not changed!!! Google is still on calendar and profiles pages!!!!
What have I to do??
Please can anyone help me??????? Please!!!!!!!!

Bosetto
06-26-2009, 07:19 PM
Please,
is there an expert who can help me????

--------------- Added 1246132907 at 1246132907 ---------------

Please,
is there an expert who can help me????
I cannot believe that nobody can solve this issue!!!
please!!!

Bosetto
06-27-2009, 07:41 PM
I cannot believe that nobody can solve this issue!!!
please!!!