View Full Version : Google Bot doesnt navigate through site
Residue
02-26-2006, 04:25 AM
I submitted my site to google ~4 months ago and everytime the Google Spider visits my site, it gets stuck on index.php and doesnt browse the site.
Im using vBadvanced CMPS ( www.jdmcentral.net/index.php ). I thought maybe this was a part of the problem, so I submitted another url to google, direct to the forum ( forums.jdmcentral.net/index.php ), unfortuantely this also has not fixed the problem.
Because of this, Google is not viewing the contents of my page, therefore google searches pull up no information for my site. I am not having any problems with submissin to yahoo, msn, etc etc.
Any help is greatly appreciated.
Residue
03-01-2006, 06:27 AM
i figured out i had to create a robots.txt file ...google is currently in the process of indexing my site! :D
perfphysio
09-18-2006, 03:40 PM
Can you give us a bit more insite into what that is and how one goes about it?
:cross-eyed:
Brandon Sheley
09-18-2006, 03:44 PM
Can you give us a bit more insite into what that is and how one goes about it?
:cross-eyed:
3. Restrict Search Engine Crawling
Those spiders..they index your content, but there are always places that you don't want or need them to go.
To restrict the pesky critters to only eating up your Content, do the following.
In your root (public_html) directory, upload the following robots.txt::
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
this assumes your forum is in the /forums/ folder ;)
also.. to the thread starter,, your site doesn't have a bunch of links to the forum.. check out my forum, its in my sig.. look at the footer and see the archive links.. I'd suggest doing something like this with links to your forum sections ;)
This will help a Lot ! :)
good luck
perfphysio
09-18-2006, 03:49 PM
thanks a lot. I will try your idea and see if i get anymore replies as well. Much appreciated
Loco.M, how did you made those links in the bottom (1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28) and whats the use of it??
Sorry i'm a noob :(
vBulletin® v3.8.12 by vBS, Copyright ©2000-2025, vBulletin Solutions Inc.