vb.org Archive
Page 13 of 105 « First 31112 13 14152363 Last »
Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.6 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=194)
-   -   Administrative and Maintenance Tools - vBSEO Google/Yahoo Sitemap Generator (https://vborg.vbsupport.ru/showthread.php?t=144730)

djbaxter 05-17-2007 03:40 PM
Quote:
Originally Posted by DiesellMinded (Post 1249560)
I do not have a robots.txt that i can see

I moved both the sitemap.xmls the index one and the "1" one to the root due to .htaccess issues
Where is this robot.txt file located ? and is the text regenerated with each update of the sitemaps ?
The robots.txt file does not exist unless you create it.

Make sure you use a plain text editor and save it in ASCII or plain text format, NOT unicode.

DieselMinded 05-17-2007 03:48 PM
Where do you get this information at so i dont have to ask 100 questions ?

What do i put on the txt file ?

If i put this text file on my root then set the robots up to read that file will it direct the bots to vbseo_sitemap/data/xml file

djbaxter 05-17-2007 04:00 PM
<a href="http://www.robotstxt.org" target="_blank">http://www.robotstxt.org</a>

DieselMinded 05-17-2007 04:06 PM
Thanks for the link Ill read up on them ;)

Look like all the robots.txt does is Disallow things what do i need to put in there for it to find the sitemap.xmls

DM

djbaxter 05-17-2007 05:35 PM
Quote:
Originally Posted by DiesellMinded (Post 1249577)
Thanks for the link Ill read up on them ;)

Look like all the robots.txt does is Disallow things what do i need to put in there for it to find the sitemap.xmls

DM

Answered previously in this thread. See https://vborg.vbsupport.ru/showpost....5&postcount=98

DieselMinded 05-17-2007 06:02 PM
Thank you ... Heres my robot.txt file Does it look right to you?

HTML Code:
Sitemap: </vbseo_sitemap/data/sitemap_index.xml.gz>
User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

djbaxter 05-18-2007 12:09 AM
Quote:
Originally Posted by DiesellMinded (Post 1249643)
Thank you ... Heres my robot.txt file Does it look right to you?

Code:
Sitemap: </vbseo_sitemap/data/sitemap_index.xml.gz>
User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
Not quite. Change it to the following:

Code:
User-agent: *
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Sitemap: http://www.yoursite.com/vbseo_sitemap/data/sitemap_index.xml.gz
Note the blank line before Sitemap: and no <> brackets. Also the URL must be a complete URL, including http:// etc.

See http://www.sitemaps.org/protocol.php#submit_robots

DieselMinded 05-18-2007 01:23 AM
THANK YOU !!!!

Also See ...

http://www.vbseo.com/f44/newbie-here...o-hicky-13619/

Im really trying to get this to work

Yellow Slider 05-18-2007 12:37 PM
google bots are not indexing my pages for somthing like 2 weeks..
what could ne the problem? im using the generator for along time..
Results 1 - 10 of about 305,000 from atraf-f.net.
i do think that google is indexing new forums in my forums but there is no sign to new theards , there are only theards from 5\5 (maybe 1 or 2..) the rest are from april.. it a big issue for me.

what can i do? my forum is in hebrew, maybe one of the coders can see in the source if there is a problem that is cousing the bots to unindex my theards pages, thanks alot.

also, i went in one of the files, http://www.atraf-f.net/sitemap_46.xml.gz the latest one that was generated by the generator and i didnt see any pages from May 2007, there seemto be alot of pages from 2006 etc', how can i make the generator to include only theards \ pages from a certain date? thanks alot.

UaeStar 05-19-2007 08:52 PM
nice thanks


All times are GMT. The time now is 11:38 PM.
Page 13 of 105 « First 31112 13 14152363 Last »
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01527 seconds
  • Memory Usage 1,748KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (1)bbcode_html_printable
  • (3)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (3)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete