| djbaxter |
06-12-2007 01:25 AM |
Quote:
Originally Posted by Calibre_k
(Post 1266658)
BUT I WANTED IT TO WRITE THE URLS TO website_link.html
|
Why? Did you buy the myth that static URLs are better in some way?
Google Facts & Fiction
Quote:
Fiction: Sites are not included in Google's index if they use ASP (or some other non-html file-type.)
Fact: We're able to index most types of pages and files with very few exceptions. A sampling of the file extensions we're able to index includes: pdf, asp, jsp, html, shtml, xml, doc, xls, ppt, rtf, wks, lwp, wri, swf, cfm, and php.
|
Google and Dynamic Pages
Quote:
If you decide to use dynamic pages (i.e., the URL contains a "?" character), be aware that not every search engine spider crawls dynamic pages as well as static pages. It helps to keep the parameters short and the number of them few.
Allow search bots to crawl your sites without session IDs or arguments that track their path through the site. These techniques are useful for tracking individual user behavior, but the access pattern of bots is entirely different. Using these techniques may result in incomplete indexing of your site, as bots may not be able to eliminate URLs that look different but actually point to the same page.
|
Update to Google and dynamic pages
Quote:
As the web continues to change and evolve, our algorithms change right along with it. Recently, as a result of one of those algorithmic changes, we've modified our webmaster guidelines. Previously, these stated:
Quote:
Don't use "&id=" as a parameter in your URLs, as we don't include these pages in our index.
|
However, we've recently removed that technical guideline, and now index URLs that contain that parameter. So if your site uses a dynamic structure that generates it, don't worry about rewriting it -- we'll accept it just fine as is. Keep in mind, however, that dynamic URLs with a large number of parameters may be problematic for search engine crawlers in general, so rewriting dynamic URLs into user-friendly versions is always a good practice when that option is available to you. If you can, keeping the number of URL parameters to one or two may make it more likely that search engines will crawl your dynamic urls.
|
Does Google index dynamic pages?
Quote:
Yes, Google indexes dynamically generated webpages, including .asp pages, .php pages, and pages with question marks in their URLs. However, these pages can cause problems for our crawler and may be ignored. If you're concerned that your dynamically generated pages are being ignored, you may want to consider creating static copies of these pages for our crawler. If you do this, please be sure to include a robots.txt file that disallows the dynamic pages in order to ensure that these pages aren't seen as having duplicate content.
|
vBulletin by default removes session IDs for search engine spiders. |
More Information