PDA

View Full Version : Getting googlized without .htaccess or mod_rewrite...


cobradude
01-06-2003, 12:03 AM
Ok, I am using IIS, and I would like google and others to crawl my entire site, but each of the spider friendly hacks I have seen require .htaccess or mod_rewrite, none of which I can use.

Is there a way to make an archive using IIS that will be crawlable?

TECK
01-06-2003, 12:06 AM
You could install vbHome (lite) and use the Search Engine Indexer add-on. On my site, I get every night about 20-30 robots crawling for new posts.

DrkFusion
01-06-2003, 12:32 AM
Every night?
I thought google only crawls once a month or something, anyways.

Tecks Archive is cool, google nailed it, and all the threads were indexed.

TECK
01-06-2003, 12:51 AM
The way Google works is like this:
First it will send in mission only one crawler, to see if something is new to the site. If the spy detects new stuff, it will report to home base how many links are new. According to this, dependable on each time stamp, the home base will send around 2-4AM it's soldiers (crawlxxx.googlebot.com) in mission to grab the new information from your site.

That's why is so important to have a plain simple link to the archive file on your site. Google say is not necessary and that they will do it for you anyway... but I don't believe it. ;)
Since I placed my archive.php file, I see many more crawlers onto my site then ever, every day. If you have only one folder, they will not come every day to visit your site.
What i did me is this: I submitted to Google the archive.php link. In 2 days my site was hammered hundreds of times by the crawlers.

BTW, this tip (plain link) came from Chen. :)

TECK
01-06-2003, 12:53 AM
Here it is an example of spidered links:
http://www.google.ca/search?hl=en&lr=&ie=UTF-8&oe=UTF-8&q=+site:www.teckwizards.com+vbhome

cobradude
01-06-2003, 12:56 AM
Teck, I am currently using vbportal. Is the add-on something I could use with it?

Thanks for the help.

TECK
01-06-2003, 01:03 AM
Unfortunately no. It needs the vbHome functions.
There is another hack similar to this on the Full Releases section, done by my friend Xenon and Scuzzy. It uses a different approach, using a htaccess file. My hack doesn't require no mods at all. Just run the installer, upload the archive file and you are done.

I cannot tell you how the performance go or if all threads are indexed (how fast or if it's done daily done) because I didn't try it.

cobradude
01-06-2003, 01:10 AM
Hmmm....I can't use .htaccess because I'm using IIS.

cobradude
01-06-2003, 01:13 AM
Any chance for a little dough you could make your archive script standalone?

TECK
01-06-2003, 01:22 AM
Sorry, no. It's designed to be used by vbHome (lite) (https://vborg.vbsupport.ru/showthread.php?s=&threadid=36756) users, since is an addon available ONLY on my forums.

DrkFusion
01-06-2003, 01:34 AM
Teck this is working amazingly awesome!

Thanks!

cobradude
01-06-2003, 01:39 AM
Hmmmm....Maybe I'll install vbhome and give it a whirl. :)

TECK
01-06-2003, 02:46 AM
Well if you want to lower your server load and perform in average 15queries (instead of 30-70 like phpPortal does), you should do it. Many users who switched are very happy with their site performance.

For sure vbHome (lite) doesn't have as many options as phpPortal but it's performing really well for what it does. Check my site for user testimonials and more info.

cobradude
01-06-2003, 02:55 AM
Ok, I have the vbhome installed. Testing it out on http://www.clubhotrod.com/index2.php

May I have access to the hack section on your site now? I have registered under same username as here.

Thanks Teck!