Log in

View Full Version : VB3 Search Engine Spirders?

ukbill69
04-09-2004, 10:08 AM
Hey people,

I wonder if anyone can help me. From the time i had to change domain names and then i upgraded to vb3 and google etc havent been spidering any of my posts. They did do in vb2 and i didnt have any hacks for this. Google did then spider my threads (ALL OF THEM) that i was very pleased with, then i had a fight with nomenet with me domain and thatb went right up the wall. Now it seems google does spider some of the treads that i have just visited or users have visited and somtimes spiders the url not the info.

I cant understand this? Anyone help me?
SmEdD
04-09-2004, 05:31 PM
Is your archive active? Spiders don't like variables in URL's so if you don't have a link to your archive that would be a start!
ukbill69
04-10-2004, 11:44 AM
Yes that works, google dont even go near it.
dstruct2k
04-17-2004, 11:10 PM
Any ideas on this one? I'm having the same problem.

By the way, my archive won't work on my host, as PHP is installed as a CGI, not a module.
RickFla
05-03-2004, 06:46 PM
Same here, is there a hack for those that are running CGI and not module?
insanctus
05-03-2004, 06:52 PM
Google eats up my personal site.

Googlebot (Google) 569 This month
Googlebot (Google) 15057 Last month (on a new url)

So it must like my vb3
Fluous
05-04-2004, 02:11 AM
err whats this mean? archive, i need to get my site active but i need loads of spiders...
SVTBlackLight01
05-04-2004, 02:43 AM
Google eats up my personal site.

Googlebot (Google) 569 This month
Googlebot (Google) 15057 Last month (on a new url)

So it must like my vb3

Actually, IMO, it's probably due to Adsense. I noticed a severe increase in Googlebots after I started using Adsense. Also with Adsense, I noticed that these bots were visiting posts sometimes seconds after messages were posted.
Boofo
05-04-2004, 02:48 AM
What is this Adsense everyone keeps talking about?
Brad
05-04-2004, 03:11 AM
What is this Adsense everyone keeps talking about?
The google program that displays ad's relivant to key words on your site. That is also why the googlebot activity went up.
SVTBlackLight01
05-05-2004, 01:21 AM
What is this Adsense everyone keeps talking about?


https://www.google.com/adsense/