StarBuG
11-06-2005, 08:38 PM
Hi
I have just noticed that if I run gsitemap (a windows prog that spiders a website to generate a sitemap) catches all my forum urls with a session ID.
I added the Gsitemap to the spider indentification xml (spiders_vbulletin.xml)
<spider ident="Gsitemap">
<name>Gsitemap Spider</name>
<type>searchspider</type>
</spider>
The spider is now propaly displayed in the who is online however the Spider STILL gets the sessions.
Any Idea where this could be set?
I need my spider to get urls without session id to create the google sitemap
I have just noticed that if I run gsitemap (a windows prog that spiders a website to generate a sitemap) catches all my forum urls with a session ID.
I added the Gsitemap to the spider indentification xml (spiders_vbulletin.xml)
<spider ident="Gsitemap">
<name>Gsitemap Spider</name>
<type>searchspider</type>
</spider>
The spider is now propaly displayed in the who is online however the Spider STILL gets the sessions.
Any Idea where this could be set?
I need my spider to get urls without session id to create the google sitemap