Quote:
Originally Posted by Max Taxable
Paul:
I've added this to the XML, the definitions file. Will it work? Any issues?
HTML Code:
<spider ident="Archive Bot">
<name>Wayback Machine</name>
<info>http://www.archive.org/details/archive.org_bot</info>
<email>bot@archive.org</email>
Is the "spider ident" what's found in the user agent string for the bot? Must it match the UA?
|
And....
That does not work. Any advice Paul? Anyone?