vb.org Archive - Forum Home Enhancements

Page 18 of 19

« First

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- Modification Graveyard (https://vborg.vbsupport.ru/forumdisplay.php?f=224)

- - Forum Home Enhancements - Track Guest Visits (https://vborg.vbsupport.ru/showthread.php?t=201214)

Max Taxable

09-07-2013 03:29 PM

Quote:

You can get an improved Spiders Definition file from this site.

That link is no longer valid, and I was looking for a updated definitions file for this. Any ideas?

Chiefly, would like to add the archive dot org "Wayback Machine" crawler to the definitions.

ozzy47

09-07-2013 03:43 PM

Quote:

Originally Posted by Max Taxable (Post 2443963)

That link is no longer valid, and I was looking for a updated definitions file for this. Any ideas?

Chiefly, would like to add the archive dot org "Wayback Machine" crawler to the definitions.

You can get the last spiders list here, http://www.vbulletin.com/forum/forum...etin-xml-files

Max Taxable

09-07-2013 05:04 PM

Quote:

Originally Posted by ozzy47 (Post 2443964)

You can get the last spiders list here, http://www.vbulletin.com/forum/forum...etin-xml-files

Thanks but, that's the one I have.

ozzy47

09-07-2013 06:47 PM

Ahh ok, AFAIK that is the latest one, I have not seen anything else posted. :(

Paul M

09-07-2013 09:48 PM

Removed that link as its no longer valid.

wolfshead-solutions btw was Mosh, so it would have been the same file.

Max Taxable

09-07-2013 10:10 PM

Quote:

Originally Posted by Paul M (Post 2444017)

Removed that link as its no longer valid.

wolfshead-solutions btw was Mosh, so it would have been the same file.

He was a good fella.

Max Taxable

09-07-2013 10:15 PM

Paul:

I've added this to the XML, the definitions file. Will it work? Any issues?

HTML Code:

<spider ident="Archive Bot">

                <name>Wayback Machine</name>

                <info>http://www.archive.org/details/archive.org_bot</info>

                <email>bot@archive.org</email>

Is the "spider ident" what's found in the user agent string for the bot? Must it match the UA?

Max Taxable

09-09-2013 03:01 PM

Quote:

Originally Posted by Max Taxable (Post 2444019)

Paul:

I've added this to the XML, the definitions file. Will it work? Any issues?

HTML Code:

<spider ident="Archive Bot">

                <name>Wayback Machine</name>

                <info>http://www.archive.org/details/archive.org_bot</info>

                <email>bot@archive.org</email>

Is the "spider ident" what's found in the user agent string for the bot? Must it match the UA?

And....

That does not work. Any advice Paul? Anyone?

Max Taxable

09-10-2013 03:52 PM

Now I've tried:

HTML Code:

<spider ident="archive.org_bot">

                <name>archive.org_bot</name>

                <info>http://www.archive.org/details/archive.org_bot</info>

                <email>bot@archive.org</email>

Max Taxable

09-11-2013 01:28 PM

Quote:

Originally Posted by Max Taxable (Post 2444675)

Now I've tried:

HTML Code:

<spider ident="archive.org_bot">

                <name>archive.org_bot</name>

                <info>http://www.archive.org/details/archive.org_bot</info>

                <email>bot@archive.org</email>

That one made the entire plugin cease to function. Everything hitting the site was a "guest."

All times are GMT. The time now is 02:08 AM.

Page 18 of 19

« First

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01351 seconds Memory Usage 1,745KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (4)bbcode_html_printable (6)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (3)pagenav_pagelink (1)pagenav_pagelinkrel (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: