The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
#1
|
|||
|
|||
What should be in robots.txt?
What should be in robots.txt?
|
#2
|
||||
|
||||
this is what i have on my site i have it on the root of my site my front end uses joomla
here a link about robots txt Code:
User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /language/ Disallow: /libraries/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ Disallow: /forum/admincp/ Disallow: /forum/clientscript/ Disallow: /forum/cpstyles/ Disallow: /forum/customavatars/ Disallow: /forum/customprofilepics/ Disallow: /forum/images/ Disallow: /forum/includes Disallow: /forum/modcp/ Disallow: /forum/ajax.php Disallow: /forum/attachment.php Disallow: /forum/calendar.php Disallow: /forum/cron.php Disallow: /forum/editpost.php Disallow: /forum/global.php Disallow: /forum/image.php Disallow: /forum/inlinemod.php Disallow: /forum/joinrequests.php Disallow: /forum/login.php Disallow: /forum/member.php Disallow: /forum/memberlist.php Disallow: /forum/misc.php Disallow: /forum/moderator.php Disallow: /forum/newattachment.php Disallow: /forum/newreply.php Disallow: /forum/newthread.php Disallow: /forum/online.php Disallow: /forum/poll.php Disallow: /forum/postings.php Disallow: /forum/printthread.php Disallow: /forum/private.php Disallow: /forum/profile.php Disallow: /forum/register.php Disallow: /forum/report.php Disallow: /forum/reputation.php Disallow: /forum/search.php Disallow: /forum/sendmessage.php Disallow: /forum/showgroups.php Disallow: /forum/subscription.php Disallow: /forum/threadrate.php Disallow: /forum/usercp.php Disallow: /forum/usernote.php |
#3
|
|||
|
|||
Quote:
|
#4
|
|||
|
|||
Just trying to catch on to make sure mine is configured properly. Why would you not list those two items? Not needed or, some specific reason?
|
#5
|
||||
|
||||
The robots.txt file is publicly viewable - has to be for the bots to "read." You'll be letting script kiddies know where the backend is located.
|
2 благодарности(ей) от: | ||
K4GAP, Krusty1231 |
#6
|
|||
|
|||
Quote:
Then here is my headache, restrict the bad guys and lose being found by folks looking for the type of content my site offers or, take a chance so I may gain more members? I'm going to start Googleing and hopefully there is a sweet spot to go with. Thanks |
#7
|
||||
|
||||
those dir are password protected im not worried so before you can login the back end you have to enter a custom username password for admincp and modcp dir
|
#8
|
|||
|
|||
I have mine pass worded as well but a good hacker can still hack any forum no matter what you have in place
|
#9
|
||||
|
||||
Quote:
Robots.txt is alot like gun laws - only the law abiding obey them. The bad bots just flat out ignore it. True story. EDIT to add: It's far more effective to just block the bad bots, using Simon Lloyd's "Ban Spiders by User Agent." One of the best Mods in the history of Mods. |
#10
|
||||
|
||||
If we're taking a poll, I have both those files in mine. It never occurred to me that a hacker would need that information for some nefarious purpose. I mean, once they get into the server they're going to know all that stuff anyway.
More important I think is keeping the db backed up locally regularly. Go ahead and hack my site; I'll just reinstall and be right back. |
|
|
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
More Information | |
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|