vB 3.8.5 and robots.txt

[Apexi]

Well the never ending story. Done alot of reading in older threads and everyone tells a different story.

I stumble upon robots.txt for the first time today since i'm setting up Google Adsense. So how should a robots.txt file looks like for a standard/default vB 3.8.5 forum?

Three things i need help with

*I've read is that I need to change the paths in the file if my forum is in a directory called 'forums' sitting in the root. Is that correct?
Like this Disallow: /forum/attachments/

*Never include /admincp/ in robots.txt file since you tell everyone where your admincp directories are located. Correct?

*And where can i find my XNL sitemap file? How should the url look like? In vB4 you can choose the dir. in options, but not in 3.8.5

[Chris8]

Well the never ending story. Done alot of reading in older threads and everyone tells a different story.

I stumble upon robots.txt for the first time today since i'm setting up Google Adsense. So how should a robots.txt file looks like for a standard/default vB 3.8.5 forum?

Three things i need help with

*I've read is that I need to change the paths in the file if my forum is in a directory called 'forums' sitting in the root. Is that correct?
Like this Disallow: /forum/attachments/


Yeah, you need to include the whole path, so yeah /forums/attachments/ as the robots.txt is located always in root directory.


*Never include /admincp/ in robots.txt file since you tell everyone where your admincp directories are located. Correct?


Yeah, and use htpasswd to lock access to it, just in case.


*And where can i find my XNL sitemap file? How should the url look like? In vB4 you can choose the dir. in options, but not in 3.8.5

Not sure about it. I don't think there is XML sitemap file in 3.8.X default installation but I might be wrong.