i have VB 4.2.1 with vbseo and vbseo site map next i am looking to make sure i have good robots txt file .
PHP Code:
User-agent: Mediapartners-Google
Disallow:
User-agent: BoardTracker
Disallow: /
User-agent: Fasterfox
Disallow: /
User-agent: *
Crawl-delay: 30
Disallow: /forums/announcement.php
Disallow: /forums/attachment.php
Disallow: /forums/avatar.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/faq.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/member2.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/private2.php
Disallow: /forums/profile.php
Disallow: /forums/report.php
Disallow: /forums/register.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/sendtofriend.php
Disallow: /forums/subscription.php
Disallow: /forums/subscriptions.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/admin/
Disallow: /forums/images/
Disallow: /forums/mod/
Disallow: /images
what you guys think good ?
09-13-2013, 11:07 AM
Need Good Robots For My Forum
Linear Mode
