PDA

View Full Version : Administrative and Maintenance Tools - Linkchecker Bot


Web4xs
08-03-2009, 10:00 PM
===========
DESCRIPTION
===========

1) Checks Rapidshare.de , Rapidshare.com , Sendspace.com , Megaupload.com , Depositfiles.com and Mediafire.com links using cURL.
2) Works for post with all BBCodes.
3) Bins the post if more than specified percent of dead links are found , pms the user about it and posts in that topic
4) If all links are alive it adds specified message at the end of the post and the description.
5) If some links are live and some are dead i.e less than specified % , it makes a thread in a specified forum about it
6)Has a debug mode, to help you debug the errors.
7)Bot doesn't timeout due to MySQL timeout or PHP timeout.
8)It is a product, can be imported and settings can be changed easily.
9)Methods are accessible with keywords.

==============
Installation How-To
==============

1. Upload bot.php to your root folder where your VB installation is
2. Change your mysql in bot.php
$config['Database']['dbname'] = 'CHANGE DBNAME';
$config['MasterServer']['username'] = 'CHANGE DBUSER';
$config['MasterServer']['password'] = 'CHANGE PASSWD';
$config['Database']['tableprefix'] = 'CHANGE PREFIX';
2. Goto your ACP and go to 'Plugins & Products' and then click on 'Manage Products'
3. In the top box eneter the location of the product-link_bot.xml file on your computer
and then click the 'Import' button.
4. Add New Scheduled TaskYou
5. have just installed the Link Checker bot.
6. If you had older version of the bot, delete bot.php (or the folder) and replace it by new one.

==================================
Setting up and configuring your Link Checker
==================================

1. Create a new user that will be used for your Link Checker Bot. Make sure the bot has
the appropriate permissions for where it will be posting. (ie, VIP/Private forums)
2. Create the forums you will be using for good and bad links if you have not done so already.
3. Goto vBulletin Opions and select the Web4xs LinkChecker Bot.
4. All the options/setting are pretty self explanatory and each option has the description
of what the setting are for and do. Refer the the bottow of this Read Me of finding the
correct IDs you will need if you are not sure where to look.
5. Once you have everything set up hit the save button at the bottom.

======
Security
======
1. For security reasons, it is highly recommended you rename your bot to something else for instance yourname.php

======================
Running your Link Checker Bot
======================

1. You can only run the bot by setting up a Scheduled Task on Vbulletin =========================
How to find all of your needed IDs.
=========================

How to find your forum ID
Just goto the forum in question and the URL will look like the one below.

http://www.yourwebsite.com/forumdisplay.php?f=20 <--- The number at the end of the URL
will be the forum ID. In this example
it is 20.

How to find your user ID
Find the user that is going to be your bot and click on the user name.
Now look at the URL in the address bar. It should look something like the one below

http://www.yourwebsite.com/member.php?u=1 <--- The number at the end of the URL will be
the user ID. In this example the user ID
is 1.

Linkchecker Bot is based on the old mod VB Linkchecker..
Web4xs Linkchecker Bot will be update always to new versions.

Tickhi
08-04-2009, 11:07 AM
Parse error: syntax error, unexpected $end in /home/******/public_html/bot.php on line 423

Web4xs
08-04-2009, 11:29 AM
Parse error: syntax error, unexpected $end in /home/******/public_html/bot.php on line 423

Yes right was forget something.. open bot.php

and add } on the bottem from the file before ?>

File in zip is fixed now..

elenh
08-04-2009, 11:48 AM
Very nice work.To many people need a new version for link checker bot.
But why you dont add a option for dead thread moving to a specific forum?Then will be perfect the hack.

Any way thanks.INSTALLED & NOMINATED

elenh
08-04-2009, 11:49 AM
By the way the screenshots is not working reupload if you can pls.

Web4xs
08-04-2009, 11:53 AM
Very nice work.To many people need a new version for link checker bot.
But why you dont add a option for dead thread moving to a specific forum?Then will be perfect the hack.

Any way thanks.INSTALLED & NOMINATED

We have that :)

Trash Forum
Enter the ID of the forum which is your TrashCan/Bin. This is where the bot will move all the dead topics to.

Web4xs
08-04-2009, 11:56 AM
By the way the screenshots is not working reupload if you can pls.

I have upload again :)

elenh
08-04-2009, 12:34 PM
You are the best.I hope everybody will click INSTALLED & NOMINATED

Hornstar
08-04-2009, 07:04 PM
Nice work. I've always wanted to install one of these but they always appeared a bit buggy, yours seems great. thanks.

Web4xs
08-06-2009, 08:28 AM
Nice work. I've always wanted to install one of these but they always appeared a bit buggy, yours seems great. thanks.

Thanks :)
We add soon more download links..

esperone
08-06-2009, 09:17 AM
looking good

thedvs
08-06-2009, 11:34 AM
does this bot check multiple posts in 1 thread?

say someone posts 1 topic with links, then someone replies with more links.. etc

Web4xs
08-06-2009, 02:52 PM
does this bot check multiple posts in 1 thread?

say someone posts 1 topic with links, then someone replies with more links.. etc

Yes all links he check's.
Also when you have 1000 links in one post.

1uxkz
08-06-2009, 07:19 PM
Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '))' at line 1on query :SELECT `threadid` ,`firstpostid`, `forumid`, `replycount`, `title` FROM `CHANGE PREFIXthread` WHERE `time_check` = '0' AND `ignore_check` = '0' AND (`forumid` NOT IN ())

any idea what could be causing this?

dancue
08-06-2009, 08:44 PM
I'm getting a MySQL error:

Database error in vBulletin 3.8.3:

Invalid SQL:

SELECT
userfield.*, usertextfield.*, user.*, UNIX_TIMESTAMP(passworddate) AS passworddate, user.languageid AS saved_languageid,
IF(displaygroupid=0, user.usergroupid, displaygroupid) AS displaygroupid
, ppgal_user.*,mgcugp.mgc_cb_evo_default_color,mgcug p.mgc_cb_evo_chanid
FROM user AS user
LEFT JOIN userfield AS userfield ON (user.userid = userfield.userid)
LEFT JOIN usertextfield AS usertextfield ON (usertextfield.userid = user.userid)

LEFT JOIN ppgal_user AS ppgal_user ON (ppgal_user.userid = user.userid) LEFT JOIN usergroup AS mgcugp ON (user.usergroupid=mgcugp.usergroupid)
WHERE user.userid = 4829;

MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Thursday, August 6th 2009 @ 03:23:12 PM
Error Date : Thursday, August 6th 2009 @ 03:26:33 PM
Script : http://*****.com/forum/admincp/cronadmin.php?do=runcron&cronid=78
Referrer : http://*****.com/forum/admincp/cronadmin.php?do=modify
IP Address : **********
Username : Crisis
Classname : vB_Database
MySQL Version :

dancue
08-06-2009, 08:51 PM
It's also marking megaupload password protected files as dead.

here is an example of one.
http://www.megaupload.com/?d=R0KZJ8UV

Maybe if the bot were allowed to enter a password that would help. The password could be defined in admincp. We would have to be able to enter multiple passwords.

dancue
08-06-2009, 09:01 PM
I had to uninstall. I was getting posts moved to the trash that were not supposed to be there.

Most of them were because they were password protected.

The only links it would check were the non-hidden ones.

If I placed a link within a charge tag (vbcredits hide hack) then it would not scan it. Either that, or it did not check it if there was an ad pop-up like this link.

http://www.megaupload.com/?d=PUSJ59KZ (http://b4eb9708.linkbucks.com/url/http://www.megaupload.com/?d=PUSJ59KZ)

Web4xs
08-07-2009, 11:52 AM
Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '))' at line 1on query :SELECT `threadid` ,`firstpostid`, `forumid`, `replycount`, `title` FROM `CHANGE PREFIXthread` WHERE `time_check` = '0' AND `ignore_check` = '0' AND (`forumid` NOT IN ())

any idea what could be causing this?

You need to edit the php file and change the --> PREFIX

Web4xs
08-07-2009, 11:54 AM
I going to look to that.. I have not problems with password protected files..
You hear from me soon.

dancue
08-07-2009, 11:57 AM
I going to look to that.. I have not problems with password protected files..
You hear from me soon.

It could be that they have linkbucks ads.

elenh
08-08-2009, 10:31 PM
Looks like the sheduled task for checker bot is not working... Have any body else the same problem?

donal
08-09-2009, 02:48 AM
Can this be used to check images from other servers which are posted at my board using [img] tag ?

Medtech
08-09-2009, 04:36 AM
Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '))' at line 1on query :SELECT `threadid` ,`firstpostid`, `forumid`, `replycount`, `title` FROM `thread` WHERE `time_check` = '0' AND `ignore_check` = '0' AND (`forumid` NOT IN ())

i am running mysqli, not mysql, where do i change this?

Manoel J?nior
08-10-2009, 01:00 AM
Not functionally with vBSEO/C-Logic.

relaxiha
08-11-2009, 03:13 AM
Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '))' at line 1on query :SELECT `threadid` ,`firstpostid`, `forumid`, `replycount`, `title` FROM `thread` WHERE `time_check` = '0' AND `ignore_check` = '0' AND (`forumid` NOT IN ())

esperone
08-11-2009, 06:10 AM
Not functionally with vBSEO/C-Logic.

works fine on vbseo.

i have also had the problem with scheduling not working though

webgroup
08-18-2009, 03:43 AM
It's also marking megaupload password protected files as dead.

here is an example of one.
http://www.megaupload.com/?d=R0KZJ8UV

Maybe if the bot were allowed to enter a password that would help. The password could be defined in admincp. We would have to be able to enter multiple passwords.


that would be a nightmare if you have a big forum.

other options should be considered to address this.

webgroup
08-18-2009, 03:45 AM
This is what I get when the shcheduled task runs:

Link Checker Bot

Warning: session_start() [function.session-start]: Cannot send session cookie - headers already sent by (output started at [path]/includes/adminfunctions.php:279) in [path]/bot.php on line 2

Warning: session_start() [function.session-start]: Cannot send session cache limiter - headers already sent (output started at [path]/includes/adminfunctions.php:279) in [path]/bot.php on line 2
Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '))' at line 1on query :SELECT `threadid` ,`firstpostid`, `forumid`, `replycount`, `title` FROM `vbnewthread` WHERE `time_check` = '0' AND `ignore_check` = '0' AND (`forumid` NOT IN ())

dancue
08-18-2009, 12:27 PM
It seems that we will never get a link checker bot that works...

I have someone willing to make one for me, but the price is really high. Maybe if we put some money together we can get this made for us. Anyone interested can pm me. I'll give you the details.

R*NightOwl
08-20-2009, 04:27 AM
i fixed some problems with this bot, first i removed the session_start because that doesn't seem to be needed at all,
now i am working on cycling the topics because atm the mysql reconnection stuff is failing on me..

LordVader
08-24-2009, 03:02 PM
Woo Hoo

Thankyou Thankyou Thankyou

Did i say Thanks ... ? ... lol

It seems to work great on my 3.84 installation exept for one silly little problem.

I set it up to run a cron job every 59:mins but it never seems to run, but if i manually click the Run Now button it looks through the forums i listed & sends anything it finds to the recycle bin.

As i said it's no biggie as it works fine when i call it up manually.

One thing that i really want to change is the text below.

(( Links checked on 24/08/09 by link checker bot ))
Please could you tell me where i edit that text

Again i thank you for sharing the first ever link checker i have ever managed to install & get working, and believe me i have tried a few.

Nominated For M.O.T.M

Will.

LordVader
08-24-2009, 03:23 PM
Ohh

And one other thing, you said you would be working on updating this so i was wondering if there would be any chance you could add http://hotfile.com/ to the list of checkable links.

Thanks

Will.

LordVader
08-24-2009, 04:26 PM
Ooops spoke to soon

Oh the joys of mysql ... argh, i hate mysql :mad:

MySQL Error : MySQL server has gone away
Error Number : 2006
Request Date : Monday, August 24th 2009 @ 12:43:19 PM
Error Date : Monday, August 24th 2009 @ 12:46:29 PM
Script : http://www.*********.com/forum/admincp/cronadmin.php?do=runcron&cronid=25
Referrer : http://www.*********.com/forum/admincp/cronadmin.php?do=modify
IP Address : **.**.**.**
Username : Lord-Vader
Classname : vB_Database
MySQL Version :

Anyone got any clues on how to fix this ?

Will.

webgroup
08-29-2009, 10:10 PM
It seems that we will never get a link checker bot that works...

I have someone willing to make one for me, but the price is really high. Maybe if we put some money together we can get this made for us. Anyone interested can pm me. I'll give you the details.

Yes, I think this is the best option

elenh
09-23-2009, 09:07 PM
how do i change the options from the defaults (removing the dead links) to removing the active links?

I want to clear one of my sections..

thanks again!

elenh
09-27-2009, 08:18 PM
This is the second link checker bot who is posted here and the both author's give's not support and they last activity of the coder was before 2 months.
You start to make something good for the community ,you make us happy and at the end the results is a dead topic..
Why you release something where you can not give support and you let us posting and posting without answers.
Call a moderator to delete this topic if you will not spend your time again here.
In the begin of the topic the topic says that is supported but this is lie..

CLICKED UNISTALLED & CLEAR NOMINATION

Thank you.

dancue
11-10-2009, 03:15 PM
I've talked to someone already and paid for the product to be made. He has a lite version being released soon and a pro version available through his website.

Once I've tested the products out they will be released to the public. So far so good.

Kangaroo666
12-22-2009, 10:10 AM
@ dancue, any updates on the link checker product m8?

stamos2003
01-19-2010, 09:40 AM
this is the exactly the same bot like here:
https://vborg.vbsupport.ru/showthread.php?t=190407
just you put your name on it, are you kidding?

giotis9
02-06-2010, 04:29 PM
I installed it and it messed up all my posts!!!!!!! All the letters except english turned up like ????????. Its a disaster!!!!!!!!!!!!!!!

Mark_Zuckerberg
01-05-2012, 09:30 PM
how can i add other sites links in this mod like you have given for only few sites if some one have to add fileserve filesonic and others then how can we modify it.