Automatic Thread Tagger for vB4.x

[Coroner]

Automatic Thread Tagger
This is the vB4 conversation of the original by Phalynx (with permission)

Description
When a user submits a new thread this modification will automatically take keywords from the thread title and use these as tags. You can use Automatic Thread Tagger to propose the user AJAX tags for his new thread, or it assigns new tags after saving the new thread. It can add the translated thread prefix to the tags.
Additionally, you can tag existing threads via maintenance and also scheduled tasks.

This modification is a successor to the terminated Automatic Thread Tagger by MrEyes:
https://vborg.vbsupport.ru/showthread.php?t=179927

As an example, if a user submits a thread with a title of:
"Fish Food for Cats!"

The thread will be automatically tagged with:

- Fish
- Food
- Cats

If the user also submits an actual tag of "Fish" this will not be duplicated. Any rules you have setup for tagging will be respected.
If you choose to do so this product will also automatically tag threads created by incoming RSS feeds.

Demo
I cannot show you the process of creation, but here is a list of tags generated by Auto Thread Tagger:
http://www.insideearth.net/tags.php?langid=5
http://www.insidesupcom.de/tags.php?langid=1

Automatic Tagging of existing threads
You can tag existing threads via maintenance or scheduled task/cron. They will be created with a special flag so they can be easily identified and deleted. Manual assigned tags are not touched. Maintenance is also working if Automatic Tagging is disabled via settings. Great if you want to test some settings. Automatic Tagging will take the date of the thread creation and also the userid of the creator. This process can be automated by running a scheduled job once a night.

Please keep in mind that tags that were proposed via AJAX are not tagged as auto tagged and therefore cannot be identified as such (and therefore not deleted automatically). If you want to retain the auto tagged flag you should disable AJAX and enable the tagging after the thread has been saved. As an alternative way you can also disable this and let new threads be tagged in the night from the scheduled job.

Installation
1. Upload all files from "upload" to your server, take care of the directory structure
2. Import "product-auto_thread_tagger110.xml" as a product, overwrite if it's already installed
3. Check settings
4. Run maintenance / Auto Tag Threads to tag existing threads (needed if you want to use the cron)

After install, and by default the modification is disabled, this will allow you to play around with configuration before switching it on.

Why thread title and not thread text?
Parsing the thread text for tags is an extremely unlikely addition as this would require some fairly heavy processing to ensure quality of tags.

What are Stopwords?
Stopwords is the name given to words which are filtered out prior to processing of tags.
The user Hostboard on vBulletin.org posted some resources regardings this:
https://vborg.vbsupport.ru/showpost.php?p=1603489&postcount=380

-------------------------------------------------------------

Text are taken from the original thread:
https://vborg.vbsupport.ru/showthread.php?t=201156

Thanks to Phalynx

[zelnik]

excellent been waiting for a vb4 version of this!

[merk_aus]

installed thanks

[zelnik]

Installed on my test site but the Ajax newthread autotag doesn't seem to be working?! but the cron set up worked fine when i ran it for the first time.

Settings set to "yes" are:

Enabled the complete auto tagger system, incl. maintenance?
Enabled the auto tagger for newthread?
Enabled the AJAX newthread?

Is there anything I'm doing wrong?

EDIT: Seems to be a conflict with VBSEO is there any chance you could look into this since vbseo is a very popular package?

[Adem GEN?]

Thanks, Installed

[Sayid]

tagged

Thanks

[BadgerDog]

Installed on 4.04pl1 with thanks and testing ... :up:

Regards,
Doug

Edit: I can't seem to find this under my Maintenance tab in our AdminCP? Is it somewhere else?

4. Run maintenance / Auto Tag Threads to tag existing threads (needed if you want to use the cron)

[BadgerDog]

Another question .... :)

We do have RSS feeds ...

The settings option says:


In order for RSS tagging to work you will have to manually edit one of the default vbulletin files. Please refer to the product page on vBulletin.org for further information.

I can't seem to find anywhere here what I need to change where to have this work? :confused:

Thanks ...

Regards,
Doug

[cyberchief]

I am sorry for being such a newb... but can anyone explain what this tagging is and what it is good for? is it for spiders, etc for web searches? Just have no clue what this tagging is.. thanks.

[mavigul]

i have a queastion

Does it work with vb 408

[rootsxrocks]

How do I merge or delete tags in mass ?

[OldSchoolDSL]

You currently have this modification tagged.

[rootsxrocks]

What I mean is this picked up the word SAN in all the football games and its all alone and large in the cloud, It seems like I was able to merge tags in the past but I forgot were to do it.

also it just picked up a phrase that I had not set the tags that were created were

christmas
so what does your cracker
treeThe title was So what does your "Cracker Christmas Tree Look Like?

Also if I run the cron 500 at a time can it find my archives beyond the last 500 and do them over time or will it always look at the last 500 post ?

[LLent]

does this have a select all option so that we may delete tags instead of checking each box...

[rootsxrocks]

not that I have found

[sticky]

Would like to install this but is there any way to clear all my old tags all at once?

[BadgerDog]

Another question .... :)

We do have RSS feeds ...

The settings option says:



I can't seem to find anywhere here what I need to change where to have this work? :confused:

Thanks ...

Regards,
Doug

Anyone able to help with this?

Thanks .. :)

Regards,
Doug

[OldSchoolDSL]

EDIT: Seems to be a conflict with VBSEO is there any chance you could look into this since vbseo is a very popular package?

I'm waiting for a fix on this

[mavigul]

installed

[linuxututs]

Would love to install also, but will wait on a fix for the conflict with VBSEO...

Thanks,

[emath]

Would love to install also, but will wait on a fix for the conflict with VBSEO...

Thanks,

same here.

[asylum119]

Didn't uninstall for me 4.1 PL2

[★Slap]

Installed on 4.04pl1 with thanks and testing ... :up:

Regards,
Doug

Edit: I can't seem to find this under my Maintenance tab in our AdminCP? Is it somewhere else?

4. Run maintenance / Auto Tag Threads to tag existing threads (needed if you want to use the cron)

It is there, the modification is working fine thanks :)

[mikeinjersey]

I was excited to see somebody recoded this. But am now kinda bummed that the support seems to be lacking.

I have vBSEO installed as well...and I guess i'll hold off installing until that bug is resolved.

maybe if we temporarily disable vbSEO before running the auto-tagging cron ?

[OldSchoolDSL]

I've not tested this, but would like to know what the conflict really is... The other poster only said there was a conflict, but never said what it was. Could be an easy fix.

[mikeinjersey]

I've not tested this, but would like to know what the conflict really is... The other poster only said there was a conflict, but never said what it was. Could be an easy fix.

I agree, sometimes people complain about nothing in these threads....meanwhile its these simple things that prevent a lot of us from installing the mod in the first place.

[phuong.bkhn]

I can't download the attach file

[OldSchoolDSL]

Installed and working

4.1 PL2 with vBSEO :cool:

Advise: Because of the way vBSEO works, I have decided NOT to use any of the AJAX option within this modification. Further, I also change the setting in vBulletin to only use the "less problematic" AJAX scripts (just to be sure).

AdminCP > General Settings > AJAX Features > Disable problematic features.

I have not tried it this modification with all AJAX features on and with the options within this modification.

[zelnik]

If you're using the cron way of tagging )because of vbseo) wouldn't that produce a seriously load on your server when its creating tags if you run a very busy forum? due to processing hundreds of posts in that 24hr period?

[RichieBoy67]

I have been trying this on a clients sites for a few weeks and I just finally got around to checking the tags and many are not even words but basically what ever anyone posted in a thread title....

This may work on an forum where users create very nice thread titles but the tags it is creating on this particular site are just awful.. Great concept though but very hard to implement in a useful way. To really create decent tags the whole thread would have to be scanned and yes, that would be very resource intensive..

A simple"select all" feature in the tag editing section would be a nice addition too..

I have to uninstall for now but I will be following this. I notice that it seems only members on web related sites tend to create tags. Most clients sites that are not web related will just ignore the tags option just about every time..

Thanks much for your hard work..
Rich

[schlottkej]

This would be awesome if you incorporated search phrases bringing the user to the page into the tags..

i.e... Fuzzy SEO Booster meets Auto Thread Tagger.... Imagine how nice tags for exact phrases in vB would be.

[horussjr]

work on 4.1.1 with vbseo and with no Disable AJAX Features. they are all active. the only option that i set to no is Enabled AJAX? because i don't understand what is doing

[Adampell]

Using this, I love it...

Thanks for this. Please keep it up to date when needed :)

[Chmura]

I'm not sure if I got this working correctly.
So I installed this on 4.1.1, enabled it in settings (enabled system, enabled, enabled ajax) also Turned on vb tagging. Then ran Auto Tag Threads maintenance, 45,000 threads later I went to see if it tagged any threads.
For some reason I can't see any tags, edit or add tags to a thread. I can however add tags to a new thread that I make, but the tag area doesn't autofill.
Am I missing something here? Are there more option that I need to enable???
I also have vbseo running if that matters.

[horussjr]

rebuld counters and wait for it to update the data

[combs]

You have to go to maintenance/update counters and scroll all the way down to Auto Tag Threads to get it to create new tags for the people asking. I couldn't find it either.

[traen]

Does it take some time for the thread tags to be updated? Just installed on 4.1.1.

[willy888]

works great 4.1.1 & greek lang
thanks man

[4WheelFreestyle]

Excellent Mod! Thank You!

[dr.tawy]

I have to write my review

This mod is a complete Crap

i installed it on my forum on my dedicated server

server loads went up to 7 & 9

editing thread is a joke it takes up to 120 seconds just to edit a thread

My rating 0/5

server loads returned to 0.3 - 0.49 - 0.52 the minute i uninstalled this modification

sorry but very poor coding dude

[BadgerDog]

This mod is a complete Crash

My rating 0/5

Well, I guess we're fortunate ... :D

It's been running just fine for months with no perceptible slow downs or complaints on our dedicated server with 16,000 registered members ... ;)

Regards,
Doug

[dr.tawy]

Well, I guess we're fortunate ... :D

It's been running just fine for months with no perceptible slow downs or complaints on our dedicated server with 16,000 registered members ... ;)

Regards,
Doug

16.000 :D i get those as visitors each day ;) ;)

[BadgerDog]

16.000 :D i get those as visitors each day ;) ;)

Sorry, didn't realize you were counting visitors too .... :D

We get an additional 18,000 - 21,000 guests and visitors every 24 hours, not counting bots ... ;)

Regards,
Doug

[dr.tawy]

Sorry, didn't realize you were counting visitors too .... :D

We get an additional 18,000 - 21,000 guests and visitors every 24 hours, not counting bots ... ;)

Regards,
Doug

LOL Good for you , i dont understand your point of taking a defensive attitude, is the mod your nephew or something?!! , i dont give a rat's ass what you are doing and what mods are working for you.!!

That still does not change the fact that this is a crappy mod, installed on other site vps cpu usage went up by complete 2 persistent with thread edit timeout ,

That's my experience with this mod , if you don't like BITE ME

Regards,
Tawy

[BadgerDog]

That's my experience with this mod , if you don't like BITE ME


Wow .. :eek:

Apparently, you a happy camper dishing out criticism of someone else's efforts, but get pretty insecure at being challenged by anyone who doesn't agree with you ... :D

Anyway, again for he benefit of others who may want to give this mod a fair try on a optimized vBulletin environment, it works fine on our dedicated server under heavy posting use. Give it a try and make up your own mind. ;)

Regards,
Doug

[ChromeDome]

Anyone using this on 4.1.3?

[MonkYZ]

Unfortunatelly, for me on 4.1.3 it does absolutely nothing :(

[MrD]

Hi,
run´s good in vb 4.1.3

[rootsxrocks]

works fine for me in 4.13 too Well upon looking RSS feeds are not tagging but that could be somethig else.

[fritz_0815]

works fine in 4.1.4

[MonkYZ]

Great mod! Can you please fix it so when the title from Plugins & Products is clicked to bring us to this page instead of the old 3.x version? I was panicked a little... thinking i am using a 3.x mod on a 4.x vB :)

[rootsxrocks]

LOL i have done that on a few occasions, momentary panic.

[MonkYZ]

Unfortunatelly i have found a big bug with this mod. When running Update Counters - Rebuild Thread Information and have this plugin active, for some forums i will get a freeze in the rebuild... the CPU for both Xeon's go to 100% usage, and after a while i'll get:
Fatal error: Maximum execution time of 2880 seconds exceeded in /home/console/public_html/forum/includes/functions_autotagger.php on line 310
This huge load made me disable it... Waiting for a fix/update. Thanks!

[Rahstyles]

hey man this dont work for 4.1.4 fix pleaseeee

[danswano]

Installed it on VB 4.3.1PL1 but couldn't see/find it in Options, any idea?

[Donkon]

Installed it on VB 4.3.1PL1 but couldn't see/find it in Options, any idea?
Hi, I also cannot find where the options are for this? any help?

[principino1984]

doesn't do anything to me... :( vb 4.1.4lp1

[danswano]

I found it, it was Tagging Options (Automatic Thread Tagger) not Automatic Thread Tagger alone.

the cron is working but the ajax new thread is not.

[Testworker]

Exactly! I have the same problem.

vB 4.1.4 PL1

[Merenguista]

thanks ..

[rootsxrocks]

I havn't had 4.1.4 running long enough to find out but Ill add my squeak to the wheel of progress. this is a great mod I don't want to lose it.
and I am really anxious to move on to 4.1.5

[archet1337]

Working great on my 4.1.4 board. Thanks :)

[rootsxrocks]

Working for me on 4.1.4 , thank you again

[emperatour]

Hello
I have problem with this plugin.
When it is active the Forum information ( under maintenance tab ) rebuild doesn't work , as just I disable this hack the rebuild will work fine.

is there any solution or new version or whatever it is ?

[The Rocketeer]

I never installed this since I thought this was not supported. So wanted to know, Does this mod still work well, doesn't slow things down or cause errors?

I am running 4.1.5

:D

[CJFactor]

I installed it but in vBulletin Options, i cannot see the settings for it.

v4.1.5

Edit: Found it, appears to work fine!

[elcoxx]

Hi, really nice add-on

How Can I filter numbers?, I don't Wanna Tags like 100 200 400 etc. I had to delete one by one.

Thanks.

[davut_c20]

thank you very much ;)

[mostafa10601]

this mod not work properly for vb4.8

system cannot create new tag for repaire tools..!

[uninvited13th]

this mod not work properly for vb4.8

system cannot create new tag for repaire tools..!

what do you mean?? works fine for me :D

[mostafa10601]

go to this address ...

Maintenance -> Update Counters -> add new tags to forum with Automatic Thread Tagger

some error occure.!

[rootsxrocks]

Starting with 4.18 posibly 4.15 I have developed a problem that I just Isolated to this Mod. I get a server 500 error when I try to merge threads. Is there a work arround, I think I have my Max # tags set high enough

[sadiq6210]

Cannot merge two thread after update to 4.1.8
We should disable this mod to fix the problem

Any update?

[rootsxrocks]

Glad I am not alone , Hope a solution is forthcoming

[jpbryan]

EXCELLENT - Installed - Voted MOTH

[Welshy2008]

Does this work on 4.1.10, guys?

[sadiq6210]

Does this work on 4.1.10, guys?

Yes but you will face a problem
You will not be able to merge the threads when you active this mod.

[Mr.Danko Jones]

I looked over some of my latest posts and didn't see anything tagged at all -- infact, by removing tags first I lost tags. Anyone else experience this problem?

Much thanks!

[FreshFroot]

well since this is not supported.. we will have to fix it ourselves

[ptceuro]

installed thanks

[tmhazzazi]

it seems very nice, I will have a try now!

thanx in advance

[CaneInsider]

I am using this just fine on 4.1.12 PL 1

[final kaoss]

So am I on the newest vb release.

[Naijasite]

installed on 4.2.0. Tag RSS Feeds?
If yes the auto tagger will also attempt to tag incoming RSS feeds.

In order for RSS tagging to work you will have to manually edit one of the default vbulletin files. Please refer to the product page on vBulletin.org for further information.

Please how do autoTag Rss feed?

[JetLee]

I looked over some of my latest posts and didn't see anything tagged at all -- infact, by removing tags first I lost tags. Anyone else experience this problem?

Much thanks!

Same thing happened to me on 4.2.0 PL2

I want my tags back!

[Akyeame Kwame]

installed on 4.2.0. Tag RSS Feeds?
If yes the auto tagger will also attempt to tag incoming RSS feeds.

In order for RSS tagging to work you will have to manually edit one of the default vbulletin files. Please refer to the product page on vBulletin.org for further information.

Please how do autoTag Rss feed?

Same thing here. I'd like to know how to autoTag RSS feeds. Since this isn't supported, is there anyone who knows how to do the necessary template edit. I did a search in the mod for feeds and nothing came up on the issue.

[Akyeame Kwame]

I'm getting this in with a go advanced reply to a thread:

Deprecated: Function split() is deprecated in /home/************/public_html/forums/includes/functions_autotagger.php on line 389

PHP 5.3.0. Any workaround?

********************************************
Found the answer: split -> explode
http://forums.phpfreaks.com/topic/176877-solved-deprecated-function-split-is-deprecated/#entry932627

Attaching the updated file

[CybertronWizard]

Thanks a lot.Marked as Installed

[dethfire]

Was working and now it's broken. I was half way done running the cron. Now it says it's done, but there are plenty of threads without tags that could have tags.

[persianpros]

something is wrong with this plugin on vb 4.2.2 :

Warning: Function split() is deprecated in /public_html/includes/functions_autotagger.php on line 191

[ozzy47]

Warning: Assigning the return value of new by reference is deprecated in ....Bla Bla Bla

How to fix.

Open the file, includes/functions_autotagger.php on line 191, in that file find the following:

$excludedForums = split('\|', $vbulletin->options['autotag_exclude_forums']);

Replace with:
$excludedForums = explode('\|', $vbulletin->options['autotag_exclude_forums']);

Find:
$excludedUsers = split('\|', $vbulletin->options['autotag_exclude_users']);

Replace it with this:

$excludedUsers = explode('\|', $vbulletin->options['autotag_exclude_users']);

[sadiq6210]

I got this errors in 4.2.2 / php5.4

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 15

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 23

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 32

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 33

[mooncreek]

Getting same errors. Would appreciate update for 4.2.2

Noticed that when editing posts, errors do not allow post to load with edits.

[tbworld]

@Sadig6210, @Mooncreek:

Please read the modification's thread before posting. @Ozzy47 graciously posted several fixes in post #91, https://vborg.vbsupport.ru/showpost.php?p=2451721&postcount=91. (https://vborg.vbsupport.ru/showpost.php?p=2451721&postcount=91ttp://)

The author has not been online since 2011.

[MrD]

Hi,
i got an Error that the split function is deprecated.
File is includes/functions_autotagger.php Line 394
$parts = split("'=>'", $filterReplaceItems[$x]);

Can i replace all split to explode?

I ask Phalynx for Permission and Coroner for Coding in 2010 for that Addon.

[rootsxrocks]

Warning: Assigning the return value of new by reference is deprecated in ....Bla Bla Bla

How to fix.

Open the file, includes/functions_autotagger.php on line 191, in that file find the following:

$excludedForums = split('\|', $vbulletin->options['autotag_exclude_forums']);Replace with:
$excludedForums = explode('\|', $vbulletin->options['autotag_exclude_forums']);Find:
$excludedUsers = split('\|', $vbulletin->options['autotag_exclude_users']);Replace it with this:

$excludedUsers = explode('\|', $vbulletin->options['autotag_exclude_users']);

I just wanted to add I had done this edit without success and turned the mod off till I could get back to it , but just went back and changed several more instances of the split to explode and it appears to be working.
It was hard to catch the errors shown before the page changed. I ignored other lines that included this $subjectTopreg_split(kens = '/\s(?=([^"]*"[^"]*"[^"]*)*$|[^"]*$)/', $title, -1, PREG_SPLIT_NO_EMPTY);

Other lines changed include but are not limited to
line 338
line 421
line 389
line 375
line 394

[MrD]

Exclude from Forums are not Working.
I have a lot of ID´s in the Settings, but the Forums are all Tagged.
Maybe a User or Coder can Fix it?

[ITDarasgah]

I have done
https://vborg.vbsupport.ru/showpost.php?p=2451721&postcount=91
but still found
https://vborg.vbsupport.ru/showpost.php?p=2456893&postcount=92

any idea?

[rootsxrocks]

Exclude from Forums are not Working.
I have a lot of ID?s in the Settings, but the Forums are all Tagged.
Maybe a User or Coder can Fix it?
I was able to exclude 1 forum delete all tags and re run and it worked fine and did not retag all the weather threads

[rootsxrocks]

I got this errors in 4.2.2 / php5.4
this is the lines as they are in my file im running PHP Version 5.4.24 and it seems to be working without errors but i may have just missed them.



Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 15
if (intval($thread['threadid']) == 0)
Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 23
WHERE t.contentid=".$thread['threadid']." AND autotag=1
Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 32
$vbulletin->db->query_write("DELETE FROM " . TABLE_PREFIX . "tagcontent WHERE autotag=1 AND contentid=" . $thread['threadid']);
Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 33
$vbulletin->db->query_write("UPDATE " . TABLE_PREFIX . "thread SET autoskip=0 WHERE threadid=" . $thread['threadid']);

[gbicar]

I got this errors in 4.2.2 / php5.4


Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 15

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 23

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 32

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 33

same mistakes, I tried changing ozzy but has no effect

the plugin that generates the error is this
Automatic Thread Tagger threaddata_postsave

[Phaedrus]

split/explode isn't enough to get rid of all the errors. This causes my forum to freeze on editing a post.

[Phaedrus]

Uninstalled but tagged just in case it works later. Even with the updates listed previously in this thread this caused errors on my forum. Tried the other auto tagger, but it too caused errors. 4.2.2 PL1

Here's to hoping to update this later.

[krimznheidiz]

Is this working for 4.2.2?

[pablodip]

Thanks you ozzy47, is mod run good 4.2.2 :)

EDIT:

Hi, I've had to disable as it brought me problems in threads, when a user edits and gives branded store stays .. and have to refresh the page to see the results

[tini_lam]

I got this errors in 4.2.2 / php5.4


Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 15

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 23

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 32

Warning: Illegal string offset 'threadid' in ..../includes/functions_autotagger.php on line 33

I have try edit functions_autotagger.php on line 15
edit
if (intval($thread['threadid']) == 0)
Replace with:
if (intval($threadinfo['threadid']) == 0)

wow, it great, not error :) you can try edit same on line 23, 32, 33, it well work

[Socialvb]

I was trying to use on my forum but when i create thread, the automatic tags are not added. Why? Someone solved the problem?

[RawBoard]

I have try edit functions_autotagger.php on line 15
edit
if (intval($thread['threadid']) == 0)
Replace with:
if (intval($threadinfo['threadid']) == 0)

wow, it great, not error :) you can try edit same on line 23, 32, 33, it well work

thanks work is not error :)

[jim@ars]

Is there any way, out of the box, to prevent tagging in a particular forum or do I need to put on my PHP hat?

[mdawg]

Does this work with vb 4.2.5 running PhP 7?

[final kaoss]

Does this work with vb 4.2.5 running PhP 7?

I've noticed it stopped working after enabling php 7.1 myself.