New Posting Features - Automatic Thread Tagger From Post Content and Title

VERSION 4.1.2 RELEASED - prepare for real revolution in tags!

What this mod do:
Each time new post arrives (as new thread or reply) this mod will automatically add tags according to post content, title and existing tags in forum. It will also automatically add new tags to old threads.

In details:
It will add only tags which already exists in your forum if it will be included in your post title or content.

It works simple - if title or content includes tag word, then tag will be added to this thread.
Simple and fast. And also have lot of sophisticated functionalities - see below

In more details :
I.e. if you already have in forum such tags as autohypnosis, hypnosis, nlp, and submodalities. Now someone will write post like this (as reply or new thread):

Title: Hello NLP fans
Content: I like to use autohypnosis!

So this mod will automatically add for thread where post is written such tags: autohypnosis, nlp

nlp - cause it is in title; autohypnosis - cause it is in content

hypnosis is included in word autohypnosis, but this mod is smart enough to see that there is no separate word hypnosis neither in title nor in content - so it is not added
submodalities and any other existing tag is not added here, cause it is not included either in content or title of new post.

In more details with sophisticated functionalities :
Also this mod will add tags propositions for each word existing in post title which is not a tag yet. So for this example 2 tags propositions will be added: hello and fans.
You can approve tags propositions manually or set quarantine time after which propositions will automaticaly change to tags.

This mod allows you to define related words for each tag. It means that now tag word don't have to be included in post - it is enough if any of related words is included to add tag :up:
I.e. if you have tag cat then you can define for it related words like: cats,kitty,kitties,lion,tiger. Now if any of those words appears in post then tag cat will be added

This is really great if you want have tag added no matter does word will be used singular or plural, or in which time it will be or maybe in your language you have to inflect words. Like in Polish we have: krowa, krowy, krowie, krową - for same word krowa. Now no matter how is inflected tag word in post and no matter in which language is your forum - this mod will appropriately add this tag!

You can also use this functionality to define tag packs. I.e. I want that every time when someone is writing about hypnosis or trans, booth hypnosis and trans tags to be added. In such case I simply define trans as related word for hypnosis tag and hypnosis as related word for trans tag

This mod also allows you to set default tags for forum. So each new and old thread in forum will be tagged by those tags It could be very useful - for example I have forum with good news and I want each thread in this forum to be tagged by newspaper, and news - so I simply write it in forum configuration and mod cares about everything! Is it great or just amazing?

Also with this mod You can just click one link in menu and it will add tags to all already existing threads. So If you was happy that now all new posts will be properly tagged, I have great news for you - now all threads will be properly tagged - even old one

Also every day this mod will automatically check does some new tags appears and in such case it will add new tags to all already existing threads which includes this keyword in content or title. So now not only all threads will be properly tagged for moment when you use functionality described above. It will keep all tags in all threads up to date continuously



Features:

• Automatically adds tags to new posts/threads according to content, title and already existing tags in forum.
• Allows you to set default tags for forum and will create those tags if don't exists
• Tags related words functionality
• Automatically creates tags propositions according to posts titles for words which are not tags yet
• Configurable creation tags proposition (on/off)
• Configurable quarantine time for tags propositions - after this time propositins will be automatically changed to tags (can be dissabled)
• Allows manually approve and disapprove tags propositions
• Aliases for setting tag min and max length with this mod options
• Respects tag min and max length settings when creates tags propositions
• Configurable set of ignored words during tags propositions creation
• Allows you to create tags propositions from all posts titles
• You can configure this mod to work only for new threads, or for each post - even replies.
• Sophisticated keyword searching (will not add as tags words included in other words)
• Configurable words separators for sophisticated searching
• Automatically adds new tags to old threads (daily)
• Allows you to add tags to all threads
• Allows you to clear all tags associations to threads
• Gives you alias to Tags form, so you can easy manage them
• Gives you alias to Forum Manager form, so you can easily set default tags for forum
• Creates new tags if defined ad default tags for forum and not exists
• Allows you to add new tag and related words in one step.
• You can configure, to how many threads should be added tags, per one page of execution of "Add tags to all threads" task
• Respects Maximum Tags per Thread setting
• Gives you alias to set native vBulletin Maximum Tags per Thread setting in one menu with other settings of this mod
• Version checking supported

And commercial :
It is very useful for everyone who wants to keep an eye on tags, and doesn't want just each word from title automatically added.

So with this mod you know that only valuable tags are automatically added.

In some languages (like mine - Polish) same word is different according to whole sentence - i.e. in English is just cow and cows - in Polish we have: krowa, krowy, krowie, krową... And I didn't want all of those to make garbage of my tags, so I was not able to mod which was just adding every word which appears in title - it was too weak for me. I really wan to have only valuable tags ant that’s why I created this mod
Also with this mod thanks to related words functionality I'm sure that tag will be added no matter in which person, time or quantity the tag word is used in post! And also allows me to create groups of related tags!

When I wrote post I just to add tags myself, but also had to do this for other users who just add post and doesn't care about tags.
You know that? Now this mod will do it for you and also you will forget about tags writing, because after some time in most forums new tags are very rare, and mostly are used tags which already exist.

It was very important for me to have such solution and I want to share Enjoy!

NOTE if you made update from version older than 4.1.1 then please read first this message before update: additional update steps
In other cases - just install/update to last release

Version History:
4.1.3 Small fix for php4 users. Do not need to update if you have working version
4.1.2 Bug corrected for related words finished with comma
4.1.1 Removed aliases for native vBulletin settings.
4.1.0 Respects tag min and max length settings when creates tags propositions, also aliases for this settings added to this mod settings group. Fixed bug for changing propositions to tags with special characters.
4.0.1 Solved bug in creation propositions for all posts with option threads only
4.0.0 Mod creates new tags - first as tags propositions, after that as tags (automatically or after manual approve - configurable). Also added set of configuration options to handle tags propositions and option to add tags propositions from titles of all posts. See first post to know how exactly works tags propositions.
3.0.1 Small bug fixed in alias
3.0.0 Related words functionality, sophisticated searching, default forum tags and others
NOTE: upgrading from version 1.X.X or 2.X.X to 3.0.X you have to uninstall previous version! In Admin CP -> Plugins & Products -> Manage Products
2.1.0 Mod respects native vBulletin Maximum Tags per Thread setting
2.0.2 Added param which allows to configure, to how many threads should be added tags, per one page of execution of "Add tags to all threads" task.
2.0.1 Small bug fixed with table prefixes.
2.0.0 Added scheduled task, which adds new tags to old posts. Also added function allowing to add tags to all existing posts.
1.1.0 Added option which allows to choose do you want this mod works only for new threads or for each post - even replies. By default it works for all new posts.
1.0.0 Just great mod released

Installation:
1. Download
zip file from here (download last release - see index at the end of file name - nothing more - other files are only history)
2. Upload
to your forum directory everything what is included in upload directory
3. Import
in vB Admin CP -> Plugins & Products -> Manage Products -> Add/Import Product -> Choose product file, set Allow Overwrite to yes and click Import
4. Click : "Mark as Installed" Thanks!
5. (Optional) Customize settings
in Admin CP -> Thread Tagger -> Options
6. (Optional) Define default tags for forums
in Admin CP -> Thread Tagger -> Forum Manager choose forum and find Automatic Thread Tagger From Post Content and Title settings (see screenshots)
7. (Optional) Define tag related words
see Thread Tagger menu. Can be done in any time and in parts.
8. (Optional) Clear all tags assotiations
see Thread Tagger menu.
9. (Optional) Add tags to old threads
Admin CP -> Thread Tagger -> Add Tags To All Threads (NOTE: if you want to do this it is advised to make clean-up in your tags, especially if you had other - the old tag adder which was adding every word from title and probably already made a garbage in your tags)

[NLP-er]

Originally Posted by turbosatan

how do i delete the tags?

this seems to have just created hundreds and hundreds of totally nonsense tags .

the options menu item doesn't show anything in the backend either

How do i remove all the tags it has created?

This mod creates only tags which you approve - manually or setting quarantine time. So you have only what you approved

Please read configuration options descriptions carefully and set mod to work as you want it to work. You can easily configure it to not create any new tags and only associate already existing with new posts. Also read mod description where you have noted which vB native options are respected by this mod

You can delete tags by Admin CP, or by SQL. In 2nd case you can use query like this (I didn't check it so do corrections yourself if there is some typo or syntax issue):

DELETE tag FROM tag INNER JOIN tag_proposition WHERE tag_proposition.status=4 and tag_proposition.tagtext=tag.tagtext

This will remove only tags which was made automatically after quarantine (status = 4). If you want to remove also propositions (will be proposed again if occurs in new posts), then execute this query:

DELETE tag, tag_proposition FROM tag INNER JOIN tag_proposition WHERE tag_proposition.status=4 and tag_proposition.tagtext=tag.tagtext

Note that it is wise to clear all tags associations after that and generate it again (see mod options). And it it even wiser to close forum for minute, clear all associations, delete automatically created tags, generate association again and turn forum on

[turbosatan]

Originally Posted by NLP-er

This mod creates only tags which you approve - manually or setting quarantine time. So you have only what you approved

i just clicked on the tag all previous threads one to tag all the previous threads but clearly there is a lot more sertup to do first.

Update

I have run both sql queries and it says rows affected = 0 on both of them

You mention that tags can be removed in admin cp. Where?

The options menu in the thread tagger doesnt seemn to work at all it is just blank on my install

[NLP-er]

Originally Posted by turbosatan

i just clicked on the tag all previous threads one to tag all the previous threads but clearly there is a lot more sertup to do first.

Update

I have run both sql queries and it says rows affected = 0 on both of them

You mention that tags can be removed in admin cp. Where?

The options menu in the thread tagger doesnt seemn to work at all it is just blank on my install

You wrote that my mod creates you lot of new tags - and now you are writing that no tag was created by this mod. I think that you mislead tag with tag association. You can clear all associations easily by mod in Admin CP. Note that it will not remove any tag, but no tag will be associated to any thread anymore. You can then set max tags limit for thread and after that generate associations by mod

[turbosatan]

Originally Posted by NLP-er

You wrote that my mod creates you lot of new tags - and now you are writing that no tag was created by this mod. I think that you mislead tag with tag association. You can clear all associations easily by mod in Admin CP. Note that it will not remove any tag, but no tag will be associated to any thread anymore. You can then set max tags limit for thread and after that generate associations by mod

no what i said was it has created a lot of tags and that the sql queries you gave me to remove the tags affected 0 rows

that is different to not creating any tags.

i have turned tags off in my forum for now as there are currently 201 Pages in teh tags list which mostly consist of thigns like 001 and 888 and 1yr etc etc

i want to remove the tags which this mod has created. how do i do that???

Edit just to be clear i do not mean tag associations or any other feature in the mod i just mean how to get rid of tags because there is no delet all button or way of cliking all the tickboxes at once and im not about to sit there through 2 jhundred pages clicking one at a time

[NLP-er]

Originally Posted by turbosatan

no what i said was it has created a lot of tags and that the sql queries you gave me to remove the tags affected 0 rows

that is different to not creating any tags.

You are right Sorry for confusion - at the end I mislead what you was writing about

Ok - I'm investigating this. I will send another message in a minutes

[NLP-er]

I just looked in the code and now I'm sure that I didn't miss to set status code for tag_propositions. So now I need 2 information from you:

1. Please give me result of this query:

SELECT count(*) FROM tag_proposition WHERE status=4

2. Please tell me are you using some other tagging mod?

EDIT:
Also I made tests on my test board and everything is ok - also SQL which I gave you works fine.
I'm still waiting for your answers, but at this particular moment I can tell that those tags which you have created are not created by my mod

[turbosatan]

Execute SQL Query

Query
SELECT count(*) FROM tag_proposition WHERE status=4

Results: 1 (0.0003s), Page 1 of 1
count(*)
0

i did use an automatic thread tagger about 1 year ago when first one was released but i could not get it to work properly so i scrapped it and did nto use it.

it may have been that that other mod created the tags and then your mod applied them to all of the threads. i guess that is possible.

the issue i have is that i want to get rid of all the tags and start again from scratch now

Your mod did process a lot of threads when i first click on the add tags to all threads option in admin cp

EDIT:- i foudn the answer here http://www.vbulletin.com/forum/showthread.php?t=317440

to delete all tags

TRUNCATE TABLE tag
TRUNCATE TABLE tagthread

[NLP-er]

Originally Posted by turbosatan

Execute SQL Query

Query
SELECT count(*) FROM tag_proposition WHERE status=4

Results: 1 (0.0003s), Page 1 of 1
count(*)
0

i did use an automatic thread tagger about 1 year ago when first one was released but i could not get it to work properly so i scrapped it and did nto use it.

it may have been that that other mod created the tags and then your mod applied them to all of the threads. i guess that is possible.

the issue i have is that i want to get rid of all the tags and start again from scratch now

Your mod did process a lot of threads when i first click on the add tags to all threads option in admin cp

EDIT:- i foudn the answer here http://www.vbulletin.com/forum/showthread.php?t=317440

to delete all tags

TRUNCATE TABLE tag
TRUNCATE TABLE tagthread

Man - this mod have no 1 year yet. You wrote that this mod made you lot of tags - it is not this mod. You are writing on wrong thread.

Also - those 2 queries will remove all tags and tags associations you have - also those tags which you made manually.

Please go to author of mod which made this mess in your tags and ask him does he marks tags added automatically - this way you will be able to remove only garbage tags by appropriate condition in WHERE clause.

Also - 2nd query is not needed - my mod gives you possibility to clear all tags associations and it makes it nicely, because it made cleaning after that using vb function (note that tags association are cached in thread table).

[turbosatan]

i really wish you understood me a little better.

Can we get vborg to install the enterprise translator maybe??

so about 1 year ago i installed a plugin to try and auto tag my threads. it caused errors with other plugins so i turned it off.

That plugin must have made the tags which we saw in my screenshot earlier.

Your Plugin which i installed days ago applied hundreds of nonsense tags to all of my threads. i do not know if the tags which it applied to the threads were from your mod or the previous one but the actual tags themselves were added to the threads by your mod.

thats it end of story.

i have used the truncate sql above to remove all the tags from the tags fields and then tried again from scratch to use your mod.

this time it seems to have done some pretty good tags. although it does still have a load which are not really applicable so it looks like i will need to just add the tags i want manually after all.

NEW PROBLEM
none of the tag clouds work as this mod puts all the tags into a different database table.

Any way to fix that?

[NLP-er]

Originally Posted by turbosatan

i really wish you understood me a little better.

Can we get vborg to install the enterprise translator maybe??

so about 1 year ago i installed a plugin to try and auto tag my threads. it caused errors with other plugins so i turned it off.

That plugin must have made the tags which we saw in my screenshot earlier.

Your Plugin which i installed days ago applied hundreds of nonsense tags to all of my threads. i do not know if the tags which it applied to the threads were from your mod or the previous one but the actual tags themselves were added to the threads by your mod.

thats it end of story.

i have used the truncate sql above to remove all the tags from the tags fields and then tried again from scratch to use your mod.

this time it seems to have done some pretty good tags. although it does still have a load which are not really applicable so it looks like i will need to just add the tags i want manually after all.

NEW PROBLEM
none of the tag clouds work as this mod puts all the tags into a different database table.

Any way to fix that?

Mod is working fine Just like it is designed - applies existing tags to threads which have this tag word in content or title. You wrote that mod is assigning nonsense tags to threads. You want to tell me that you have nonsense content in your threads?...

My mod applies only tags which you already have created. Garbage in - garbage out. You had garbage tags, so garbage tags was assigned to threads. And was assigned in appropriate places - it means in threads which are using tag words. It is clearly described in mod description that mod is adding existing tags to threads according to its content and title. So why did you expect it will not do this?...

About new problem - what table are you writing about? Mod handles tags in default vB tables (tag and tagthread) - maybe you have some problems with prefixes, but it shouldn't happen, cause variable for prefixes is used in SQL queries.

Also please read mod description cause I have a thought that perhaps you still don't understood how this mod is working.