Vb 3.0 Links/Harvester (Unreleased)
 

I've been working on this one for a few days now, and have decided that I will turn it into a release.

So here's the details:

What this hack does:

Adds a links directory with full ability to categorize all links into any category you can thing of.

Features (current):

• Users can add their links to your directory
• User added links are password protected with a password reminder function that enables them to be able to come back later and edit their listing as needed
• Unlimited categories and subcategories
• Unlimited amount of links
• Admin can harvest and edit all links within their forum's posts and then add them to the directory
• Admin can choose to ignore certain links within the harvester so they do not get added to the Database
• Moderators can use the system through their ModCP
• System emails the admin when a link is added
• Users can report dead posts
• Users can rate links
• Images can be linked to the listing and shown in the directory (good for banners)
• Admins and Mods can delete, edit, and adjust the listing in any way that they need
• Can be easily added to any frontend integration system (like VbIndex or VbAdvanced (will have instructions for VbAdvanced)) as a sidebar showing 'x' amount of new links, or random links etc.
• Multi-page spanning for longer lists within the directory for enhanced speed
• Searchable within itself
• Make harvester recognize links that do not have the "http://" in front of the link and add that so that the links are valid when added to the DB
• Have setting to make harvester just add the link to an unsorted category if desired or as un-approved
• Complete installer/upgrader/uninstaller for hack
• Admin can choose whether or not admin validation is needed
• AdminCP controls how everything runs
• Admin can adjust allowed settings for moderators

Features to add before releasing the beta:

• Finalize layout of main directory
• Adjust code to make it cleaner
• Make harvester recognize internal domain links and ignore them
• Make harvester show the original post with bbcode removed for ease of link addition
• Show subs and recursive count on main page per main cat

Nice to haves:

• Make Moderator Waste-Basket for deleted links
• Add graphical ratings system and settings to choose text or graphics for ratings
• Have harvester run a cron job every x that harvests all new links in the posts and adds them to the uncategorized category to be edited later or as a un-approved link to adjust at your leisure
• Searchable within the resident vB 3.0 coding
• Once Finished with Beta Release, port over to HTL
• Dupe Links Check

This is about 85% finished for beta testing, so I would like to know what you all would like to have in this system as well. Please let me know what you would like to have added in the near future to this hack!

I would like to take the time right now to personally thank HellSatan here on VB.org for the assistance in coding when I went totally blank. I would also like to thank the following testers for their help as well (This list will grow I am sure!):

• Tomshawk

)O( Cloudrunner )O(

More Screens

I will be sending the beta as an attachment here, if you plan on installing this, then hitting the install button will make sure that you are updated when I release the beta.

I am looking at waiting a week to find out what else you guys would like in this before finalizing the code for beta. That should take about a week more, so I'm looking at two weeks before beta release.

This will have a full installer, and require minimal editing of the base files (very little actually, just enough to add the links control in your CP nav bars for admin and mods).

I'm looking forward to your ideas.

Thanks!

)O( Cloudrunner )O(

and where i will see the links ? It will be a new link in NAVBAR...a new forum category ? Place some bigger screenshots. I can't understand a thing !

Looks promising! Many good ideas.

I think the #1 request from people will be the ability to upgrade from "Links Directory" from the vb 2 level.

Let me know when you are ready for a beta tester!

Wow, demanding...

good lord, I just posted this ROFL!

Anyway it is a new page (thus the directory in the name, therefore kinda rules out a forum) that runs on the VB backend, so it would require you to add a link in the navbar or some other place where YOU see fit to put it.

There will be instructions on how to add it to the navbar if you want to do that or as a forum link when the beta is released.

as far as screeners, if you want a better idea of it all, then goto: The Noble Pagan Links Directory

there was a links directory for VB 2?

I didn't know that...If I'm stepping on anyone's toes I apologize and I'll rename the hack before beta.

That being the case, I'm sure that I can implement something into the installer to import the links from the other one if someone can point me in the direction of that so that I can see it's sql structure.

)O( CR )O(

<a href="https://vborg.vbsupport.ru/showthread.php?t=44551" target="_blank">https://vborg.vbsupport.ru/showthread.php?t=44551</a>

This Links Directory system had about 200 installations. I think the people who made the vb2 system have abandoned the project. Your plans sound much more powerful and comprehensive. Harvesting external links from the threads would be great.

The link harvesting already works ;) (although the implementing that damned feature kept me up all night last night LOL).

Let's just say that I HATE regexp. I managed to get it done with only one preg_match_all though, so all is hunky dory!

The only drawback (currently) to the harvester is that I can see absolutely no way to implement a link title into the harvesting, so adding the link name and the description has to be done manually.

But, I was able to harvest 300+ links from my forums today in under thirty minutes ;)

)O( CR )O(

Cloudrunner, that is still good. :)

Would it be possible to have sub-categories inside the main categories?

Would it be possible to move misplaced links to more appropriate categories?

How does the harvester work? Do we run it once at the beginning to get all the old links (huge job) and then run it once a month to catch everything in last 30 days?

Sorry for all of these suggestions/questions. Feel free to decline anything that is not practical. :)

Already there bro. Unlimited subs within main cats, and unlimited subs within subs.

Again, already coded. Just click edit link, and all the information comes up, including a selector for the categories (I'm still working on making the pull-down level compliant, prolly have that in the next day or so).

[QUOTE=Catch-22|BL]How does the harvester work?

You just click Harvest Links in the main CP for the Links Directory, and it shows all links that have not been added to the DB or made invisible to the Harvester (i.e. There's a small table that tracks each link, and if the harvester finds the exact link in the table, it doesn't display it as a valid link to import into the directory, as it has either already been imported in, or has been chosen to be not-viewable by the harvester.

The time frame is all up to you, but since each harvested link has to have the extra stuffies, like banners and or name and descriptions added manually, the first time you run the harvester you will get ALOT of links to add. That being the case, yes it is a huge job, but it's a whole heck of alot easier than searching the individual posts for links and then doing the same thing.

Once you have done the initial harvest, then I would personally suggest a once a week harvest to put everything there. There are plans in the works to have this done as a VBcron, but that will only allow the links to be imported into the DB within an unsorted category (look at mine, and you'll notice this, and that each link name is title "Surprise! number *random number*". I'm using this area as a click surprise area until the links are edited for names and locations within the directory), it is also possible (again in planning) to VBcron it as an un-approved link then you can add them at your leisure.

One should never apologize for a question. For asking questions is the only way to learn, and learning is truly the only reason that we are here.

)O( Cloudrunner )O(

Excellent stuff Cloudrunner, This is great.

I've been playing with the other links addon https://vborg.vbsupport.ru/showthread.php?t=60403

And while it works pretty good, I like this one alot better, as it seperates the links alot better and if oyu put in a description of the link it doesn't mess up the layout of the page.

I definately want this.

At the moment, I dont see anything to add.

Question about the harvester though
When you run it, does it add them to the Uncatagorized catagory for later manipulation, or is this something you have to do before you can finish the task. Because If I have a couple of thousand links. this could take days even with the harvestor. Still quicker then by hand. But...

Just curious

Good stuff, I am awaiting release. :)

absolutely, this hack looks great, can't wait for the Full release :).

yes this hack is looking very good :D , tho is this the right forum seens how its not actually been released yet? Still cant wait to have a go of this, with afew template edits this could be v.handy for me :D

just to clarify this does import links and modify the table settings from the vb2 links directory right?

is so cool, i'll be installing this :)

I IMO would rename this hack as one already exists (even though the author may have abandoned it) which can be seen here.

Beta hacks is for actually released hacks. I'm moving this to general modification discussion. Just give one of the staff a shout when you're ready to released and we'll move it back :)

I am actually going to implement into the harvest an option to just harvest all the links and put them in the uncategorized area without the approval set. That way you can go back in later and edit those you want to without having them show on the directory page until they have been sorted.

Well, I actually did not know that there was a VB 2 links directory, thus this is in no way connected to the *other* directory. I've PM'd the originator of that hack asking for permission to write an import script from his to this one. If I get the go ahead, then I'll do it, if not, then it'll have to be done by hand.

I've already sent a PM to the originator verifying whether or not I need to change the name so as not to step on any one's toes.

And after looking at that link looks liek I will be so, I'll be changing the name today.

Thank you for letting me know, I appreciate that, I truly did not know that there was one already.

Gravy, Thank you for the clarification. I was unsure as to whether I should put it in beta since planned release is fairly shortly.

Anyway, Looks like beta will be sooner than I thought, I should have pre-beta out this weekend, I need two Alpha testers for this, if you are interested please PM me and we'll talk.

I've a few more things to code in, and once those adjustments are done, and the installer is written I'll release Beta.

Thank you for the encouragement, I appreciate that.

Just an FYI, I've hit an unanticipated snag in the developement which will delay release slightly.

My hosting provider was getting screwed by Voxel and their server farm, so they have moved their entire operations over to Alabanza. Until this move is done, I cannot do any updates currently. Once we have finished with the move, I will be back on this project full tilt again.

Just to let you know what's going on.

)O( Cloudrunner )O(

if you need help with a host, let me know. Many thanks for this great hack.

Thank you for the offer, however, after three years with this host and this being the only time stuff has screwed up, I'm still very loyal to our current host.

But thanks again, I do appreciate it.

I meant free for temporarily time, in no way I will charge any money, therefore, mine can't be compared with your host ;).

no problem bro, I appreciate the offer, but I just gonna be patient ;)

I will be one of your alpha testers.

Here is a thought for a new feature (feel free to disregard): Once you get >1000 links, you start getting many duplicates and it makes things look sloppy. Would it be possible to have an option to periodically search the database for duplicate links and report anything that has similar URL's. Then a human moderator can decide if it is an unwelcome duplicate or if it is intentional.

Excellent suggestion, will prolly be implemented in the final release, I'll put it the "nice to haves" area for now. Thank you!

PM me for alpha bro

Alpha has been released.

We'll work on whatever we find there, and will release beta shortly.

Thank you for your patience and encouragement.

)O( Cloudrunner )O(

is it a public alpha? and did you manage to get in contact with the other links author about an import script?

i wouldn't think you'd really need it, i doubt vB asked iPB

no, the public release will be Beta.

I've still a few things to work through before getting that one out, like some hardcoding issues, and setting up the phrasing and settings.

As far as a response from the other author, no I have not yet received a response. I'm going to give it until around the time that beta is ready to release, and if I haven't heard anything back from it, then I will simply write the import script on the grounds of, "I tried".

)O( Cloudrunner )O(

Work is continuing on this hack. I am currently working on getting the settings installed into the system, and will start on phrasing it tomorrow.

Once this is done and tested on multiple platforms for abit, I will then post the Beta release for you all to play with.

Understand that while this is not my first hack, it is to date my most involved hack that I have taken on. That being said I will welcome any and all comments, and complaints about the system once beta is released and will work on any issues found at that point.

Also understand that since this hack is a standalone add-on with very few file edits, it *SHOULD* run on virtually every installation of VB 3.0 RC+. I do not forsee any issues with installation and/or running of the system, BUT I have been wrong before. I look forward to providing you with my little project soon, hopefully by next weekend (I am giving myself a deadline of no later than 12 March 2004 for the beta release.

Also, FYI, from the 20th of March 2004, until the 27th of March 2004, I will be unavailable due to a course that I am being shipped off to Batesville, Indiana for. During that time there will be NO, I say again, NO support offered from me during this time as I will be concentrating on the course at that time.

Thank you for allowing me to do this for you all!

)O( Cloudrunner )O(

I'm looking for a links script, as I haven't had links on my site for a bit and really need to readd some to make some friends happy. I can test this for you (and have high volume) if you'd like to email it to me.

Beta will be out shortly, but if you are serious about Alpha testing it for me, I will welcome the assistance, PM me for further info.

Quick Status Update:

I have finished getting the settings into the system. There are settings for how the thing acts for the end user, and what your mods can and cannot do through the ModCP.

Next on the plate, Phrasing.

Enjoy.

)O( Cloudrunner )O(

I have installed the alpha version.

I have just released Alpha.1 to my Alpha Testers. I have begun work on Alpha.2 (incorporate phrasing). After Alpha.2 I'll begin work on hashing out the bugs found in Alpha.2, and then release Alpha.3. Once We've Verified that Alpha.3 Runs correctly, we will release the Beta version for everyone to play with. Then I'll get into suggestions and bug issues, as well as cleaning up the coding at that time.

Just an update for you all to let you know.

)O( Cloudrunner )O(

Phrasing is completed (for the most part), and I've supplied me testers with the new installation.

We are now working on glitches and bugs. Once we've hashed these out I'll take suggestions from the testers and then release Beta while incorporating the suggestions.

Looking at releasing Beta on Friday hopefully.

Enjoy!

)O( Cloudrunner )O(