[welo]

Originally Posted by AndrewD

...everyone will have a slightly different requirement, so we will need different harvesters feeding a standard farm.

Could we specify an interface between the harvester and the farm? For example, should the harvester generate an xml file or should it just dump links straight into a default category in this hack's database?

Well, ideally, if your script contained a link harvester designed to nab links from the posts table, the results should be queued somewhere else. This way someone would be able to mark what links were already checked so when they run the harvester next time, it won't return all the links it already gave them. Someone could run it once a month or so (or if it had a scheduler built in you could just set it to run automatically and email a designated person so they know a new set of links are ready for review and filing) and see what new links having been posted might be worth moving to an appropriate existing category (or indicate the need for a new category). Would also be nice if the results showed what forum/thread/post the link came from.