The Arcive of Official vBulletin Modifications Site.

NEW Modified RSS News Feed Hack · **Released**: 04-12-2004

Hack originally posted by: Xyphen - RSS News Feed Hack
Modified by: wolfstream - Modified RSS News Feed Hack

I am posting this up as a new hack because of the major changes made to how the script works. Also, I didn't want people to get confused as to which one to download since there were 3 different versions on the original post.

Xyphen released the original version, then wolfstream modified the script and corrected some errors. After that, I modified wolfstreams version to change how posts were inserted. Now the post count will increase, posts will be able to be searched, and similiar threads will work.

RSS News Feed Hack for vB 3.0.x. As long as vBulletin doesn't change the database structure much, this should be good for the next release also, and those to come.

Allows you to have a live RSS news feed (such as one from Google or CNET) in a forum. The user that posts it will basically be a bot, which *should* only be used for posting the news, but you can even make it for a regular user.

Comments are welcome! Support provided through this thread.

Latest Version:
- 1.26 - for PHP 4.3.0 & above
- 1.26a - for PHP prior to 4.3.0

vBulletin Versions:
- 3.0.0
- 3.0.1

PHP Versions:
- > 4.3.0
- < 4.3.0

Installation Overview:
- Files to edit: (2) /admincp/index.php, /includes/functions_newpost.php
- Files to upload: (4) rss.php, admincp/rss_admin.php, includes/RSS/class.RSS.php, includes/RSS/rss_update.php
- Queries to run: (4) in rss_install.php

History:
Version 1.26 (23 June 2004 - Slapyo, Natch)
- listing of bot's more intuitive (Natch)
- hopefully fixed duplicate problem (Slapyo)
- stripped html tags from title and description (Slapyo)

Version 1.25 (12 May 2004 - Slapyo)
- fix for " showing up
- logs action in scheduled task log if turned on

Version 1.24 (20 April 2004 - Slapyo)
- posts now deleted with delete_thread function
- post counts updated when using delete all news

Version 1.23 (14 April 2004 - Slapyo)
- added ability to delete bots
- cleaned up includes
- fix for PHP versions prior to 4.3.0 calling html_entity_decode()

Version 1.22 (13 April 2004 - Slapyo)
- duplicate posts problem fixed
- fix for problem with ' appearing as \'

Version 1.21 (12 April 2004 - Slapyo)
- bot will not be subscribed to posts now

Version 1.2 (11 April 2004 - Slapyo)
- posts now inserted with build_new_post function

Version 1.1 (28 March 2004 - wolfstream)
- file edits taken down to 1
- cron script included

Version 1.0 (28 January 2004 - Xyphen)
- original release

Common RSS Feeds:
- Yahoo!
- CNET.com
- BBC
- Wired News
- The Register
- Ars Technica
- All Headline News

dethfire · #**107** 04-16-2004, 03:06 AM

world news and politics

Slapyo · #**108** 04-16-2004, 03:11 AM

can you look in your database in the vb3_thread table and see if it is filling the rss_feed and rss_date fields?

it should be filling them and then it checks the date in the rss_date field against the dates in the feeds.

dethfire · #**109** 04-16-2004, 03:26 AM

yeah it fills just fine, it's not like it duplicates right away, it seems to run but run a few times

Slapyo · #**110** 04-16-2004, 03:38 AM

could it be the news articles are closely related? maybe try getting a copy of the rss feeds when it runs, then get more copies later on and compare them. that's what i would try to do.

the script checks the article title and the pubdate of the article. if both are the same, it is marked as old and not posted.

PranK · #**111** 04-16-2004, 03:43 AM

Quote:

Originally Posted by mirdin

Not likely. I believe the old hack would fetch the rss feed every time someone would enter the forum.

For this one you have to set a cronjob.

fantastic! thanks!

will_lean · #**112** 04-16-2004, 05:35 AM

HELP i installed this hack and it doesnt seem to post to the forum?
ived tried yahoo,slashdot and a few others and none of them seem to be working.
If i call rss.php i get a blank page,in adminCP i try to "run cron job"n as a test and it shows me a page with "rss" on it?
any ides what would be causing this to not display anything?

Slapyo · #**113** 04-16-2004, 05:41 AM

did you run the install file?
what version of php do you have?
whats the url of the rss feeds you are trying to use?
do you have the bots set up properly with the right user id and forum id?
is the cron job set up correctly in the scheduled tasks manager?

will_lean · #**114** 04-16-2004, 05:44 AM

yes i ran install fine,im using php 4.3.3
im using the yahoo and slashdot feeds from your intro post as well as a few other music site feeds.
I set the forum id to my news forum and have also tried the music forum but both dont show any news and rss.php is blank?

heres a feed i tried to use
http://rapdirt.com/newsrss10.php

i also have cron job set to 1 hour and have tested it but it shows a blank page with the letters rss at the top

Slapyo · #**115** 04-16-2004, 05:59 AM

that feed won't work because it is a rdf feed....for now this only works with rss feeds. however the yahoo feeds and slashdot feeds are rss and will work.

could you post the info in your scheduled task, and possibly a screen shot of the page with rss at the top.

when you make the script run from the scheduled task manager, all you should see is the name you gave the task.

will_lean · #**116** 04-16-2004, 06:05 AM

hmmm it seems as though it was the feed i was using they were RDF,ive tried another feed and it seems to work

but the posts seem to be formatted as so:

Quote:

<![CDATA[Late last year, the RIAA confiscated up to 1,000 mixed CD's from Alan Berry's Indianapolis stores -forcing him to close the famed Hip-Hop franchise a few months later. Now, Berry is taking his RIAA fight to the hip-hop streets and calling artists like 50 Cent, Jay-Z and Eminem to his defense.]]>

any idea how i can get rid of the tags or is it the feeds im using?

Slapyo · #**117** 04-16-2004, 06:19 AM

that is happening because of the feed you are using. some have the CDATA tags in front and behind. i'm not sure if this will work. it should. it is just replacing the things you don't want with what they should be, or in some cases nothing.

in rss_update.php FIND:
// Setup the thread

ABOVE ADD:

PHP Code:


			
$rss_title = str_replace("<![CDATA[[", "", $rss_title);

$rss_description = str_replace("<![CDATA[[", "", $rss_description);

$rss_title = str_replace("]]", "", $rss_title);

$rss_description = str_replace("]]", "", $rss_description);

$rss_title = str_replace("<p>", "", $rss_title);

$rss_description = str_replace("<p>", "", $rss_description);

$rss_title = str_replace("</p>", "", $rss_title);

$rss_description = str_replace("</p>", "", $rss_description);

$rss_title = str_replace("<b>", "[b]", $rss_title);

$rss_description = str_replace("<b>", "[b]", $rss_description);

$rss_title = str_replace("</b>", "[/b]", $rss_title);

$rss_description = str_replace("</b>", "[/b]", $rss_description);

Mobile · #**118** 04-16-2004, 07:59 AM

is there anyway to remove these posts from the search option because i've got a massive rss feed with about 400 posts and it gets too much looking through all the posts.

Mobile

Slapyo · #**119** 04-16-2004, 01:00 PM

actually the 2nd news feed by wolfstream did this. try this: https://vborg.vbsupport.ru/showpost....&postcount=139

they were manually inserted into the database so post count doens't go up for those threads, similiar threads won't work for the posts, and you won't be able to search them at all. however, i don't offer any support for that version.

SnowBot · #**120** 04-16-2004, 03:02 PM

Any news on fixing my problem yet ?

AWS · #**121** 04-16-2004, 03:10 PM

The problem with dupe posts seems to be a problem with vbulletin cron. If I run the script manually it does not post duplicates. If it runs via cron.php it runs more than once and posts duplicates. The script will run until it times out when it reaches the php timeout or until the next scheduled task is to run.
Whne I figure out a fix I'll post it.

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.06030 seconds Memory Usage 2,371KB Queries Executed 30 (?)
More Information
Template Usage: (1)SHOWTHREAD (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)ad_showthread_beforeqr (1)bbcode_php (2)bbcode_quote (1)footer (1)forumjump (1)forumrules (1)gobutton (1)header (1)headinclude (1)modsystem_post (1)navbar (6)navbar_link (120)option (1)pagenav (1)pagenav_curpage (4)pagenav_pagelink (1)pagenav_pagelinkrel (16)post_thanks_box (16)post_thanks_button (1)post_thanks_javascript (1)post_thanks_navbar_search (16)post_thanks_postbit_info (15)postbit (16)postbit_onlinestatus (16)postbit_wrapper (1)spacer_close (1)spacer_open (1)tagbit_wrapper Phrase Groups Available: global inlinemod postbit posting reputationlevel showthread	Included Files: ./showthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/functions_bigthree.php ./includes/class_postbit.php ./includes/class_bbcode.php ./includes/functions_reputation.php ./includes/functions_post_thanks.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete showthread_start showthread_getinfo forumjump showthread_post_start showthread_query_postids showthread_query bbcode_fetch_tags bbcode_create showthread_postbit_create postbit_factory postbit_display_start post_thanks_function_post_thanks_off_start post_thanks_function_post_thanks_off_end post_thanks_function_fetch_thanks_start post_thanks_function_fetch_thanks_end post_thanks_function_thanked_already_start post_thanks_function_thanked_already_end fetch_musername postbit_imicons bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete postbit_display_complete post_thanks_function_can_thank_this_post_start pagenav_page pagenav_complete tag_fetchbit_complete forumrules navbits navbits_complete showthread_complete
Messages:

The Arcive of Official vBulletin Modifications Site.

It is not a VB3 engine, just a parsed copy!