I figured out my own question if anyone wants to know.
In plugin manager - xfavatar - forumdisplay_query
replace the plugin php code with this, changing the forumids to the forums you don't want this plugin in.
Code:
if( $foruminfo[forumid]==32 || $foruminfo[forumid]==17 || $foruminfo[forumid]==18 || $foruminfo[forumid]==19 || $foruminfo[forumid]==20 || $foruminfo[forumid]==21 || $foruminfo[forumid]==22 || $foruminfo[forumid]==23 || $foruminfo[forumid]==24 || $foruminfo[forumid]==25 || $foruminfo[forumid]==26 || $foruminfo[forumid]==28 ) {
} else {
if(file_exists(DIR . '/krscripts/xfavatar/forumdisplay_query.php'))
{
require_once(DIR . '/krscripts/xfavatar/forumdisplay_query.php');
}
}