If you only want to hide certain polls in certain areas then you may need to get a hack that does that. You may want to search the hacks here for something like that or you may have to have someone code it for you. I do not remember one that does that off hand but that does not mean its not there.
That's what I figured. I didn't really find anything but I'm thinking I may be able to create a style for that specific forum and edit the poll templates with conditionals to hide specific details.
That is one possibility that may work. Might be a PITA though if you have to add the id of each thread you want to show the count and not show the count.