Why can't I vote in MS Outlook 2010 when a poll is sent to me?

When using Microsoft Outlook 2010, I am able to add voting buttons to my emails and send them out and get responses back, but I am not able to vote when a poll is sent to me. Is there a setting I am missing that needs to be a certain way in order for me to receive polls and vote back to the person?