I'm reading Jane Austen's Emma right now (another one on my list of classics to read), and once again, Jane Austen's words of wisdom are something to take to heart.
"I lay it down as a general rule, Harriet, that if a woman doubts as to whether she should accept a man or not, she certainly ought to refuse him. If she can hesitate as to 'Yes,' she ought to say 'No' directly. It is not a state to be safely entered into with doubtful feelings, with half a heart."
This is taken from Emma giving advice to a younger woman after the woman receives a letter with a proposal in it.
So the bottom line is that you really do have to listen to your whole heart. Don't let other's expectations sway you from what your instincts say.