It's difficult to understand the anger and irritation some display when told they are privileged. I wish people would see that it doesn't detract or minimize any of your hard work. Rather, it is just recognizing that you have had some things easier than others. And by realizing that, you're more appreciative... and UNDERSTANDING of other people and their situations.
While the whole debate on privilege gets muddled, the comic "On a Plate" by Toby Morris makes the concept pretty easy to understand.
If you are privileged, that's okay. There's no need to just feel guilty or shitty. Rather, use your privilege, your power, your voice to help others.