I think the OP is in a better position to decide what he should do and judge how his boyfriend would react than I or you. Personally, I wouldn't find it fit to stay with a person who'd berate me for something I have absolutely no control over.
Having said all of that, I can understand your point very well. For instance, I love my family very much and believe they do the same to me too, but can't for the life of me come out to them - not to my parents at least who are very conservative, religious, and massively ill-informed when it comes down to the subject of homosexuality.
Bu I still say a relationship like that should be based on trust and that, if the thing is bothering the OP so much - it's better to take the opportunity and be open to his boyfriend about it if it's possible. Discussions like that can strengthen a relationship more.
And no, I didn't take offense to what you've said, and I don't think you were picking a fight either.