Sorry, but in all relationships trust is vital. From what you say, there's not much trust between the two of you. Not to mention, yeah, your partner can and will annoy you at times, but it seems like you spend more time upset, irritated, or frustrated with this guy than not. You have to decide if the relationship is worth taking the time to work through your problems. I'd suggest speaking to him face to face, with honesty, about how you feel. If you can work it out, more power to you, if not *shrugs*. A relationship should take some work, but you shouldn't feel like you have to manage it constantly.