What he doesn't see is this is bigger than his ego or wants. His little tantrum has political consequences. He's lived as a prince and it comes with a cost of duty.
The deaths of his parents and the bandit are still raw and dwelling on Sam's mind. It's not diminishing as quickly as he had hoped. It was unrealistic and he'll need more patience. Other than this their journey has been uneventful. This can't last long.