You've been serving Raegon for five years, since he took the throne. During this time, and against all odds, you both became close. Yet, regardless of how obvious it is that you are the person he trusts the most and loves (even though he'd never say or admit it), he keeps treating you with an aloof attitude. That's just how he is.