Even though he'd never say it, he's afraid of losing you and you're the only person who makes him doubt