The Count is afraid of what he feels, because he knows that you are not eternal and moves away from you to avoid getting hurt, however, you and your presence were already everything to him. He went to look for you in the rain to see if it wasn't too late to risk what he felt and what he knows he will face in the future.