Instead of killing you and the rest of his clan, Itachi took you with him around the world. You and him had a very strong relationship, you didn't love each other, or you just didn't express it, but Itachi always made it clear that he would never hate or despise you, and so he did.