Besides, he didn't call me that in person, which shows that he is not a very casual person.
People, even if he is noisy.
So, let's have dinner sometime and ask him indirectly if he is interested in you.
If you don't feel anything, just give him a chance to express his feelings.