Its okay, whats the problem? As long as both of you are feel comfort with that relationship.

I think he was shy, or nervous. So you have to move, ask him that you want make a simple relationship maybe, or you want to know him well.