Do I bully my brother?

Everyone in my family is over 6 feet tall except my brother who is only 5"5 and he's 19 so he isn't going to get taller. So I call him runt but my mom says this is bullying, is it bullying(he never says anything).