With the exception of Ben who is at a tall height, I'm thinking they're saying that for the rest due to them picturing Batman being taller than what he is. In their mind they may think he's some 7foot tall guy and when they meet him they see he's not what they were originally imagining, so the "I thought you'd be taller" line comes out.