I agree. This has been my thoughts all along. I just wanted to see other people's opinions on the matter.
If you look throughout history, everyone was much smaller. Suits of armor for Knights, Spartans, Vikings, Samurai and the like that have survived are all much smaller and most people today would not be able to fit into them. People just keep getting bigger.