I agree. That’s one of the reasons I have a Sony Xperia 10. It’s has a 6" screen and is narrower than other phones making it very easy to hold and pocket.
Sadly the OEM’s will tell you that when given the choice, customers always go for the bigger screen because they think they are getting more. Which is why we have this situation.
Asus have the ZenFone which is smaller but even they are making a bigger 6.7" version next.