Most Japanese are slender, it is one of the country with lowest obesity rate. And in most country in Asia, making comment about your body is usual. Well, not really polite but not rude either, depend on how you talk about it.

For example, comparing your body size and your wealth is a common joke and compliment (e.g.: wow, your business must be good that you are getting larger).