You really aren't concerned about retiring in Malaysia, then, but about retiring away from your family. That's hard. If you are really miserable, would you be able to move back, or would that be too much of a financial struggle once you have sold your home?

Where is your Malaysian home?