In the modern world, I would call them "diaspora" or " commonity" as in "Japanese community in the US"
In historical time it could be the "colonisers": especially if they still respected their original country's power over them rather than the local authorities.
