What are the downsides to giving away Migration Access?

Should the original faction declare war on you in the future, they will require less warscore to take over any planets containing "their" pops in the future, as well as an easier time "digesting" the planet after conquest. (Source: Dev forum posts here, and here)