Is it worth it to remove Item Modifications?

You cannot remove mods and sell them to other players.

Once you remove the mod the item and mod becomes bound to you and then the only person that you can sell the weapon/armor/mod to is a vendor.

If you are talking about removing the mod just to sell, the cost of removing it is greater than the cost of the mod itself when sold to a vendor.