What happens to the gem when I salvage an item with a gem in it?

Yes, the gem is removed and added to your inventory upon salvage. Don't be afraid.