How to remove the Live Share button?

Uninstall the Live Share feature via Visual Studio Installer under individual components

Now the button is gone.

You just need to go to Extensions -> Manage Extensions, look for Live Share, and disable it.