Uninstalling VisualSVN 2.0 from Visual Studio 2010
From VS: Tools->Extension Manager->Visual SVN->Uninstall
From VS:
Tools->Extension Manager->Visual SVN->Uninstall .
In visual studio 2010, Uninstall button is disabled. If disabled, go here and install the visual svn again. During installation, you will get an remove option. Click the 'Remove' button. It will remove Visual SVN form visual studio.
Do forget to Restart the visual studio.
In Visual Studio 2010, the Uninstall button is disabled.
I definitely don't want to upgrade VisualSVN (per @Md. Tahmilur Rahman above) just so I can remove it from Visual Studio. Going to Control Panel/Uninstall a program/VisualSVN and removing it also cleared it out of VS2010 the next time I opened it.