When is it safe to remove installation media during Windows 10 upgrade

Early on in the process Windows will copy all the files it needs from the USB drive to your hard drive. Typically when the first reboot starts, you can remove it. In the unlikely event that the installation process needs it again, it will ask for it.