How to delete the account image in Windows 8?

The previous answer works, actually. To elaborate: go to C:/users/your user name/AppData/Roaming/Microsoft/Windows/Accountpictures and delete the pictures you want to delete. The AppData folder is hidden, so you'll want to make it visible first (by checking the appropriate box under the Explorer's 'View' tab). Your current picture will be retained, but you can change it in the usual way, and after the change, it will be gone, too.

You can find the default account picture under:

C:\ProgramData\Microsoft\Default Account Pictures

Note that this is a hidden folder, so you may need to either enable viewing hidden files and folders, or press Windows + R and paste the path.

Source