Is it safe to delete Java folders from C:\Users\(Username)\AppData\LocalLow\Sun\Java

Based on the this bug report, I removed the files in C:\Users\(Username)\AppData\LocalLow\Sun\Java after installation. Java continued to work as it should. It became impossible to remove, using Add/Remove Programs, any version whose files I had deleted.

It seems that these files are only kept around for uninstallation. Java Uninstall Tool mentioned in Jason's answer probably alleviates the need to keep those files around.

Yes, if you've already uninstalled them, this is safe to do.

Also, you may find Oracle's Java Uninstall Tool helpful.