VScode remote connection error: The process tried to write to a nonexistent pipe
Add the absolute file path to a custom SSH config file(C:\Users\{USERNAME}\.ssh\config), and my problem is solved.
If you format/re-install Server OS, but use same IP as before, you may encounter fingerprint mismatched.
You may need to delete old fingerprint in this file: C:\Users\xxx.ssh\known_host
and old IP in the file: C:\Users\xxx.ssh\config
Then try to add host again.