cygwin + mintty + vim backspace problem

Add

set backspace=indent,eol,start

to your .vimrc file.

Cygwin's vim is configured to behave like traditional vi by default. Just create an empty ~/.vimrc, which causes vim extensions to be enabled and hence the Backspace and arrow keys to behave as expected.