git difftool holding the shell
At the time I asked the question I didn't know I could simply exit the handle (which is only waiting for the external tool to emit its exit code), using Ctrl + C.
This is not automatic but it is enough to get going.
EDIT - better solution : as suggested in @1615903's comment, putting an &
after the difftool command seems to be launching the difftool without any handle.