Is it possible to make Firefox open a folder of bookmarks in a new window?

Just Shift+Click on the folder.

In the current Firefox release (tested in 51.0.1), use Alt+Shift+click.