QGIS: extract point features not in polygons
The tool you are looking for is Processing > Toolbox > Vector selection > Extract by Location, using the Disjoint option:
The Help page describes the tool quite well.
You could use the select by location
tool, select all points within the polygons and then reverse the selection. Though I don't know how the tool handles datasets this large.