Apple - Can I disable Safari's pinch-to-zoom tab switcher?
This is currently not possible. Apple does not provide a way to turn this off.
Note that if your swiping is begun whilst still zoomed slightly, the tab switcher is not invoked. See this animation:
This is a pretty large GIF — it'll take a while to load and be smooth.