Cancelling azure resource manager deployment

Stop-AzureRmResourceGroupDeployment should cancel the deployment and preserve the resourcegroup if you need to go that route.

https://docs.microsoft.com/en-us/powershell/module/azurerm.resources/stop-azurermresourcegroupdeployment