Would using SAS disks instead of SATA disks make sense over NFS for a VMWare datastore?
Solution 1:
The benefit of SAS is the number of IO/s they can do compared to SATA (or midline). SATA drives rotate more slowly (7200 RPM) and thus have a higher read latency. This is made worse by the fact that you'll have more VMs running per drive because of the high density of space. SAS drives that run at 10k or 15k RPM will have a much higher number of IO/s they can do per spindle.
You can put some loads on SATA, but I would use SAS for anything that can't afford slow response times.
Solution 2:
15K drives will support higher random I/O operations per second than 7.2K RPM drives.
15K drives supporting random I/O should only saturate GigE if there are enough of them to spread the load. You don't mention how many drives are going in here, so it's hard to say how far it'll scale for you.
A blended solution is actually not a bad plan. Some SAS, some SATA. Keep in mind that drive performance has more to do with drive count than drive size. For some workloads using SATA makes perfect sense, while other more databasey workloads really should go on the faster SAS disks.
Most people end up having to make a judgment call between filer size and filer performance. This compromise usually dictates the mix, if any between 15K and 7.2K RPM drives.
Solution 3:
You should have an option for nearline/midline SAS disks as well. They are roughly equivalent to the SATA drives mechanically, but uses the SAS protocol. That should be the choice if you're concerned about capacity...
But with regard to performance, storage is rarely about maximum throughput speed. It's more often centered around IOPS random operations. So even though you're serving NFS over gigE, the VM traffic should always benefit from faster disks.
Solution 4:
SAS handles varying concurrent high loads better than SATA because its queue management is far more efficient than SATA's NCQ.
Most if not all SAS disks are designed for a 100% duty cycle, whereas few SATA disks are, most only offering 30%. This could massively affect your MTBF/reliability.
I'm personally no fan of NFS for working with vSphere, your mileage may vary but we couldn't live with its limitations and performance.
vSphere doesn't support LACP so your teaming is unlikely to work as you imagine.