Apple - High fan speed and CPU temp with low CPU usage?

Try resetting the SMC as noted in the question for your MacBook Air and see if the problem persists.

If the problem does persist it may be a failing temperature sensor, resulting in the fans running faster than normal to worst case fail-safe full-speed state, your only option at that point would be to take it to Apple Support for repair / replacement.