Chrome://inspect displaying device though not displaying any opened tabs
Ok you must use chrome mobile in order to debug any webviews or browser tabs. No other browser works. I was unaware of this.
//Edit
As of Android version 4.4 or later this is no longer the case. Android 4.4 has support for debugging internal Webviews. Please see https://developer.chrome.com/devtools/docs/remote-debugging#debugging-webviews
After connecting your device, make sure you open Chrome browser on the device and after that refresh the Chrome window on your PC. This will display the entry of the opened Chrome browser on the device. It will not launch if you don't first open Chrome browser on your phone
Using chrome://inspect/#devices, if the device is detected, but tabs open in chrome on the device are not listed, look for the "activate USB debugging" option in the chrome settings-->developer options tab on the device. This is in addition to the USB debugging option you've already checked in the Android developer settings.