Display GPU Usage While Code is Running in Colab

If you have Colab Pro, can open Terminal, located on the left side, indicated as '>_' with a black background.

You can run commands from there even when some cell is running

Write command to see GPU usage in real-time:

watch nvidia-smi

Used wandb to log system metrics:

!pip install wandb
import wandb
wandb.init()

Which outputs a URL in which you can view various graphs of different system metrics.