turn off noise on kinesis keyboard caps-lock
Figured it out by reading the manual. You hit the "Program" and "hyphen" keys at the same time (no need to hold them down). Mine didn't give feedback to acknowledge the action, but now the beep doesn't occur when I hit Caps Lock.
For the Advantage 2: Program + Shift + F8. https://www.kinesis-ergo.com/support/technical-support/faqs-advantage2-keyboard/