How to prevent Dynamic activity with color swatches in V10+

This should work:

SetSystemOptions["TypesetOptions" -> "ColorDirectiveSwatches" -> False]

You can disable this interactivity (and keep the swatches) with the Deploy function.

yields a deployed version of expr in which elements such as Slider, InputField, Locator and Button are active, but general editing and selection is disabled.

Deploy@Red

Hope this helps.