Android - Developer option "Do not keep activites" gets stuck
Mystery solved!
Clicking the toggle does nothing. Clicking the text itself works, though. It looks like Samsung's devs have a click listener on the list item, but not the toggle switch itself.