Can I add comments to a pip requirements file?

Sure, you can, just use #

pip docs:

A line that begins with # is treated as a comment and ignored. Whitespace followed by a # causes the # and the remainder of the line to be treated as a comment.