Can a json string contain HTML tags with it?

Technically, yes, you can do that... practically, I'd be a bit concerned if there were HTML markup in my data. What else might be in there? Smells like an XSS vulnerability.

Yeah.. no problem with that. :)