Referee report ignored and not sent to authors
I agree with Patrick that you should let things go with the journal and not take things personally--what happened was probably just a result of everyone being too busy. I doubt your relationship with the journal or editor will improve by pushing more.
To address your last question, yes I think it's worth contacting the authors. You have a chance to fix some mistakes in a paper before it gets published, so I would probably contact the authors, and just say that you were asked to review but couldn't finish on time so the journal didn't accept your report. (You also don't have to send them the exact report, but could just point out the mistakes.) Edit: To be clear, I am suggesting your explanation of this situation is short, and matter-of-fact, in a way that doesn't blame anyone or anything except your tardiness.
I think this is okay, because you did not end up being a referee for the paper, you don't need to maintain anonymity. There should certainly be no problem if their preprint is publicly available, in which case you don't even need to tell them you were supposed to be a referee. However, if their paper is not public, you may want to first check any secrecy agreements you may have made when you agreed to referee the paper.
Let it go.
Occam's Razor would suggest that what happened is that the editor, a busy person just trying to get their own deadlines met, didn't see (or read) your email, looked at the automated system and concluded that your review had not been submitted, and proceeded before reading your email. It's unfortunate that the review process was so impersonal for you this time, but that's sometimes the way it is, especially when interacting with people that you haven't met.
At the same time, my access to the manuscript in the editorial system was revoked.
Maybe you could aim to review the revised version, contact the editor explaining that you no longer seem to be able to access the system but that you're happy to send in a review. You've already done most of the work, you can return the review in good time, and the authors benefit from your comments. Just make sure they haven't already fixed the mistakes you noticed. Editors won't normally have reviewers falling over themselves to submit a review.