Yes, you're right, it makes no sense at all that trying to add a comment causes you to fail an audit when the post is high quality. You are also right that the system does not read your comment to see if it is reasonable (also, on a personal note, if commenting is going to cause me to fail an audit, can I please fail as soon as I click add a comment instead of when I try to submit the huge comment I spent 10 minutes composing?).
The most upvoted answer (at the time of typing this) to the post Kulfy linked to refers to a problem of people trying to quickly pass audits by doing an action that will reliably pass all audits. But this is a very very bad reason for making an attempt to add a comment fail an audit where the post is supposedly high quality. Instead of that, we could give new reviewers better guidance, and provide better tools for moderating reviews to more users.
I don't know what we can do to improve the situation. Someone (which could be me, or you, or anyone else) could post a feature request asking for attempting to comment on a "high quality post" audit not to fail the audit.
FYI, mods have almost* no special powers to decide which posts will become audits or to remove them. There is a general way to somewhat avoid bad audits being created, which is the community handling all posts correctly, but even that would not help with this particular situation.
However, we can escalate feature requests and probably complain about stuff on your behalf more influentially to people who might be able to do something (although such people are at present extremely overworked and lacking time to take on new stuff, I believe).
*I say almost, because posts that have at least one validated rude/abusive flag are not used in audits (so you hopefully don't have to see horrible things just so the system can attempt to check you are reviewing properly), and mods have significantly more power than other users to validate such flags.