It bugs me a little that "fidelity" has connotations other than "faithfulness to an original"---fidelity should be basically the same as correctness here!

That’s really not the highest fidelity interpretation of “fidelity.”

Fair, but correctness should be a necessary component of fidelity.

My dictionary writes: "precision * accuracy = fidelity".

If correctness would matter anymore, people wouldn't be using LLMs in the first place.