One thing you can do is reconcile your transactions with the bank's. They are not infallible.

But I'm mostly in your camp. I don't use accounting software for my personal finances. I don't know anyone who does. I think it's more useful for businesses or other organizations that have to be able to report where the money goes.