False Confidence isn't a machine problem, it's the oldest human error. The Dogmatic Average II.
Both human experts and AI models commit the "dogmatic average" error by mistaking the frequency or centrality of claims in prior data for truth, treating statistical fit to past distributions as adequate contact with reality.