One big, sad problem in machine learning and AI is that many, hopefully not most, practitioners there are largely incompetent in statistics and probability. This is why they often incorrectly evaluate the performance before deployment.

I’ll sell you a fair coin that’s nearly as accurate for half the price!

60% of the time, it works every time