The data science team spent six months building a fraud detection model with 96% accuracy on test data.
The board approved a million-dollar investment. Production launch went smoothly with no technical errors.
Three months later, the model catches only 68% of actual fraud cases while flagging legitimate transactions at triple the expected rate.
The data scientists review their…
