Unwittingly obfuscating the fact that you’re not doing AI

The variables of the model were all pretty straightforward – indicators for variables, some customer history variables and some other stuff to handle the frequency of their interactions with the company. The reason this model seemed like it was ok was because customers with that particular product were indeed churning en masse, such that it masked performance flaws elsewhere in the sample space. In the case I described above, what had happened was that the model was trained on a dataset that contained no examples of a customer having that one product and also not churning.

Source: breakitdownto.earth