Dealing with some real-world problems of ML models.
Take 1,000 bootstrapped samples of the current dataset and calculate the reconstruction loss for each. Calculate the mean and stdev. Then, if the reconstruction loss of the new dataset is more than 2 stdev's above the mean, we have data shift.
Take 1,000 bootstrapped samples of the current dataset and calculate the reconstruction loss for each. Calculate the mean and stdev. Then, if the reconstruction loss of the new dataset is more than 2 stdev's above the mean, we have data shift.