ensembles don’t provide mathematical guarantees of validity and have a number of other serious issues -you might be interested in the best framework for uncertainty quantification

https://github.com/valeman/awesome-conformal-predictionConformal Prediction