Predictive modeling has emerged as a new research subject that studies a broad range of modeling techniques to provide confident prediction of the phenomenon of interest by integrating scientific principles together with both computer models and observed physical experiments. Motivated by overcoming the existing challenges, the objective in this dissertation...