Deep neural networks have shown impressive performance for many applications. In this dissertation, leveraging the capabilities of neural networks for modeling the non-linearity exists in the data, we propose several models that can project data into a low dimensional, discriminative, and smooth manifold. The suggested models can transfer knowledge from...