In this dissertation, we aim to develop efficient algorithms with theoretical guarantees for several data-driven decision making problems. Specifically, we study the data-driven deci- sion making from three different perspectives: statistical learning, nonconvex optimization, and control of stochastic system. This dissertation contains three parts. In the first part, we study...