Basic Knowledge Unconstrained Optimization SGD Newton Methods Newton Conjugate Gradient Method Constrained Optimization Low-Dimensional Linear Program Low-Dimensional Quadratic Program Constrained Optimization via Sequential Unconstrained Optimization Penalty Methods Barrier Methods Lagrangian Relaxation Generally Constrained Optimization Karush-Kuhn-Tucker(KKT) Conditions PHR Augmented Lagrangian Method Conic Programming Conic Augmented Lagrangian 优化问题构建和求解技巧 Smoothing Techniques