What is the Cholesky Decomposition used for?

Symmetric and positive definite matrices that can be Cholesky factored appears in many applications:

• Normal equations for least squares problems.
• Discretizations of self adjoint partial differential equation boundary value problems.
• Hessians of convex functions (in many cases the Hessian is made to be convex) in optimization.
• Systems of equations arising from the primal-dual barrier method for linear programming.

As to why one would use the Cholesky factorization rather than another matrix factorization such as the LU factorization, the answer is that Cholesky factorization is substantially faster than LU factorization because it can exploit the symmetry of the matrix and because pivoting isn't required. Cholesky factorization of sparse positive definite matrices is fairly simple in comparison with LU factorization because of the need to do pivoting in LU factorization.