Treatise on non-elementary integrable functions
Here is the list of references I've seen on the topic of elementary integration. It is eclectic, and not intended to be complete, but contains most of what seem to be the relevant benchmarks, and several expository accounts in varying degrees of detail. Sadly, I am not familiar with Liouville's or Ostrowski's original papers. (Perhaps I'll use this as an excuse to track them down.)
MR0223346 (36 #6394). Rosenlicht, Maxwell. Liouville's theorem on functions with elementary integrals. Pacific J. Math. 24 (1968), 153–161.
MR0237477 (38 #5759). Risch, Robert H. The problem of integration in finite terms. Trans. Amer. Math. Soc. 139 (1969), 167–189.
MR0269635 (42 #4530). Risch, Robert H. The solution of the problem of integration in finite terms. Bull. Amer. Math. Soc. 76, (1970), 605–608.
MR0321914 (48 #279). Rosenlicht, Maxwell. Integration in finite terms. Amer. Math. Monthly 79 (1972), 963–972.
MR0409427 (53 #13182). Risch, Robert H. Implicitly elementary integrals. Proc. Amer. Math. Soc. 57 (1), (1976), 1–7.
MR0536040 (81b:12029). Risch, Robert H. Algebraic properties of the elementary functions of analysis. Amer. J. Math. 101 (4), (1979), 743–759.
MR0815235 (87a:12009). Richtmyer, R. D. Integration in finite terms: a method for determining regular fields for the Risch algorithm. Lett. Math. Phys. 10 (2-3), (1985), 135–141.
Matthew P Wiener. Elementary integration and $x^x$. Sci.Math post. February 21, 1995. (The pdf version was typed by Apollo Hogan).
Manuel Bronstein. Symbolic Integration Tutorial. "Course notes of an ISSAC (International Symposium on Symbolic and Algebraic Computation) '98 tutorial."
MR1960772 (2004c:12010). Van der Put, Marius; Singer, Michael F. Galois theory of linear differential equations. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], 328. Springer-Verlag, Berlin, 2003. xviii+438 pp. ISBN: 3-540-44228-6.
MR2106657 (2005i:68092). Bronstein, Manuel. Symbolic integration. I. Transcendental functions. Second edition. With a foreword by B. F. Caviness. Algorithms and Computation in Mathematics, 1. Springer-Verlag, Berlin, 2005. xvi+325 pp. ISBN: 3-540-21493-3.
Brian Conrad. Integration in elementary terms. Unpublished note. (2011?).
Moshe Kamensky. Differential Galois theory. "An introduction to Galois theory of linear differential equations."
Bronstein's book in particular is highly recommended.