Creation and annihilation operators in QFT

The connection can be seen by taking $H = L^2(\mathbb{R}^3)$ in the first explanation. This is the Hilbert space of a nonrelativistic, spinless, three-dimensional particle. By direct summing the symmetric (antisymmetric) tensor powers of $H$ we get the Hilbert space of an ensemble of noninteracting Bosonic (Fermionic) nonrelativistic, spinless, three-dimensional particles, known as Fock space. The $n$th tensor power represents the states in which $n$ particles are present.

Now we have "creation" and "annihilation" operators which take states in the $n$th tensor power into the $(n \pm 1)$st tensor power. For each state $h$ in the original Hilbert space $H$ there is a creation operator which tensors with $h$ and symmetrizes (antisymmetrizes), taking the $n$th tensor power into the $(n+1)$st, and its adjoint which goes in the opposite direction and removes a tensor factor of $h$.

In the physics literature one usually works with idealized creation/annihilation operators for which the state $h$ is a fictional Dirac delta function concentrated at some point of $\mathbb{R}^3$. This is what is described in your second explanation. As is usual in physics, the Hilbert space is unspecified, but in the case of free fields it corresponds to the Fock space in the first explanation.

Fock space is inadequate to model interacting fields (indeed, here the mathematical issues become deep and fundamentally unresolved). However, it is not trivial; for instance, one can study free quantum fields against a curved spacetime background and derive Hawking radiation, the Unruh effect, etc. Quantum Field Theory in Curved Spacetime and Black Hole Thermodynamics by Wald is an excellent, mathematically rigorous explanation of this setting.

In QFT the intuition is that one has a separate Hilbert space at each point of space, and one takes their tensor product to get the Hilbert space of the entire field. I indicated how, intuitively, the Fock space models a "measurable tensor product" of a family of harmonic oscillators (Bosonic case) or two-state systems (Fermionic case) indexed by all the points of space in my answer here. See Section 2.5 of my book Mathematical Quantization for a full explanation.


Disclaimer: I am not a mathematical physicist.

Even with one Hilbert space, namely the quantum harmonic oscillator, you can define "creation-annihilation" operators, except that in this case they simply raise or downgrade the energy level of the single particle system.

Now, you consider the Fock space $\mathcal{F}^{\pm}(\mathcal{H}) = \bigoplus_{n=0}^{\infty}\mathcal{H}_{n}^{\pm}$ the way you describe above: it is actually a functor, hence the infamous dictum that second quantization is a functor.

Therein, you define again the two operators, but you re-interpret them as ladder operators which, from the ground state, create and destroy particles. Formally they behave very much as with the toy harmonic oscillator, and that analogy is far-reaching:

basically it tells you that the quantum field described by the Fock functor can get "excited": particles are excitations of the void (in fact there are some beautiful pictures of quantum fields as (infinite) ensembles of (coupled ) harmonic oscillators, see here).

What has this to do with the second definition? If the quantum field creates and annihilates particles, it can do it at each point of your ambient space. Hence the indexes...