Two mirrors facing each other
This question reminds me of Zeno's paradoxes.
It is assumed that the two mirror surfaces are absolutely parallel.
In classical physics the electromagnetic waves that create the reflections are uniform and the energy loss due to the reflection ( depending on the material of the glass) will be what will make the reflections fainter and fainter, but the process is continuous and the limit will be a limit in luminosity. In principle a totally reflecting material would have no limit, going to infinite reflections as time goes to infinity. {corrected from the original statement that the wavefronts are instantaneous: Maxwell's equations obey special relativity i.e. the velocity c of light is finite}
Reality is quantum mechanical and also special relativity dependent.
With special relativity in the problem it will take time to reach the next reflection, so even for a total reflector infinity will also be reached only at infinite time, during observation, though there will be an enormous number of reflections.
Quantum mechanically there can not be a totally reflecting mirror, even in a thought problem. There will always be a probability of absorption and thus termination of the wavefront eventually, the images getting less and less defined until they become individual photons and finally totally absorbed.
Since quantum mechanics reigns, in reality, no, there will not be an infinite amount of reflections.