How does one correctly interpret the behavior of the heat capacity of a charged black hole?

The paper pointed out by Daniel's comment gave me a starting point to find more literature on this topic and do further research. After a while, it became clear to me that my question is actually an unsettled (research) question. Therefore, a definitive answer cannot really be expected. Nonetheless, I think it's valuable to provide something of an answer. Since no one else has done so, I will now simply outline the main results of my own research. This "answer" will only address my second question:

What does the divergence in the heat capacity mean?

This seems to be the question that has attracted most attention from actual researchers. I think that, chronologically, this paper by Davies (paywalled, regrettably), was the first to bring up the fact that there is an infinite discontinuity in the heat capacity of a Reissner-Nordström (or rather, its generalization, called the Kerr-Newman metric) black hole at $\frac{Q}{M}=\frac{\sqrt{3}}{2}$. A similar thing occurs in the Kerr-Newman setting when the angular momentum to mass ratio exceeds a certain value.

As can already be seen from the abstract, Davies argues that there is a physical meaning to this divergence: He views it as a phase transition. We note that, for even higher charges, the black hole has positive heat capacity and can thus be in equilibrium with a heat bath. Regrettably, Davies refrains from commenting on any depth why there is (or should be) a phase transition as the charge is increased. In the Kerr ($Q=0$) case, he does suggest an interpretation for the phase transition that occurs at a certain value of $J$ (for fixed $M$):

Newtonian calculations [...] indicate that a rotating, self-gravitating fluid becomes unstable and loses its axisymmetry at a critical value of the ratio (rotational energy/Newtonian gravitational energy). I am grateful to Dr D. W. Sciama for drawing my attention to a striking result by Bertin & Radicati (I976), who have recovered this instability as a thermodynamic second order phase transition [...]. In the higher angular momentum phase, the axisymmetric spheroid gives way to a triaxial ellipsoid. This suggests the possibility that in a similar fashion the Kerr black hole becomes unstable [...] and enters a non-axisymmetric, dynamic phase in which new thermodynamic degrees of freedom appear.

Shortly after Davies' paper, an article by young Dutch physicist Piet Hut appeared, with a more in-depth analysis (see section 3 and appendix 1 of the paper). Hut takes a different position than Davies on the meaning of the discontinuity of the heat capacity. He considers both the heat capacity at constant $Q$, which he denotes by $C_Q$, and the heat capacity at constant electric potential $C_\Phi=-\frac{S}{4\pi}$. Here, $\Phi$ is defined by the general equation

$$dM=TdS+\Phi dQ $$

While $C_\Phi$ is finite and negative everywhere, $C_Q$ has an infinite discontinuity at $Q/M =\frac{1}{2}\sqrt{3}\approx 0.87$. At this point its sign changes too: $C_Q$ is positive for more highly charged black holes. This remarkable behaviour of $C_Q$ occurs because the $Q, T$ coordinates are double valued, which is illustrated in Fig. 5 [reproduced below]. The $Q, \Phi$ coordinates, however, form a non-degenerate coordinate system everywhere. The physical reason for the double valued $M (Q, T)$ is that the temperature of a black hole tends to zero not only in the limit $M\to\infty$, but also in the lower limit $M \downarrow Q$ if $Q$ is kept constant, since in both cases the surface gravity vanishes.

[...]

In order to interpret the discontinuity in $C_Q$ in terms of a phase transition, the appropriate thermodynamic potential to consider would be the Helmholtz free energy $F(T, Q) =M-TS$ instead of the usual Gibbs free energy $G(T, \Phi) = F -Q\Phi$, since the heat capacities can be written as $C_Q = - T(\partial^2 F/\partial T^2)$ and $C_\Phi=-T(\partial^2 G/\partial T^2)$, respectively.

In analogy to the Ehrenfest classification [which classifies phase transitions by the lowest derivative of the free energy that is discontinuous at the transition] of phase transitions, we might call the dis- continuity in $C_Q$ a first order phase transition, since $(\partial F/\partial T)_Q$ becomes infinite at $Q/M =\frac{1}{2}\sqrt{3}$. But this terminology does not seem to be very appropriate here, as there is no such thing as a latent heat in this case, and most other thermodynamic functions are well behaved (see Appendix 1).

In the above-mentioned appendix 1 we find a demonstration that only those functions that explicitly depend on the (supposedly) degenerate coordinates $Q,T$ are affected by the divergence of $C_Q$. This is done by simply calculating a number of thermodynamic functions and showing that they have no singular behavior, unless they depend on the $Q,T$ coordinates.

Finally, near the end of his paper, Hut discusses the meaning of the singularity:

[...] the infinite discontinuity cannot be considered as a phase change at all. Here the entropy is continuous together with all its derivatives [...]. But this infinite discontinuity has a physical significance which in a way transcends that of a phase transition. Although the internal characteristics of the system do not change here, the way the system can be brought into stable equilibrium with an external environment changes. On the side with a higher $Q/M$, $C_Q > 0$, and the system can be in equilibrium with a heat bath. But at the lower $Q/M$ side, $C_Q < 0$, and the system can only be in equilibrium if it is isolated from the outside world. Thus instead of a phase transition we encounter here a transition from a region where only a microcanonical ensemble can be used to a region where both a canonical and a microcanonical ensemble are appropriate.

So we see that Hut interprets the singularity as signifying a change in the way we can describe the system, rather than a change in the properties of the system itself.

More recently, there have been a few new publications on the subject, but in my opinion they do not contain any very compelling arguments, so I don't think discussing them is really worthwhile. In any case, it appears that the issue has not been completely settled. Finally, I note that, to me personally, the explanation by Hut seems quite convincing.