Are black holes perfect heat sinks?
As a commenter points out, black holes (and all systems whose primary interaction is gravitational) have negative heat capacity. For classical gravitational systems you can tell that the heat capacity is negative from the virial theorem: the average kinetic energy of a gravitationally-bound particle has half the magnitude of its potential energy. Adding heat to a gravitationally-bound system sends its particles into higher orbits, where their speeds are slower; to the extent that temperature is related to mean particle speed, the object cools off. (A consequence of this is that when a dying star shifts from hydrogen burning to helium burning, its overall brightness increases, but its average temperature gets cooler: our yellow sun will turn into a brighter red giant, not a brighter blue giant.)
To observe that black holes also have negative heat capacity, simply note that adding energy to a black hole increases its mass, which decreases its Hawking temperature.
Negative heat capacities screw around with temperature-based ideas about thermal equilibrium. But the reason we talk about temperature is because temperature relates energy exchange and entropy exchange. If you're not sure how a system will evolve, you can always ask what pathway gives the largest increase in entropy. And there are several proofs that a black hole is a maximum-entropy state: if you have a system that contains a black hole and some other stuff (including other black holes), that system has less entropy than if everything ended up in the one black hole. That's what will happen, if you wait long enough.
I have to amend my initial comment: the fact that the black hole has negative heat capacity means that it is not guaranteed that an equilibrium is possible, but in a closed system, as is the case you specified, it is possible that equilibrium exists. As you'll see, this is a pretty rich problem.
You can simplify your setting by considering a black hole in a closed box, without the initial blackbody. Because the black hole will emit blackbody radiation itself, and that radiation will fill the box and bring it to some temperature, it ends up being an equivalent situation. The equilibrium conditions of this setup have been studied by Hawking (1) and Page (2), and by the standards of scientific papers both are pretty readable.
Consider a box with some fixed total energy, $E_0$, that can be divided between a black hole and the radiation around it. The energy in the radiation is $E$ and the energy in the black hole is $E_0-E$. Then the temperatures of each are easily found:
$$k_BT_{BH}=\frac{\hbar c^5}{8\pi G(E_0-E)}$$ $$k_BT_{rad}=\left[\frac{15(\hbar c)^3}{\pi^2}\frac{E}{V}\right]^{1/4}$$
The first equation is the usual black hole temperature formula, and the second equation comes from the blackbody radiation formula one learns in undergraduate thermodynamics. Note that this depends on $V$, the volume of the box.
We can plot both of these to learn about the possible stable configurations. There are two possibilities, depending on $V$:
The way to read these diagrams is that when the black hole has higher temperature than the radiation, there will be a net energy flow from the black hole to the radiation, moving you towards the right, and vice versa when the radiation temperature is higher. That determines the direction of the arrows marking the flow.
In case 1, for a large box, there is no stable equilibrium with a black hole, and the system always moves towards the black hole evaporating and leaving only radiation.
In case 2, for a small box, there is a stable equilibrium with the black hole and radiation, and also an unstable equilibrium. This corresponds to the situation originally asked by the OP: for example, imagine starting at x=0.4. So we can see that while the OP was correct that both systems initially get colder, because they do so at different rates this does not go on indefinitely.
While the black hole is locally stable here, over an unfathomably long time there will occasionally be thermodynamic fluctuations, some of which push the system into the unstable region near the right of the plot. So, you would expect that the system sometimes fluctuates from the equilibrium with the black hole to the equilibrium without, and vice versa. The relative probability of these two equilibria are not equal; there is another critical volume at 0.256 $V_c$ that separates whether the system spends more time near the black hole equilibrium or the radiation equilibrium.
The value of $V_c$, as found in the above papers, corresponds to $E=E_0/5$: $$V_c=\frac{3*2^{20}\pi^2E_0^5}{125}\frac{G^4}{\hbar c^{17}}$$. This assumes that the black hole emits only photons; there is a slight modification when you allow it to emit more species of particles.
For completeness, there is one more final possibility that I've ignored until now. If the initial energy density is very large, or the volume very small, the Schwartzchild radius of the system will be larger than V, meaning that when you form a black hole it is larger than the box itself. If this is the case, then this whole notion of an isolated black hole breaks down. This happens at $V_s=\frac{8 G^3 E_0^3}{c^{12}}$.
Edit: In response to Rob's question, one may look at the ratio $V_c/V_s$:
$$\frac{V_c}{V_s}=\left( \frac{E_0}{E^*} \right)^2, $$ where $E^*=\sqrt{\frac{125\hbar c^5}{3*2^{17} \pi^2 G}} \approx 0.0056m_pc^2$. Here $m_p$ is the Planck mass of about 21 $\mu$g. In other words, for a black hole with an initial mass of greater than 0.0056 $m_p,$ around 0.1 $\mu$g, one can put a box around it such that the box is large enough to contain the black hole but small enough that the black hole is stable.