Why is there antagonism towards extended real numbers?

The extended reals are a way of thinking, but hardly the only way. It is normal to think of a line as having no endpoints, rather than as ends that meet.

The reason you see antagonism is that this site is frequented by learners of mathematics, that often have very muddled ideas about infinity. Introducing the extended reals and allowing $\infty$ to be a number would only add to their confusion. Saying that $+\infty$ is a concept and not a number is a simplification made for calculus students to help them understand the definition of $\lim_{x\to \infty}f(x)$. Mathematics educators regularly simplify things for beginners, and this is an excellent example.

I'm not sure if explaining why the extended reals are natural is an appropriate answer to this question, but just in case:

As Baby Dragon and Bill Dubuque have pointed out, various notions of "compactifications" obtained by adding "points at infinity" are truly ubiquitous in mathematics, especially in geometry. The entire notion of projective geometry turns on adding these kinds of points, and it does not seem like much of an exaggeration to claim that the difference between affine and projective geometry is kind of the key to the city of algebraic geometry, a leading branch of contemporary mathematics.

Projectivization though would lead to the one-point compactification of $\mathbb{R}$ and we are talking about a $2$-point compactification. That shows up naturally by considering the order properties of $\mathbb{R}$: namely $\mathbb{R}$ is a Dedekind complete linearly ordered set whose order completion is precisely the extended real numbers: see e.g. this note for a take on this. So the extended real numbers are, from the perspective of order theory, extremely natural. They are also useful in calculus and analysis...

One can pinpoint the reason for such an antagonism to the notion of an infinite number (as opposed to cardinality) rather precisely due to the able work of the historian Joseph Dauben. Dauben wrote as follows:

Cantor devoted some of his most vituperative correspondence, as well as a portion of the Beiträge, to attacking what he described at one point as the ‘infinitesimal Cholera bacillus of mathematics’, which had spread from Germany through the work of Thomae, du Bois Reymond and Stolz, to infect Italian mathematics ... Any acceptance of infinitesimals necessarily meant that his own theory of number was incomplete. Thus to accept the work of Thomae, du Bois-Reymond, Stolz and Veronese was to deny the perfection of Cantor's own creation. Understandably, Cantor launched a thorough campaign to discredit Veronese's work in every way possible.

See pp. 216-217 in Dauben, J., 1980. The development of Cantorian set theory. From the calculus to set theory, 1630-1910, 181-219, Princeton Paperbacks, Princeton University Press, Princeton, NJ, 2000. Originally published in 1980.

These remarks make it clear that one of the sources of the hostility toward the concept of an infinite number is the attitude of Georg Cantor which has had a pervasive influence on the attitudes of contemporary mathematicians.