Combinatorial reasoning in an expected value problem
I also have a heuristic, non-combinatorial approach.
This problem can be recast as a boxes and balls problems.
Imagine that you lay out all $a$ blue balls in a row. You have $a$ red balls in your hand. Imagine that there are "boxes" between the blue balls and two "boxes" at the ends of the row. Let $I_j$ indicate whether or not the ball $j$th red ball was thrown into the last box. We can pretend that this last box is the urn that contains the number of red balls $X$ remaining after we've drawn the last blue one. Notice that the probability that a particular red ball is thrown into the last bin is $\frac{1}{a+1}$. Then $$E[X] = E\left[\sum_{j = 1}^a I_j\right] = a P(I_j = 1) = \frac{a}{a+1}.$$
EDIT: The below answer may not be as "combinatorial" as you desire, but I think conditioning on the first draw and using recursion might give some insight into the problem.
Let $p(a,b)$ be the number of expected balls remaining when playing the same game, but initially there are $a$ blue balls and $b$ red balls. Clearly $p(1,1)=\frac{1}{2}$. By conditioning on the first draw, $p(a,1)=\frac{1}{2}p(a-1,1)+\frac{1}{a+1}p(a,0)=\frac{a}{a+1}p(a-1,1)$, and by induction $$ p(a,1)=\frac{1}{a+1} $$ Similarly, $$p(1,b)=\frac{1}{b+1}p(0,b)+\frac{b}{b+1}p(1,b-1)$$ and by induction again we can see $$ p(1,b)=\frac{b}{2}. $$ This suggests the general answer may be $p(a,b)=\frac{b}{a+1}$.
Now using double induction on $a, b$ gives $$ p(a,b)=\frac{a}{a+b}p(a-1,b)+\frac{b}{a+b}p(a,b-1)=\frac{b}{(a+1)}, $$ from which you may set $a=b$ to get your answer