Upper semicontinuity of set-valued maps with open values
I think there is not much more to say than that most interesting results about upper semicontinuous set-valued maps involve closed-valued or even compact-valued maps. Indeed some authors choose to define upper semicontinutiy only for such maps. But there are good reasons not to. It helps to rephrase continuity notions for set-valued maps in terms of preimages of open sets, and here it turns out that there is more than one natural notion of a preimage.
Let $F:X\to 2^X$ be a set valued map and let $W\subseteq Y$. The upper inverse of $W$ under $F$ is
$$F^U(W)=\{x\in X:F(X)\subseteq W\}$$
and the lower inverse is
$$F^L=\{x\in X:F(x)\cap W\neq\emptyset\}.$$ Then one can define upper semicontinuity by the requirement that the upper inverse of an open set is again open and lower semicontinuity by the requirement that the lower inverse of an open set is again open. If one identifies functions with set-valued maps whose values are singletons, both notions coincide with ordinary continuity there. Indeed, one often talks about hemicontinuity instead of semicontinuity nowadays exactly because a, say, upper semicontinuous function is in general not upper semicontinuous as a set-valued map.
Now these two notions of continuity for set-valued maps represents different aspects of continuity. The example you gave does satisfy lower hemicontinuity so it does satisfy an idea of continuity, just not the one you used.
A very accessible reference for results on set-valued maps is Chapter 17 of Infinite Dimensional Analysis by Aliprantis and Border.