Right identity and Right inverse implies a group
It is conceptually very simple that a right inverse is also a left inverse (when there is also a right identity). It follows from the axioms above in two steps:
1) Any element $a$ with the property $aa = a$ [i.e. idempotent] must be equal to the identity $e$ in the axioms, since in that case:
$$a = ae = a(aa^{-1}) = (aa)a^{-1} = aa^{-1} = e$$
This already proves the uniqueness of the [right] identity, since any identity by definition has the property of being idempotent.
2) By the axioms, for every element $a$ there is at least one right inverse element $a^{-1}$ such that $aa^{-1}=e$. Now we form the product of the same two elements in reverse order, namely $a^{-1}a$, to see if that product also equals the identity. If so, this right inverse is also a left inverse. We only need to show that $a^{-1}a$ is idempotent, and then its equality to $e$ follows from step 1:
$$[a^{-1}a][ a^{-1}a] = a^{-1}(a a^{-1})a = a^{-1}ea = a^{-1}a $$
3) It is now clear that the right identity is also a left identity. For any $a$:
$$ea = (aa^{-1})a = a(a^{-1}a) = ae = a$$
4) To show the uniqueness of the inverse:
Given any elements $a$ and $b$ such that $ab=e$, then
$$b = eb = a^{-1}ab = a^{-1}e = a^{-1}$$
Here, as above, the symbol $a^{-1}$ was first used to denote a representative right inverse of the element $a$. This inverse is now seen to be unique. Therefore, the symbol now signifies an operation of "inversion" which constitutes a single-valued function on the elements of the set.
See Richard A. Dean, “Elements of Abstract Algebra” (Wiley, 1967), pp 30-31.
I assume that (a) should read $\exists e\in G$ such that $ae=a$, $\forall a\in G$. For each $a \in G$ we have
$$\begin{align*} (a^{-1})^{-1}a^{-1} &= e[(a^{-1})^{-1}a^{-1}]\\ &= (aa^{-1})[(a^{-1})^{-1}a^{-1}]\\ &= [(aa^{-1})(a^{-1})^{-1}]a^{-1}\\ &= (a[a^{-1}(a^{-1})^{-1}])a^{-1}\\ &= (ae)a^{-1}\\ &= aa^{-1}. \end{align*}$$
Multiplying $(a^{-1})^{-1}a^{-1} = aa^{-1}$ on the right by $(a^{-1})^{-1}$ yields $$\begin{align*} (a^{-1})^{-1} &= (a^{-1})^{-1}e\\ &= (a^{-1})^{-1}[a^{-1}(a^{-1})^{-1}]\\ &= [(a^{-1})^{-1}a^{-1}](a^{-1})^{-1}\\ &= (aa^{-1})(a^{-1})^{-1}\\ &= a[a^{-1}(a^{-1})^{-1}]\\ &= ae\\ &= a, \end{align*}$$
so $a^{-1}a=e$ for all $a \in G$.
Added: The foregoing obviously assumes that $e$ is a left identity, which was not given, and somehow none of us caught it at the time. Here is a corrected argument. For each $a\in G$ we have $$a^{-1}=a^{-1}e=a^{-1}(aa^{-1})=(a^{-1}a)a^{-1}\;,$$ so $$e=a^{-1}(a^{-1})^{-1}=\left((a^{-1}a)a^{-1}\right)(a^{-1})^{-1}=(a^{-1}a)\left(a^{-1}(a^{-1})^{-1}\right)=(a^{-1}a)e=a^{-1}a\;.$$
In other words, $a^{-1}$ is both a left as well as a right inverse for $a$. It follows that
$$ea = (aa^{-1})a = a(a^{-1}a) = ae = a\;,$$
so $e$ is a left as well as a right identity for $G$. Now you can use the usual arguments to show that the identity and inverses are unique. (For example, if $e'$ were another identity, we’d have $e = ee' = e'$, because $e$ is a left identity and $e'$ is a right identity.)
This is stated with left identity and left inverse as Proposition 20.4 in the book Spindler: Abstract Algebra with Applications. Let me copy here the proof from this book (it should be easy for you to change it for the right instead of left):
Let $x\in G$ be arbitrary. We want to show that the left inverse $x^{-1}$ is in fact also a right inverse. Let $y:=xx^{-1}$. Then $$yy=(xx^{-1})(xx^{-1})=x(x^{-1}x)x^{-1}=x(ex^{-1})=xx^{-1}=y.$$ Hence $$e=y^{-1}y=y^{-1}(yy)=(y^{-1}y)y=ey=y=xx^{-1},$$ i.e. $xx^{-1}=e$ which was what we wanted to show.
Now we prove that the left-neutral element $e$ is also a right-neutral element. Let $x\in G$ be arbitrary; we want to establish that $xe=x$. Now $$xe=x(x^{-1}x)=(xx^{-1})x=ex=x. $$
I googled a little and found out that several authors take this in fact as a definition of group, here are some of the first hits from google books when searching for "left inverse" "left identity" group:
- Robinson: A course in the theory of groups, p.2
- Gelbaum, Olmsted: Theorems and counterexamples in mathematics, p.1
- Sharma: Group Theory, p.14