Let $G$ be a finite group with $|G|>2$. Prove that Aut($G$) contains at least two elements.

The reason why that last case is done separately is because in that case we cannot describe a non-trivial automorphism with operations intrinsic to the group. In the non-abelian case we could use an inner automorphism, and in other abelian cases we can use negation. Using vector space structure is the "next best thing" in the sense that then everybody will immediately accept multiplication by an invertible matrix as an automorphism.

That last case is about groups that are isomorphic to a direct product of finitely many copies of $C_2$ $$ G=C_2\times C_2\times\cdots C_2. $$ Any permutations of components is then obviously an automorphism. But proving that such a group has this direct product structure, while not too tricky, is something the answerers did not want to do, because it is much more convenient to observe that a finite abelian group where all the non-trivial elements have order two is a vector space over $GF(2)$.

Here's another way of doing this step. We inductively find elements $x_1,x_2,\ldots,x_\ell\in G$ such that at all steps $x_k$ is not in the subgroup generated by $x_1,x_2,\ldots,x_{k-1}$. Because $G$ is finite, at some point we will have exhausted all of $G$, and thus $G=\langle x_1,x_2,\ldots,x_\ell\rangle$. The claim is then that $$ G=\langle x_1\rangle\times\langle x_2\rangle\times\cdots\langle x_\ell\rangle $$ is a way of writing $G$ as a direct product of subgroups of order two. This is more or less obvious by construction.

But you should notice that this is essentially the same argument proving that a finitely generated vector space over a field has a finite basis.

By structure theorem for finite abelian groups, we have $$G\cong(\Bbb Z_2)^n$$ for some $n$. Consider the function on $(\Bbb Z_2)^n$ that swaps the $1$st and $n$th coordinates. Show that that is an automorphism.

Building off of OP's work, we now consider Abelian groups, where each non-identity element has order 2.

Let $\{g_1, g_2, \ldots g_n \}$ be any minimal generating set of the group. Since $|G| > 2 $, thus $n\geq 2$.

Each element of the group $g$ can be uniquely written as $\prod_{i \in S_g} g_i$. (Exponents are no needed, since each element has order 2.)

Then, consider the the map that replaces $g_1$ with $g_2$ and vice versa.

Show that this is an automorphism.