Prove, that group of order $p^2$ is abelian.

If there is an element of order $p^2$, it's cyclic and thus abelian. Suppose there is no element element of order $p^2$. Then, the order of of the elements of $G$ are either $1$ or $p$. Let $h_1,h_2\in G$ two elements of order $p$ s.t. $h_2\notin\left<h_1\right>$. Then, $\left<h_1,h_2\right>$ is of order $p^2$ and is s.t. $|\left<h_1,h_2\right>|\geq p+1$. Therefore, $|\left<h_1,h_2\right>|=p^2$, and thus $G=\left<h_1,h_2\right>$. Therefore, $G$ is abelian.

We can show that $\left<h_i\right>$ are normal in $G$. Then, $[G:H_i]=p$ and thus $G/H_i$ are cyclic, and thus abelian. Let consider $$\pi: G\longrightarrow G/H_i,$$ defined by $\pi(g)=gH_i$. Take an element of $[G,G]=\left<ghg^{-1}h^{-1}\mid g,h\in G\right>$. You have that $$\pi(ghg^{-1}h^{-1})=\pi(g)\pi(h)\pi(g^{-1})\pi(h^{-1})\underset{G/H_i\ cyclic}{=}H_i$$ and thus and thus $[G,G]\leq H_i$, and since $H_1\cap H_2=\{1\}$, we get $[G,G]=\{1\}$. Therefore $G=G/[G:G]$ is abelian.

Now for something completely different (using representation theory over $\mathbb{C}$)...

Let $G$ be a group of order $p^2$. Let $Irr(G)$ be its set of complex irreducible characters. Note that the principal character $1_G \in Irr(G)$. Since $|G|=p^2=\sum_{\chi \in Irr(G)}\chi(1)^2=1 + \sum_{\chi \in Irr(G)-\{1_G\}}\chi(1)^2$, and for all $\chi \in Irr(G)$: $\chi(1) \mid p^2$, it follows that all $\chi$ must be linear, which is equivalent to $G$ being abelian.