Prove the relation involving derivative of inverse of a function
Let $y_0\in \mathbb{R}$. Then there is $x_0\in\mathbb{R}$ such that $f(x_0)=y_0$. If $x\rightarrow x_0$ and by continuity of $f$ (because $f$ is differentiable) we have $y=f(x)\rightarrow f(x_0)=y_0$. Now, let's check the differentiability of $f^{-1}$ by the definition: $$(f^{-1})'(y_0)=\lim_{y\rightarrow y_0}\frac{f^{-1}(y)-f^{-1}(y_0)}{y-y_0}=\lim_{y\rightarrow y_0}\frac{f^{-1}(f(x))-f^{-1}(f(x_0))}{f(x)-f(x_0)}\\=\lim_{x\rightarrow x_0}\frac{x-x_0}{f(x)-f(x_0)}=\frac{1}{f'(x_0)}=\frac{1}{f'(f^{-1}(y_0))}.$$
For differentiable functions $\mathbb{R} \to \mathbb{R}$ it is easy using geometrical interpretation. Take the graph of $f$, then the graph of $f^{-1}$ is symmetrical with respect to $\{y = x\}$ line. However, $f'(x) = \tan \alpha$ implies that $${f^{-1}}'(y) = \tan\left(\frac{\pi}{2}-\alpha\right) = \cot \alpha = \frac{1}{\tan \alpha} = \frac{1}{f'(x)}.$$
Hope that helps ;-)
The chain rule "derivation" is invalid, because it assumes $f^{-1}$ is differentiable, which is begging the question (circular reasoning).
Here is a valid proof:
Conditions:
i) Function $f$ defined and continuous on a neighborhood of point $x$.
ii) Inverse function $f^{-1}$ defined and continuous on a neighborhood of $y = f(x)$.
iii) $f$ differentiable at point $x$, and $f'(x) \not = 0$.
By the differentiability theorem:
$$f(x + h) - f(x) = h(f'(x) + g(h))$$
where $g(h)$ goes to zero as $h$ goes to zero.
Define $k := h(f'(x) + g(h))$
By limit theorem $k$ also goes to zero as $h$ does.
Since $f'(x)$ is non-zero, you can restrict $|h|$ so that that $|g(h)|$ is less than $|f'(x)|$ (and thus $k$ is non-zero), and add a further restriction so that $f^{-1}$ is defined and continuous on the interval $[y-k, y + k]$.
Now you can show that the derivative exists:
$$\frac{1}{f'(x)} = \lim_{h\to 0} \frac{h}{f(x+h) - f(x)} = \lim_{h\to 0} \frac{f^{-1}(f(x + h)) - f^{-1}(f(x))}{f(x+h)-f(x)} = \lim_{k\to 0} \frac{f^{-1}(y+k) - f^{-1}(y)}{k}.$$
Note: If a function is continuous and strictly increasing or strictly decreasing on a neighborhood of $x$, the inverse function theorem says that $f^{-1}$ is then also strictly increasing/decreasing on a neighborhood of $y$. Thus the inverse function is defined and continuous on a neighborhood of $y$.