For each $a \in \mathbb{R}$ evaluate $ \lim\limits_{n \to \infty}\left(\begin{smallmatrix}1&\frac{a}{n}\\\frac{-a}{n}&1\end{smallmatrix}\right)^n$

Your answer is correct as well. but there is a short way to reach it. Merely by putting ourselves in the complex plan where we identify

$$ 1 \equiv \left(\begin{matrix} 1& 0\\0&1 \end{matrix}\right)~~~\text{and}~~~~ i \equiv \left(\begin{matrix} 0& 1\\-1&0 \end{matrix}\right).$$

Thus, $$\begin{align}\displaystyle \lim_{n \to \infty}\left(\begin{matrix} 1&\dfrac{a}{n}\\\dfrac{-a}{n}&1\end{matrix}\right)^{n} &= \displaystyle \lim_{n \to \infty}\color{blue}{\left(1+\dfrac{ai}{n}\right)^n} \\&=\color{red}{e^{ai} = \cos a+i\sin a} \\&= \left(\begin{matrix} \cos a&\sin a\\-\sin a&\cos a\end{matrix}\right).\end{align}$$

Given that, for any $z\in \Bbb C$ we have, $\lim\limits_{n \to \infty}\left(1+\dfrac{z}{n}\right)^n =e^{z} $ See here also here,


The best approach is to diagonalize your matrix. Both $(1,i)$ and $(1,-i)$ are eigenvectors. So, let$$T=\begin{pmatrix}1&1\\i&-i\end{pmatrix}.$$Then$$T^{-1}.\begin{pmatrix}1&\frac an\\-\frac an&1\end{pmatrix}.T=\begin{pmatrix}1+\frac ani&0\\0&1-\frac 1ni\end{pmatrix}.$$Therefore$$T^{-1}.\begin{pmatrix}1&\frac an\\-\frac an&1\end{pmatrix}^n.T=\begin{pmatrix}1+\frac ani&0\\0&1-\frac 1ni\end{pmatrix}^n=\begin{pmatrix}\left(1+\frac{ai}n\right)^n&0\\0&\left(1-\frac{ai}n\right)^n\end{pmatrix}$$ and so$$\lim_{n\to\infty}T^{-1}.\begin{pmatrix}1&\frac an\\-\frac an&1\end{pmatrix}^n.T=\begin{pmatrix}e^{ai}&0\\0&e^{-ai}\end{pmatrix}.$$So$$\lim_{n\to\infty}\begin{pmatrix}1&\frac an\\-\frac an&1\end{pmatrix}^n=T.\begin{pmatrix}e^{ai}&0\\0&e^{-ai}\end{pmatrix}.T^{-1}=\begin{pmatrix}\cos a&\sin a\\-\sin a&\cos a\end{pmatrix}.$$