Is it true that the unit ball is compact in a normed linear space iff the space is finite-dimensional?
The unit ball is always closed in a normed (real or complex) linear space. You may be thinking of compactness:
The unit ball is compact iff the space is finite dimensional.
For the first direction, prove the contrapositive by fixing $\epsilon > 0$ and then choosing a countable set of linearly independent vectors with length less than $1$, so that each subsequent vector is further than $\epsilon$ from the span of the previous vectors. This can be done with Riesz's lemma. This is a sequence with no convergent subsequence. For the converse direction, pick a basis and consider $\mathbb{R}^n$.
Thank you for the correction, Martin.
I assume you are talking about compactness.
($\Leftarrow$) Use criterion of compactness for finite-dimensional subspaces - id est closedness and boundedness.
1.1. Unit ball $B$ of normed space $(X,\Vert\cdot\Vert)$ is bounded by definition of boundedness.
1.2. Unit ball is closed because it is preimage of the closedd set $[0,1]\subset \mathbb{R}$ under the continuous map $$ f:X\to\mathbb{R}_+:x\mapsto\Vert x\Vert $$
($\Rightarrow$) Prove ad absurdum. Use Riesz lemma, to construct a sequence $\{x_n:n\in\mathbb{N}\}\subset B$ with the property $$ \forall n,m\in\mathbb{N}\qquad n\neq m\implies \Vert x_n-x_m\Vert>1/2 $$ Show that it have no convergent subsequence.
It depends what you mean by "unit ball". To be make the question precise, let $$U:=\{x\in X: \|x\| < 1\}$$ and $$E:=\{x\in X: \|x\| \leq 1\}.$$ Then the conclusions are the following;
(1) $U$ is open in $X$, and not closed in $X$.
(2) $E$ is closed in $X$ and not open in $X$.
(3) $E$ is compact if and only if $X$ is finite dimensional.
(4) $U$ is totally bounded in $X$ if and only if $X$ is finite dimensional.
(5) $E$ is complete in $X$ if and only if $X$ is complete.
The proofs of (1), (2) are easy, and is left to the reader as exercises.
For the proofs of (3) and (4) see the book: "Functional Analysis: A First Course", PHI-learning, New Delhi, 2002 (Fourth Print: 2014), by me (M.Thamban Nair).
Proof of (5) is also easy, recently observed by me, and is going to appear in an educational news letter. This shows that if the space is not complete, then its "closed unit ball" $E$ is not complete, and hence not compact.