What are the units or dimensions of the Dirac delta function?

Yes. The Dirac delta always has the inverse dimension of its argument. You can read this from its definition, your first equation. So in one dimension $\delta(x)$ has dimensions of inverse length, in three spatial dimensions $\delta^{(3)}(\vec x)$ (sometimes simply written $\delta(\vec x)$) has dimension of inverse volume, and in $n$ dimensions of momentum $\delta^{(n)}(\vec p)$ has dimensions of inverse momentum to the power of $n$.

Let $x$ be dimensionless and Using the property $\delta (ax)=\frac{1}{|a|}\delta (x)$ we see that indeed the dimension of a Dirac delta is the dimension of the inverse of its argument.

One reoccurring example is eg $\delta(p'-p)$ where $p$ denotes momentum, this delta has dimension of inverse mass in natural units.