The physical units of the Dirac delta function

If $a(t)$ is acceleration and $t$ is time, will $\int a(t) \, dt$ have dimension $\text{length}^2$ since we are finding the area under the graph? No, it will not; it will have dimension $\text{length}/\text{time}$.

The interpretation of integral as area should not be taken too far.