Understanding Epsilon-Delta Proof

I think your main issue is that you are still trying to think about this exercise as a routine algebraic manipulation. It is not exactly like that.

The thing is that here we have a goal/target about ensuring that some inequality holds. In current question the goal is to ensure that $$|x^2-9|<\epsilon$$ We are not supposed to find all values of $x$ for which the above inequality holds (similar to solving equations like $x^2=9$). The problem is not exactly algebraic. Rather what we desire is to find a range of values of $x$ near $3$ for which this inequality can be ensured. Such a range of values of $x$ may or may not exist. Our task is to prove that such a range of values of $x$ near $3$ always exists no matter what $\epsilon $ is given.

The technique is to replace the target inequality by a simpler one. Thus we have to find some expression $g(x) $ which is simpler in form and satisfies $$|x^2-9|<g(x)$$ and then replace the goal with ensuring that $g(x) <\epsilon $. Thus our original target is to be achieved via a combination of two simpler goals $|x^2-9|<g(x)$ and $g(x) <\epsilon$.

The problem is now to choose a suitable $g(x) $ and to find a range of values of $x$ near $3$ which can ensure that both the sub-goals are met. This is where one has great leverage and problem is actually far simpler than it appears. We have $$|x^2-9|=|x+3||x-3|$$ Now let us choose any specific range of values of $x$ near $3$, say $|x-3|<1$ (this is totally as per your wish, but in general the range should be such that the desired simplification in what follows is possible). And $$|x+3|\leq |x-3|+6<7$$ and therefore we have $$|x^2-9|=|x+3||x-3|<7|x-3|$$ for the range of values of $x$ given by $|x-3|<1$.

Thus we can choose $g(x) =7|x-3|$ and one of the sub goals is achieved for the range $|x-3|<1$. The other goal is now simpler $$7|x-3|<\epsilon $$ Obviously this can be achieved by the range of values of $x$ given by $|x-3|<\epsilon /7$ (if this is not obvious to you then you need to see how inequalities work in general).

So for the two goals we have found two ranges of values of $x$ namely $|x-3|<1$ and $|x-3|<\epsilon /7$ which ensures that the respective goals are met. Since we want to ensure that both the goals are met simultaneously we need to deal with the range of values of $x$ which are common to both $|x-3|<1$ and $|x-3|<\epsilon/7$. This is possible if $|x-3|<\min(1,\epsilon /7)$ and we are done by setting $\delta=\min(1,\epsilon/7)$ and our desired range of values of $x$ is $|x-3|<\delta$.


The important thing to notice here is that our original problem to ensure some inequality is replaced by two far simpler (but not necessarily equivalent) problems. This is in quite contrast to solving equations like $x^2-9=0$ where the problem is reduced to two simpler and equivalent problems $x-3=0,x+3=0$.

The fact that we have to simplify the problem without caring about equivalence gives us great leverage here. Most beginners however don't notice this and instead focus on solving inequalities (where the problem can be simplified but only to an equivalent one) and this is one of stumbling blocks in understanding and applying definition of limit.

More formally the target inequality $$|f(x) - L|<\epsilon $$ is not a hypothesis but a conclusion in a long chain of logical implications. Also by definition the implications involved are one way and you don't need to put any extra effort to unnecessarily ensure a both way implication. And we present our argument like "the target conclusion, say $A$, holds if (not iff) $B, C, \dots$ hold and so on till we reach a stage where we get to see ranges of values of $x$". So the chain of implications is figured out in reverse.

Using your own words from question: how $$|x+3||x-3|<\epsilon$$ and $$|x+3||x-3|<C|x-3|$$ lead to $$|x-3|<\epsilon /C$$ is not the right question, but you should ask how $$|x-3|<\epsilon /C$$ and $$|x+3||x-3|<C|x-3|$$ lead to $$|x+3||x-3|<\epsilon $$ This is the desired logical flow and it would now look obvious to you. The thing however is that the individual logical implications have to be figured out in reverse starting from the conclusion to the hypotheses.

Years of training in algebraic manipulation which are mostly forward or both way implications makes things in analysis a little bit surprising (if not difficult) when we have to deal with one way implications in reverse manner. Thus we switch from "$A$ implies $B$" to "$B$ holds if $A$ holds".


  1. The author is just saying that if $|x+3||x-3|<C|x-3|$, then$$|x-3|<\frac\varepsilon C\implies|x+3||x-3|<C|x-3|<C\frac\varepsilon C=\varepsilon.$$
  2. If you define $\delta=\min\left\{1,\frac\varepsilon7\right\}$, then, if $|x-3|<\delta$, you know that $|x-3|<1$ and that $x-3|<\frac\varepsilon7$. And the author proved that, when both of these inequalities hold, $|x+3||x-3|<\varepsilon$.

Proposition 1: Let $p, v, M \in \Bbb R$ with $v,M \gt 0$.
Let $f$ be a real-valued function that is defined over the interval $[p-v,p+v]$ satisfying

$\tag 1 \displaystyle {\lim _{x \to p} f(x) = 0}$

Let $g:[p-v,p+v] \to \Bbb R$ be given and satisfy $|g(x)| \le M$ for all $x$ in its domain.

Then the function $h(x) = f(x)g(x)$ defined over $[p-v,p+v]$ satisfies

$\tag 2 \displaystyle {\lim _{x \to p} h(x) = 0}$ Proof
Let the challenge $\varepsilon \gt 0$ be submitted for $\text{(2)}$.

By $\text{(1)}$, for the number $\varepsilon_f = \frac{\varepsilon}{M}$ a corresponding $\delta_f \gt 0$ can be specified such that

$\quad 0 \lt |x - p| \lt \delta_f \text{ implies } |f(x)| \lt \varepsilon_f$

Set $\delta = \text{min}(\delta_f,v)$. It is easy to see that

$\quad 0 \lt |x - p| \lt \delta \text{ implies } |h(x)| \lt \varepsilon$

and so the validity of $\text{(2)}$ has been established. $\quad \blacksquare$

For the OP's problem, set

$f(x) = x - 3$
$g(x) = x + 3$
$p = 3$
$v = 1$

Now if we check we see that the $|g(x)| \le 7$ on $[2,4]$ so set $M = 7$.

For any $\varepsilon$ presented for $\displaystyle \lim_{x\to3} x^2 = 9$, we can '$\text{turn the proposition 1 crank}$', and let

$\quad \delta = \text{min}(\frac{\varepsilon}{7},1)$

Note that since $f(x) = x -1$ has slope equal to $1$, $\,\delta_f = \epsilon_f$.