Image for a strict local minimizer that is not an isolated minimizer

As others have pointed out correctly, this happens when you have a series of local minimizers that converge to a minimizer that has a better value than what they have.

So, this is something that is not very easy to draw knowing that the local minimizers should get very close to each other when converging to the final point. Having said that I tried my best to depict it (it is actually easier to imagine it instead of drawing it)Sorry for my poor drawing

The key to understanding the difference is the term "only local minimizer in N" in the definition of the isolated local minimizer. A point could be the global minimizer in a neighbourhood (as the origin is in the image above), but there might be infinitely many local minimizers in that neighbourhood which are not as good as this point, but they are still local minimizers. In that sense, although this point is strict local minimizer as no other point can beat its value, but is not an isolated local minimizer (there is a sequence of local minimizers converging to it with strictly higher function value).

Note: you could think of much simpler examples if you do not limit yourself to the continuous functions: $f(x) = 1$ if $x\neq 0$ and $f(0) = 0$ at zero has this property. In any neighbourhood around 0, 0 is the strict local minimizer, but any other point in the neighbourhood is also a local minimizer. So, 0 is not an isolated local minimum.


To get some function that looks like the graph in Maziar Sanjabi's answer, we can

  1. Find a function that has a basic shape like that, such as $f(x)=x^2$;
  2. Multiply $f(x)$ with a periodic function that has infinitely small period as it approaches $x=0$, which is the local minimizer of $f(x)$, one such function is $g(x)=2-\cos(30/x)$.

We have $h(x)=f(x)g(x)$, which looks like:

enter image description here

It oscillates between $x^2$ and $3x^2$.