In constrained optimization problems, when is 'naive' substitution possible?

Consider the following third problem: $$\text{(P2a)} \quad \min_x ~~ g(x) = x^2 + (x-1)^3 ~~ \text{s.t.} ~~ (x-1)^3=y^2$$ I think you will agree that (P2a) is equivalent to (P1).

So it wasn't the substitution that is the problem! It was the fact that you also eliminated the constraint. It might seem, of course, that you could eliminate it at this point, because $y$ no longer appears in the objective. But this would be incorrect, because it still serves to constrain $x$: $$\begin{aligned}&(x-1)^3=y^2\quad\Longleftrightarrow\quad (x-1)^3\geq 0, \quad y\in\{+(x-1)^{3/2},-(x-1)^{3/2}\}\\ &\qquad\Longleftrightarrow\quad x\geq 1, \quad y\in\{+(x-1)^{3/2},-(x-1)^{3/2}\} \end{aligned}$$ Therefore, a correct model after eliminating $y$ is $$\text{(P2b)} \quad \min_x ~~ g(x) = x^2 + (x-1)^3 ~~ \text{s.t.} ~~ x\geq 1$$

I would therefore challenge your question itself. Rewriting the objective function in this manner is always acceptable. Dropping a constraint, however, is only acceptable if it can be proven that it is not active at any optimal point. Therefore, do not assume you can drop a constraint just because you rewrote the objective.

EDIT: perhaps this will help. Two optimization models are equivalent only if you can readily recover the solution to one from a solution to the other, and vice versa. Thinking about the conditions that must hold in order to be able recover an eliminated variable will help to prevent the elimination of essential constraints. For example, in this case, we can only recover $y$ if $(x-1)^3$ is nonnegative.


You just made a mistake replacing $y^2$ by $(x-1)^3$. There is a hidden constraint on $(x-1)^3$ that you forgot: $(x-1)^3\ge 0$

Tags:

Optimization