iterative optimization method

1. constrained

1.1. linear (convex)

1.1.1. linear programming or LP (continuous)

1.1.1.1. small/medium

1.1.1.1.1. Simplex method (best)

1.1.1.2. large

1.1.1.2.1. Interior-point Method

1.1.2. linear integer programming or LIP (discrete)

1.1.3. mixed integer programming or MIP (continuous & discrete)

1.2. nonlinear

1.2.1. convex

1.2.1.1. continuous

1.2.1.2. discrete

1.2.2. nonconvex

1.2.2.1. global?

1.2.2.1.1. randomization of the initial point

2. unconstrained (nonlinear)

2.1. convex

2.2. nonconvex