Base120 · Recursion
Gradient Descent Heuristic
Iteratively adjust toward improvement, even without perfect knowledge of optimal direction
When to use
"Use when the optimal direction is unknown but local improvement is measurable. Iteratively adjust in the direction of improvement, even without global knowledge. Simple but can get stuck in local optima."
Example
"A team improves a process by trying small changes and keeping the ones that help. Each week, one change is tested. Over time, the process improves. The team does not know the global optimum, but the local search finds a good-enough solution."
Common misuse
"Getting stuck in a local optimum. Hill climbing finds a peak, but not necessarily the highest peak. Periodically make a random jump (simulated annealing) to escape local optima."