Pattern search (optimization)

Example of convergence of a direct search method on the Broyden function. At each iteration, the pattern either moves to the point which best minimizes its objective function, or shrinks in size if no point is better than the current point, until the desired accuracy has been achieved, or the algorithm reaches a predetermined number of iterations.

Pattern search (also known as direct search, derivative-free search, or black-box search) is a family of numerical optimization methods that does not require a gradient. As a result, it can be used on functions that are not continuous or differentiable. One such pattern search method is "convergence" (see below), which is based on the theory of positive bases. Optimization attempts to find the best match (the solution that has the lowest error value) in a multidimensional analysis space of possibilities.