The Hopfield network, designed by J. Hopfield as an optimization tool, is based on the concept of associative memory. It is often described as an associative memory similar to linear memory. However, the self-associative memories of the Hopfield network are non-linear because each neuron in the system can be either active or inactive (i.e., its response is binary: 1 or -1) and operates asynchronously.