How does a Genetic Algorithm work?

Genetic Algorithms are a subset of Evolutionary Algorithms, a group of search and optimization engines inspired by the natural process of evolution. Evolutionary Algorithms typically use evolutionary selection, variation, and replacement operations to augment or replace populations in a generational manner in order to improve the overall fittest solution. An example of this process cycle is shown in Fig. 1. Figure 1: The evolutionary cycle of a typical evolutionary algorithm. Each block represents an operation on a population of candidate solutions.