18
1

Achieving Tight O(4k)O(4^k) Runtime Bounds on Jumpk_k by Proving that Genetic Algorithms Evolve Near-Maximal Population Diversity

Abstract

The JUMPk_k benchmark was the first problem for which crossover was proven to give a speed-up over mutation-only evolutionary algorithms. Jansen and Wegener (2002) proved an upper bound of O(poly(n)+4k/pc)O(\text{poly}(n) + 4^k/p_c) for the (μ\mu+1) Genetic Algorithm ((μ+1)(\mu+1) GA), but only for unrealistically small crossover probabilities pcp_c. To this date, it remains an open problem to prove similar upper bounds for realistic pcp_c; the best known runtime bound, in terms of function evaluations, for pc=Ω(1)p_c = \Omega(1) is O((n/χ)k1)O((n/\chi)^{k-1}), χ\chi a positive constant. We provide a novel approach and analyse the evolution of the population diversity, measured as sum of pairwise Hamming distances, for a variant of the (μ+1)(\mu+1) GA on JUMPk_k. The (μ+1)(\mu+1)-λc\lambda_c-GA creates one offspring in each generation either by applying mutation to one parent or by applying crossover λc\lambda_c times to the same two parents (followed by mutation), to amplify the probability of creating an accepted offspring in generations with crossover. We show that population diversity in the (μ+1)(\mu+1)-λc\lambda_c-GA converges to an equilibrium of near-perfect diversity. This yields an improved time bound of O(μnlog(μ)+4k)O(\mu n \log(\mu) + 4^k) function evaluations for a range of kk under the mild assumptions pc=O(1/k)p_c = O(1/k) and μΩ(kn)\mu \in \Omega(kn). For all constant kk, the restriction is satisfied for some pc=Ω(1)p_c = \Omega(1) and it implies that the expected runtime for all constant kk and an appropriate μ=Θ(kn)\mu = \Theta(kn) is bounded by O(n2logn)O(n^2 \log n), irrespective of kk. For larger kk, the expected time of the (μ+1)(\mu+1)-λc\lambda_c-GA is Θ(4k)\Theta(4^k), which is tight for a large class of unbiased black-box algorithms and faster than the original (μ+1)(\mu+1) GA by a factor of Ω(1/pc)\Omega(1/p_c). We also show that our analysis can be extended to other unitation functions such as JUMPk,δ_{k, \delta} and HURDLE.

View on arXiv
@article{opris2025_2404.07061,
  title={ Achieving Tight $O(4^k)$ Runtime Bounds on Jump$_k$ by Proving that Genetic Algorithms Evolve Near-Maximal Population Diversity },
  author={ Andre Opris and Johannes Lengler and Dirk Sudholt },
  journal={arXiv preprint arXiv:2404.07061},
  year={ 2025 }
}
Comments on this paper