Test functions for optimization

Template:Short description In applied mathematics, test functions, known as artificial landscapes, are useful to evaluate characteristics of optimization algorithms, such as convergence rate, precision, robustness and general performance.

Here some test functions are presented with the aim of giving an idea about the different situations that optimization algorithms have to face when coping with these kinds of problems. In the first part, some objective functions for single-objective optimization cases are presented. In the second part, test functions with their respective Pareto fronts for multi-objective optimization problems (MOP) are given.

The artificial landscapes presented herein for single-objective optimization problems are taken from Bäck, Haupt et al. and from Rody Oldenhuis software. Given the number of problems (55 in total), just a few are presented here.

The test functions used to evaluate the algorithms for MOP were taken from Deb, Binh et al. and Binh. The software developed by Deb can be downloaded, which implements the NSGA-II procedure with GAs, or the program posted on Internet, which implements the NSGA-II procedure with ES.

Just a general form of the equation, a plot of the objective function, boundaries of the object variables and the coordinates of global minima are given herein.

Test functions for single-objective optimization

Name	Plot	Formula	Global minimum	Search domain
Rastrigin function	Rastrigin function for n=2	$f(𝐱)=An+\sum _{i=1}^n[x_i^2-A\cos (2\pi x_i)]$ $\text{where: }A=10\text{ and }𝐱\in {ℝ}^n$	$f(0,\dots ,0)=0$	$-5.12\le x_i\le 5.12$
Ackley function	Ackley's function for n=2	$f(x,y)=-20\exp [-0.2\sqrt{0.5(x^2+y^2)}]$ $-\exp \left[0.5(\cos 2\pi x+\cos 2\pi y)\right]+e+20$	$f(0,0)=0$	$-5\le x,y\le 5$
Sphere function	Sphere function for n=2	$f(𝒙)=\sum _{i=1}^n{x}_i^2$	$f(x_1,\dots ,x_n)=f(0,\dots ,0)=0$	$-\mathrm{\infty }\le x_i\le \mathrm{\infty }$, $1\le i\le n$
Rosenbrock function	Rosenbrock's function for n=2	$f(𝒙)=\sum _{i=1}^{n-1}[100{(x_{i+1}-x_i^2)}^2+{(1-x_i)}^2]$	$\text{Min}=\{\begin{array}{cc}n=2& \to f(1,1)=0,\\ n=3& \to f(1,1,1)=0,\\ n>3& \to f(\underset{n\text{ times}}{\underbrace{1,\dots ,1}})=0\end{array}$	$-\mathrm{\infty }\le x_i\le \mathrm{\infty }$, $1\le i\le n$
Beale function	Beale's function	$f(x,y)={(1.5-x+xy)}^2+{(2.25-x+x{y}^2)}^2$ $+{(2.625-x+x{y}^3)}^2$	$f(3,0.5)=0$	$-4.5\le x,y\le 4.5$
Goldstein–Price function	Goldstein–Price function	$f(x,y)=[1+{(x+y+1)}^2(19-14x+3x^2-14y+6xy+3y^2)]$ $[30+{(2x-3y)}^2(18-32x+12x^2+48y-36xy+27y^2)]$	$f(0,-1)=3$	$-2\le x,y\le 2$
Booth function	Booth's function	$f(x,y)={(x+2y-7)}^2+{(2x+y-5)}^2$	$f(1,3)=0$	$-10\le x,y\le 10$
Bukin function N.6	Bukin function N.6	$f(x,y)=100\sqrt{|y-0.01x^2|}+0.01|x+10|.$	$f(-10,1)=0$	$-15\le x\le -5$, $-3\le y\le 3$
Matyas function	Matyas function	$f(x,y)=0.26(x^2+y^2)-0.48xy$	$f(0,0)=0$	$-10\le x,y\le 10$
Lévi function N.13	Lévi function N.13	$f(x,y)={\sin }^{2}3\pi x+{(x-1)}^2(1+{\sin }^{2}3\pi y)$ $+{(y-1)}^2(1+{\sin }^{2}2\pi y)$	$f(1,1)=0$	$-10\le x,y\le 10$
Griewank function	Griewank's function	$f(𝒙)=1+\frac{1}{4000}\sum _{i=1}^n{x}_i^2-\prod _{i=1}^n{P}_i(x_i)$, where $P_i(x_i)=\cos \left(\frac{x_i}{\sqrt{i}}\right)$	$f(0,\dots ,0)=0$	$-\mathrm{\infty }\le x_i\le \mathrm{\infty }$, $1\le i\le n$
Himmelblau's function	Himmelblau's function	$f(x,y)=(x^2+y-11{)}^2+(x+y^2-7{)}^2.$	$\text{Min}=\{\begin{array}{cc}f(3.0,2.0)& =0.0\\ f(-2.805118,3.131312)& =0.0\\ f(-3.779310,-3.283186)& =0.0\\ f(3.584428,-1.848126)& =0.0\end{array}$	$-5\le x,y\le 5$
Three-hump camel function	Three Hump Camel function	$f(x,y)=2x^2-1.05x^4+\frac{x^6}{6}+xy+y^2$	$f(0,0)=0$	$-5\le x,y\le 5$
Easom function	Easom function	$f(x,y)=-\cos \left(x\right)\cos \left(y\right)\exp (-({(x-\pi )}^2+{(y-\pi )}^2))$	$f(\pi ,\pi )=-1$	$-100\le x,y\le 100$
Cross-in-tray function	Cross-in-tray function	$f(x,y)=-0.0001{[|\sin x\sin y\exp \left(|100-\frac{\sqrt{x^2+y^2}}{\pi }|\right)|+1]}^{0.1}$	$\text{Min}=\{\begin{array}{cc}f(1.34941,-1.34941)& =-2.06261\\ f(1.34941,1.34941)& =-2.06261\\ f(-1.34941,1.34941)& =-2.06261\\ f(-1.34941,-1.34941)& =-2.06261\end{array}$	$-10\le x,y\le 10$
Eggholder function	Eggholder function	$f(x,y)=-(y+47)\sin \sqrt{|\frac{x}{2}+(y+47)|}-x\sin \sqrt{|x-(y+47)|}$	$f(512,404.2319)=-959.6407$	$-512\le x,y\le 512$
Hölder table function	Holder table function	$f(x,y)=-|\sin x\cos y\exp \left(|1-\frac{\sqrt{x^2+y^2}}{\pi }|\right)|$	$\text{Min}=\{\begin{array}{cc}f(8.05502,9.66459)& =-19.2085\\ f(-8.05502,9.66459)& =-19.2085\\ f(8.05502,-9.66459)& =-19.2085\\ f(-8.05502,-9.66459)& =-19.2085\end{array}$	$-10\le x,y\le 10$
McCormick function	McCormick function	$f(x,y)=\sin (x+y)+{(x-y)}^2-1.5x+2.5y+1$	$f(-0.54719,-1.54719)=-1.9133$	$-1.5\le x\le 4$, $-3\le y\le 4$
Schaffer function N. 2	Schaffer function N.2	$f(x,y)=0.5+\frac{{\sin }^2(x^2-y^2)-0.5}{{[1+0.001(x^2+y^2)]}^2}$	$f(0,0)=0$	$-100\le x,y\le 100$
Schaffer function N. 4	Schaffer function N.4	$f(x,y)=0.5+\frac{{\cos }^2[\sin \left(|x^2-y^2|\right)]-0.5}{{[1+0.001(x^2+y^2)]}^2}$	$\text{Min}=\{\begin{array}{cc}f(0,1.25313)& =0.292579\\ f(0,-1.25313)& =0.292579\\ f(1.25313,0)& =0.292579\\ f(-1.25313,0)& =0.292579\end{array}$	$-100\le x,y\le 100$
Styblinski–Tang function	Styblinski-Tang function	$f(𝒙)=\frac{\sum _{i=1}^n{x}_i^4-16x_i^2+5x_i}{2}$	$-39.16617n<f(\underset{n\text{ times}}{\underbrace{-2.903534,\dots ,-2.903534}})<-39.16616n$	$-5\le x_i\le 5$, $1\le i\le n$..
Shekel function	A Shekel function in 2 dimensions and with 10 maxima	$f(𝒙)=\sum _{i=1}^m{(c_i+\sum _{j=1}^n(x_j-a_{ji}{)}^2)}^{-1}$		$-\mathrm{\infty }\le x_i\le \mathrm{\infty }$, $1\le i\le n$

Test functions for constrained optimization

Name	Plot	Formula	Global minimum	Search domain
Rosenbrock function constrained to a disk	Rosenbrock function constrained to a disk	$f(x,y)=(1-x{)}^2+100(y-x^2{)}^2$, subjected to: $x^2+y^2\le 2$	$f(1.0,1.0)=0$	$-1.5\le x\le 1.5$, $-1.5\le y\le 1.5$
Mishra's Bird function - constrained	Bird function (constrained)	$f(x,y)=\sin (y)e^{[(1-\cos x{)}^2]}+\cos (x)e^{[(1-\sin y{)}^2]}+(x-y{)}^2$, subjected to: $(x+5{)}^2+(y+5{)}^2<25$	$f(-3.1302468,-1.5821422)=-106.7645367$	$-10\le x\le 0$, $-6.5\le y\le 0$
Townsend function (modified)	Heart constrained multimodal function	$f(x,y)=-[\cos ((x-0.1)y){]}^2-x\sin (3x+y)$, subjected to:$x^2+y^2<{[2\cos t-\frac{1}{2}\cos 2t-\frac{1}{4}\cos 3t-\frac{1}{8}\cos 4t]}^2+[2\sin t{]}^2$ where: t = Atan2(x,y)	$f(2.0052938,1.1944509)=-2.0239884$	$-2.25\le x\le 2.25$, $-2.5\le y\le 1.75$
Keane's bump function	Keane's bump function	$f(𝒙)=-\left|\frac{[\sum _{i=1}^m{\cos }^4(x_i)-2\prod _{i=1}^m{\cos }^2(x_i)]}{{\left(\sum _{i=1}^{m}i{x}_i^2\right)}^{0.5}}\right|$, subjected to: $0.75-\prod _{i=1}^m{x}_i<0$, and $\sum _{i=1}^m{x}_i-7.5m<0$	$f((1.60025376,0.468675907))=-0.364979746$	$0<x_i<10$

Test functions for multi-objective optimization

Name	Plot	Functions	Constraints	Search domain
Binh and Korn function:	Binh and Korn function	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=4x^2+4y^2\\ f_2(x,y)={(x-5)}^2+{(y-5)}^2\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1(x,y)={(x-5)}^2+y^2\le 25\\ g_2(x,y)={(x-8)}^2+{(y+3)}^2\ge 7.7\end{array}$	$0\le x\le 5$, $0\le y\le 3$
Chankong and Haimes function:	Chakong and Haimes function	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=2+{(x-2)}^2+{(y-1)}^2\\ f_2(x,y)=9x-{(y-1)}^2\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1(x,y)=x^2+y^2\le 225\\ g_2(x,y)=x-3y+10\le 0\end{array}$	$-20\le x,y\le 20$
Fonseca–Fleming function:	Fonseca and Fleming function	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=1-\exp [-\sum _{i=1}^n{(x_i-\frac{1}{\sqrt{n}})}^2]\\ f_2\left(𝒙\right)=1-\exp [-\sum _{i=1}^n{(x_i+\frac{1}{\sqrt{n}})}^2]\end{array}$		$-4\le x_i\le 4$, $1\le i\le n$
Test function 4:	Test function 4.[6]	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=x^2-y\\ f_2(x,y)=-0.5x-y-1\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1(x,y)=6.5-\frac{x}{6}-y\ge 0\\ g_2(x,y)=7.5-0.5x-y\ge 0\\ g_3(x,y)=30-5x-y\ge 0\end{array}$	$-7\le x,y\le 4$
Kursawe function:	Kursawe function	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=\sum _{i=1}^2[-10\exp (-0.2\sqrt{x_i^2+x_{i+1}^2})]\\ & \\ f_2\left(𝒙\right)=\sum _{i=1}^3[{\left|x_i\right|}^{0.8}+5\sin \left(x_i^3\right)]\end{array}$		$-5\le x_i\le 5$, $1\le i\le 3$.
Schaffer function N. 1:	Schaffer function N.1	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(x\right)=x^2\\ f_2\left(x\right)={(x-2)}^2\end{array}$		$-A\le x\le A$. Values of $A$ from $10$ to $10^5$ have been used successfully. Higher values of $A$ increase the difficulty of the problem.
Schaffer function N. 2:	Schaffer function N.2	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(x\right)=\{\begin{array}{cc}-x,& \text{if }x\le 1\\ x-2,& \text{if }1<x\le 3\\ 4-x,& \text{if }3<x\le 4\\ x-4,& \text{if }x>4\end{array}\\ f_2\left(x\right)={(x-5)}^2\end{array}$		$-5\le x\le 10$.
Poloni's two objective function:	Poloni's two objective function	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=[1+{(A_1-B_1(x,y))}^2+{(A_2-B_2(x,y))}^2]\\ f_2(x,y)={(x+3)}^2+{(y+1)}^2\end{array}$ $\text{where}=\{\begin{array}{c}{A}_1=0.5\sin \left(1\right)-2\cos \left(1\right)+\sin \left(2\right)-1.5\cos \left(2\right)\\ A_2=1.5\sin \left(1\right)-\cos \left(1\right)+2\sin \left(2\right)-0.5\cos \left(2\right)\\ B_1(x,y)=0.5\sin \left(x\right)-2\cos \left(x\right)+\sin \left(y\right)-1.5\cos \left(y\right)\\ B_2(x,y)=1.5\sin \left(x\right)-\cos \left(x\right)+2\sin \left(y\right)-0.5\cos \left(y\right)\end{array}$		$-\pi \le x,y\le \pi$
Zitzler–Deb–Thiele's function N. 1:	Zitzler-Deb-Thiele's function N.1	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=x_1\\ f_2\left(𝒙\right)=g\left(𝒙\right)h(f_1\left(𝒙\right),g\left(𝒙\right))\\ g\left(𝒙\right)=1+\frac{9}{29}\sum _{i=2}^{30}{x}_i\\ h(f_1\left(𝒙\right),g\left(𝒙\right))=1-\sqrt{\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}}\end{array}$		$0\le x_i\le 1$, $1\le i\le 30$.
Zitzler–Deb–Thiele's function N. 2:	Zitzler-Deb-Thiele's function N.2	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=x_1\\ f_2\left(𝒙\right)=g\left(𝒙\right)h(f_1\left(𝒙\right),g\left(𝒙\right))\\ g\left(𝒙\right)=1+\frac{9}{29}\sum _{i=2}^{30}{x}_i\\ h(f_1\left(𝒙\right),g\left(𝒙\right))=1-{\left(\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}\right)}^2\end{array}$		$0\le x_i\le 1$, $1\le i\le 30$.
Zitzler–Deb–Thiele's function N. 3:	Zitzler-Deb-Thiele's function N.3	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=x_1\\ f_2\left(𝒙\right)=g\left(𝒙\right)h(f_1\left(𝒙\right),g\left(𝒙\right))\\ g\left(𝒙\right)=1+\frac{9}{29}\sum _{i=2}^{30}{x}_i\\ h(f_1\left(𝒙\right),g\left(𝒙\right))=1-\sqrt{\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}}-\left(\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}\right)\sin \left(10\pi f_1\left(𝒙\right)\right)\end{array}$		$0\le x_i\le 1$, $1\le i\le 30$.
Zitzler–Deb–Thiele's function N. 4:	Zitzler-Deb-Thiele's function N.4	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=x_1\\ f_2\left(𝒙\right)=g\left(𝒙\right)h(f_1\left(𝒙\right),g\left(𝒙\right))\\ g\left(𝒙\right)=91+\sum _{i=2}^{10}(x_i^2-10\cos \left(4\pi x_i\right))\\ h(f_1\left(𝒙\right),g\left(𝒙\right))=1-\sqrt{\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}}\end{array}$		$0\le x_1\le 1$, $-5\le x_i\le 5$, $2\le i\le 10$
Zitzler–Deb–Thiele's function N. 6:	Zitzler-Deb-Thiele's function N.6	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=1-\exp (-4x_1){\sin }^6\left(6\pi x_1\right)\\ f_2\left(𝒙\right)=g\left(𝒙\right)h(f_1\left(𝒙\right),g\left(𝒙\right))\\ g\left(𝒙\right)=1+9{\left[\frac{\sum _{i=2}^{10}{x}_i}{9}\right]}^{0.25}\\ h(f_1\left(𝒙\right),g\left(𝒙\right))=1-{\left(\frac{f_1\left(𝒙\right)}{g\left(𝒙\right)}\right)}^2\end{array}$		$0\le x_i\le 1$, $1\le i\le 10$.
Osyczka and Kundu function:	Osyczka and Kundu function	$\text{Minimize}=\{\begin{array}{c}{f}_1\left(𝒙\right)=-25{(x_1-2)}^2-{(x_2-2)}^2-{(x_3-1)}^2-{(x_4-4)}^2-{(x_5-1)}^2\\ f_2\left(𝒙\right)=\sum _{i=1}^6{x}_i^2\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1\left(𝒙\right)=x_1+x_2-2\ge 0\\ g_2\left(𝒙\right)=6-x_1-x_2\ge 0\\ g_3\left(𝒙\right)=2-x_2+x_1\ge 0\\ g_4\left(𝒙\right)=2-x_1+3x_2\ge 0\\ g_5\left(𝒙\right)=4-{(x_3-3)}^2-x_4\ge 0\\ g_6\left(𝒙\right)={(x_5-3)}^2+x_6-4\ge 0\end{array}$	$0\le x_1,x_2,x_6\le 10$, $1\le x_3,x_5\le 5$, $0\le x_4\le 6$.
CTP1 function (2 variables):	CTP1 function (2 variables).[4]	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=x\\ f_2(x,y)=(1+y)\exp (-\frac{x}{1+y})\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1(x,y)=\frac{f_2(x,y)}{0.858\exp (-0.541f_1(x,y))}\ge 1\\ g_2(x,y)=\frac{f_2(x,y)}{0.728\exp (-0.295f_1(x,y))}\ge 1\end{array}$	$0\le x,y\le 1$.
Constr-Ex problem:	Constr-Ex problem.[4]	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=x\\ f_2(x,y)=\frac{1+y}{x}\end{array}$	$\text{s.t.}=\{\begin{array}{c}{g}_1(x,y)=y+9x\ge 6\\ g_2(x,y)=-y+9x\ge 1\end{array}$	$0.1\le x\le 1$, $0\le y\le 5$
Viennet function:	Viennet function	$\text{Minimize}=\{\begin{array}{c}{f}_1(x,y)=0.5(x^2+y^2)+\sin (x^2+y^2)\\ f_2(x,y)=\frac{{(3x-2y+4)}^2}{8}+\frac{{(x-y+1)}^2}{27}+15\\ f_3(x,y)=\frac{1}{x^2+y^2+1}-1.1\exp (-(x^2+y^2))\end{array}$		$-3\le x,y\le 3$.

External links

• landscapes