COCO-BBOB

Problem Difficulty Classification

BBOB (F1-F24)

Difficulty Mode

Training Set

Testing Set

easy

4, 6-14, 18-20, 22-24

1, 2, 3, 5, 15, 16, 17, 21

difficult

1, 2, 3, 5, 15, 16, 17, 21

4, 6-14, 18-20, 22-24

BBOB-Noisy (F101-F130)

Difficulty Mode

Training Set

Testing Set

easy

102-104, 106-114, 118, 121-124, 126-130

101, 105, 115-117, 119, 120, 125

difficult

101, 105, 115-117, 119, 120, 125

102-104, 106-114, 118, 121-124, 126-130

Note: When difficulty is ‘all’, both training and testing sets contain all problems in the suite.


The blackbox optimization benchmarking (bbob) test suite is COCO’s standard test suite with 24 noiseless, single-objective and scalable test functions. Each function is provided in dimensions (2, 3, 5, 10, 20, 40) and in 15 instances, however also available for arbitrary dimensions and number of instances. Links to their definition with visualizations are provided in the table.

1. Separable Functions

Indax Name
f1 Sphere Function
f2 Separable Ellipsoidal Function
f3 Rastrigin Function
f4 Büche-Rastrigin Function
f5 Linear Slope

2. Functions with low or moderate conditioning

Index Name
f6 Attractive Sector Function
f7 Step Ellipsoidal Function
f8 Rosenbrock Function, original
f9 Rosenbrock Function, rotated

3. Functions with high conditioning and unimodal

Index Name
f10 Ellipsoidal Function
f11 Discus Function
f12 Bent Cigar Function
f13 Sharp Ridge Function
f14 Different Powers Function

4. Multi-modal functions with adequate global structure

Index Name
f15 Rastrigin Function
f16 Weierstrass Function
f17 Schaffer's F7 Function
f18 Schaffer's F7 Function, moderately ill-conditioned
f19 Composite Griewank-Rosenbrock Function F8F2

5. Multi-modal functions with weak global structure

Index Name
f20 Schwefel Function
f21 Gallagher's Gaussian 101-me Peaks Function
f22 Gallagher's Gaussian 21-hi Peaks Function
f23 Katsuura Function
f24 Lunacek bi-Rastrigin Function

Only f1 and f5 are purely convex quadratic (f1) or purely linear in the domain of interest [-5,5]D (f5).