Towards better estimation of statistical significance when comparing evolutionary algorithms

Allbwn ymchwil: Pennod mewn Llyfr/Adroddiad/Trafodion CynhadleddTrafodion Cynhadledd (Nid-Cyfnodolyn fathau)

Crynodeb

The use of well-established statistical testing procedures to compare the performance of evolutionary algorithms often yields pessimistic results. This requires increasing the number of independent samples, and thus the computation time, in order to get results with the necessary precision.

We aim at improving this situation by developing statistical tests that are good in answering typical questions coming from benchmarking of evolutionary algorithms. Our first step, presented in this paper, is a procedure that determines whether the performance distributions of two given algorithms are identical for each of the benchmarks. Our experimental study shows that this procedure is able to spot very small differences in the performance of algorithms while requiring computational budgets which are by an order of magnitude smaller (e.g. 15x) compared to the existing approaches.
Iaith wreiddiolSaesneg
TeitlGECCO '19
Is-deitlProceedings of the Genetic and Evolutionary Computation Conference Companion
GolygyddionManuel López-Ibáñez
CyhoeddwrAssociation for Computing Machinery
Tudalennau1782-1788
Nifer y tudalennau7
ISBN (Argraffiad)978-1-4503-6748-6
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 13 Gorff 2019
Cyhoeddwyd yn allanolIe
DigwyddiadGECCO 2019: The Genetic and Evolutionary Computation Conference - Prague, Y Weriniaeth Tsiec
Hyd: 13 Gorff 201917 Gorff 2019
https://gecco-2019.sigevo.org

Cynhadledd

CynhadleddGECCO 2019: The Genetic and Evolutionary Computation Conference
Gwlad/TiriogaethY Weriniaeth Tsiec
DinasPrague
Cyfnod13 Gorff 201917 Gorff 2019
Cyfeiriad rhyngrwyd

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Towards better estimation of statistical significance when comparing evolutionary algorithms'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn