IOHanalyzer

The performance analyzer for Iterative Optimization Heuristics (IOHs).

It provides:

It is built on:

It is available through:

Online Service

A free server http://iohprofiler.liacs.nl running the stable version of IOHanalyzer is hosted in Leiden Institute of Advanced Computer Science. You’re welcome to check it out!

Installation

Software dependency

Stable version

Please start up a R console and install the stable version as:

install.packages('IOHanalyzer')

which is maintained on CRAN (Comprehensive R Archive Network).

Lastest version

The lastest development is always hosted on Github. In case you’d like to try out this version, the R package devtool is needed:

install.packages('devtools')
devtools::install_github('IOHprofiler/IOHanalyzer')

Runinng the Web Interface locally

The IOHanalyzer package can be installed and loaded using the following commands:

library('IOHanalyzer')
runServer()

Have fun! For the complete reference on usage, please check out our Wiki page.

Host it online?

We provide docker file for deploying IOHanalyzer on the server. Please see https://github.com/IOHprofiler/IOHanalyzer-docker for details.

Supported Data Format

Specific formats are required to load your benchmark data to IOHanalyzer. If your data sets are generated in the format of

then you just need to compress the data folder obtained from the experiment into a zip file and uploaded it. However, you are encouraged to convert your own benchmark data to the format regulated here!. The supported data format is specified in this page. Please follow the instruction there to convert your data sets.

Our Team

When using IOHprofiler and parts thereof, please kindly cite this work as

Carola Doerr, Hao Wang, Furong Ye, Sander van Rijn, Thomas Bäck: IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics, arXiv e-prints:1810.05281, 2018.

@ARTICLE{IOHprofiler,
  author = {Carola Doerr and Hao Wang and Furong Ye and Sander van Rijn and Thomas B{\"a}ck},
  title = {{IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics}},
  journal = {arXiv e-prints:1810.05281},
  archivePrefix = "arXiv",
  eprint = {1810.05281},
  year = 2018,
  month = oct,
  keywords = {Computer Science - Neural and Evolutionary Computing},
  url = {https://arxiv.org/abs/1810.05281}
}

License

This application is governed by the BSD 3-Clause license.

BSD 3-Clause License

Copyright (c) 2018, All rights reserved.

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.