International Workshop on Benchmarking of Computational Intelligence Algorithms (BOCIA)

at the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018)

March 29-31, 2018 in Xiamen [厦门], Fujian [福建省], China
http://iao.hfuu.edu.cn/bocia18

BOCIA, the International Workshop on Benchmarking of Computational Intelligence Algorithms, a part of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), was cordially inviting the submission of original and unpublished research papers. It took place on March 31st, 2018.

Computational Intelligence (CI) is a huge and expanding field which is rapidly gaining importance, attracting more and more interests from both academia and industry. It includes a wide and ever-growing variety of optimization and machine learning algorithms, which, in turn, are applied to an even wider and faster growing range of different problem domains. For all of these domains and application scenarios, we want to pick the best algorithms. Actually, we want to do more, we want to improve upon the best algorithm. This requires a deep understanding of the problem at hand, the performance of the algorithms we have for that problem, the features that make instances of the problem hard for these algorithms, and the parameter settings for which the algorithms perform the best. Such knowledge can only be obtained empirically, by collecting data from experiments, by analyzing this data statistically, and by mining new information from it. Benchmarking is the engine driving research in the fields of optimization and machine learning for decades, while its potential has not been fully explored. Benchmarking the algorithms of Computational Intelligence is an application of Computational Intelligence itself! This workshop wants to bring together experts on benchmarking of optimization and machine learning algorithms. It provides a common forum for them to exchange findings and to explore new paradigms for performance comparison.

Here you can download the BOCIA Workshop Call for Papers (CfP) in PDF format and here as plain text file.

All accepted papers in this workshop will be included in the Proceedings of the IEEE ICACI 2018 published by IEEE Press and indexed by EI. Authors of selected papers will be invited to submit extended versions of these papers to the Special Issue on Benchmarking of Computational Intelligence Algorithms in the Applied Soft Computing journal by Elsevier B.V., indexed by EI and SCIE. Here you can download the Special Issue Call for Papers (CfP) in PDF format and here as plain text file.

Summary

It was an honor and pleasure to organize and  chair the International Workshop on Benchmarking of Computational Intelligence Algorithms (BOCIA) at the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018) on March 31st, 2018 in Xiamen [厦门], Fujian [福建省], China. Our program was packed with seven very interesting presentations on the field, each of which discussing another aspect or application where algorithm performance was mined using modern statistics. I work on this field for several years now and still found the proposed ideas novel and the presentations quite inspiring. Indeed, each presentation led to an exciting discussion, so the workshop could indeed become a platform for the exchange of thoughts.

We want to wholeheartedly thank all of our authors for their research contributions and insightful presentations and the audience for their valuable comments and discussions. It should be mentioned that our workshop was the very last session at ICACI>, yet was attended very well. This also speaks for the great organization of ICACI, whose chairs managed to attract several top-level keynote and tutorial presenters and an audience who deeply cares about research on Computational Intelligence. Of course, we would also like to thank our program committee, without whom organizing our workshop would have been impossible.

Final Program

1. Yiqin Zhang, Fenlin Liu, Hongyan Jia, This email address is being protected from spambots. You need JavaScript enabled to view it., and Chunfang Yang. "Optimization of Rich Model based on Fisher Criterion for Image Steganalysis" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 809—814
2. This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., and This email address is being protected from spambots. You need JavaScript enabled to view it.. "A Research on Metric Learning in Computer Vision and Pattern Recognition" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 815—820
3. This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., and This email address is being protected from spambots. You need JavaScript enabled to view it.. "An Improved Estimation of Distribution Algorithm for Cloud Computing Resource Scheduling" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 821—826
4. This email address is being protected from spambots. You need JavaScript enabled to view it. and Jinlong Li. "Tuning the Hyper-parameters of CMA-ES with Tree-structured Parzen Estimators" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 827—832
5. This email address is being protected from spambots. You need JavaScript enabled to view it. and This email address is being protected from spambots. You need JavaScript enabled to view it.. "A Hybrid Multi-swarm Particle Swarm Optimization with One-Dimensional Chaotic Search Strategy" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 833—838
6. This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., and This email address is being protected from spambots. You need JavaScript enabled to view it.. "A Density-based Discretization Method With Inconsistency Evaluation" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 839—844
7. This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., and This email address is being protected from spambots. You need JavaScript enabled to view it.. "Optimization Algorithm Behavior Modeling: A Study on the Traveling Salesman Problem" in Proceedings of the Tenth International Conference on Advanced Computational Intelligence (ICACI 2018), March 29-31, 2018, Xiamen, Fujian, China, IEEE, ISBN: 978-1-5386-4362-4, pages 845—850. pdf / slides

Photos

Topics of Interest

The topics of interest for this workshop include, but are not limited to:

• mining of higher-level information from experimental results
• modelling of algorithm behaviors and performance
• visualizations of algorithm behaviors and performance
• statistics for performance comparison (robust statistics, PCA, ANOVA, statistical tests, ROC, …)
• evaluation of real-world goals such as algorithm robustness, reliability, and implementation issues
• theoretical results for algorithm performance comparison
• comparison of theoretical and empirical results
• new benchmark problems
• automatic algorithm configuration
• algorithm selection
• the comparison of algorithms in "non-traditional" scenarios such as
  • multi- or many-objective domains
  • parallel implementations, e.g., using GGPUs, MPI, CUDA, clusters, or running in clouds
  • large-scale problems or problems where objective function evaluations are costly
  • dynamic problems or where the objective functions involve randomized simulations or noise
  • deep learning and big data setups
• comparative surveys with new ideas on
  • dos and don'ts, i.e., best and worst practices, for algorithm performance comparison
  • tools for experiment execution, result collection, and algorithm comparison
  • benchmark sets for certain problem domains and their mutual advantages and weaknesses

Instructions for Authors

Prospective authors are invited to submit papers of no more than six pages in IEEE Manuscript Format for Conference Proceedings (double column, A4 format), including results, figures and references, with a maximum file size of 4MB, in PDF format.

More information regarding the submission process can be found at the conference website and at the submission site. The LaTeX template here.

The papers are to be submitted via the official conference website submission form where the "International Workshop on Benchmarking of Computational Intelligence Algorithms" should be selected as track.

The conference program of ICACI has been released (pdf). The paper presentation of our workshop will take place on March 31st, 2018 from 09:45 to 11:30 in room Guang-Yi [广益厅]. Each talk will have a total of 15 minutes, 12 of which are for presentation and 3 for questions and answers. All authors should bring their presentation either in PPT, PPTX or PDF format on a USB stick and hand them to the session chair before the session starts. This will ensure that all presentations can take place in a timely manner without too many delays caused by switching and plugging in laptops.

Important Dates

For more information please contact Thomas Weise at This email address is being protected from spambots. You need JavaScript enabled to view it..

Chairs

• Thomas Weise, Institute of Applied Optimization, Hefei University, Hefei, China
• Bin Li, University of Science and Technology of China, Hefei, China
• Markus Wagner, University of Adelaide, Adelaide, SA, Australia
• Xingyi Zhang, Anhui University, Hefei, China
• Jörg Lässig, University of Applied Sciences Zittau/Görlitz, Görlitz, Germany

International Program Committee

• Thomas Bartz-Beielstein, Technical University of Cologne, Köln (Cologne), Germany
• Josu Ceberio Uribe, University of the Basque Country, Bilbao, Spain
• Wenxiang Chen, Colorado State University, Fort Collins, CO, USA
• Marco Chiarandini, University of Southern Denmark, Odense M, Denmark
• Raymond Chiong, The University of Newcastle, Callaghan, Australia
• Carola Doerr, Université Pierre et Marie Curie - Paris 6, Paris, France
• Mohamed El Yafrani, Mohammed V University of Rabat, Rabat, Morocco
• Marcus Gallagher, University of Queensland, Brisbane, Australia
• William La Cava, University of Pennsylvania, Philadelphia, PA, USA
• Jörg Lässig, University of Applied Sciences Zittau/Görlitz, Görlitz, Germany
• Bin Li, University of Science and Technology of China, Hefei, China
• Pu Li, Technische Universität Ilmenau, Ilmenau, Germany
• Jing Liang, Zhengzhou University, Zhengzhou, China
• Zhen Liu, Institute of Applied Optimization, Hefei University, Hefei, China
• Manuel López-Ibáñez, University of Manchester, Manchester, UK
• Yi Mei, Victoria University of Wellington, Wellington, New Zealand
• Martin Middendorf, Leipzig University, Leipzig, Germany
• Antonio J. Nebro, University of Málaga, Málaga, Spain
• Randal S. Olson, University of Pennsylvania, Philadelphia, PA, USA
• Patryk Orzechowski, University of Pennsylvania, Philadelphia, PA, USA
• Qi Qi, University of Science and Technology of China, Hefei, China
• Danilo Sipoli Sanches, Federal University of Technology – Paraná, Cornélio Procópio, Brazil
• Ponnuthurai Nagaratnam Suganthan, Nanyang Technological University, Singapore
• Ryan J. Urbanowicz, University of Pennsylvania, Philadelphia, PA, USA
• Markus Wagner, University of Adelaide, Adelaide, SA, Australia
• Thomas Weise, Institute of Applied Optimization, Hefei University, Hefei, China
• Yang Yu, Nanjing University, Nanjing, China
• Xingyi Zhang, Anhui University, Hefei, China

Chair Biographies

Prof. Dr. Thomas Weise obtained the MSc in Computer Science in 2005 from the Chemnitz University of Technology and his PhD from the University of Kassel in 2009. He then joined the University of Science and Technology of China (USTC) as PostDoc and subsequently became Associate Professor at the USTC-Birmingham Joint Research Institute in Intelligent Computation and Its Applications (UBRI) at USTC. In 2016, he joined Hefei University as Full Professor to found the Institute of Applied Optimization at the Faculty of Computer Science and Technology. Prof. Weise has more than seven years of experience as a full time researcher in China, having contributed significantly both to fundamental as well as applied research. He has more than 80 scientific publications in international peer reviewed journals and conferences. His book "Global Optimization Algorithms – Theory and Application" has been cited more than 730 times. He has acted as reviewer, editor, or programme committee member at 70 different venues.

Prof. Dr. Bin Li received the B.S. degree from Hefei University of Technology, Hefei, China, in 1992, the M.Sc. degree from Institute of Plasma Physics, China Academy of Science, Hefei, China, in 1995, and the Ph.D. degree from University of Science and Technology of China (USTC), China in 2001. He is currently a professor with the School of Information Science and Technology, USTC, Hefei, China. He has authored and co-authored more than 40 refereed publications. His major research interests include evolutionary computation, memetic algorithms, pattern recognition, and real-world applications. Dr. Li is the Founding Chair of IEEE CIS Hefei Chapter, Counselor of IEEE USTC Student Branch, senior member of Chinese Institute of Electronics (CIE), member of the Technical Committee of Electronic Circuits and Systems Section of CIE.

Dr. Markus Wagner is a Senior Lecturer at the School of Computer Science, University of Adelaide, Australia. He has done his PhD studies at the Max Planck Institute for Informatics in Saarbrücken, Germany and at the University of Adelaide, Australia. His research topics range from mathematical runtime analysis of heuristic optimization algorithms and theory-guided algorithm design to applications of heuristic methods to renewable energy production, professional team cycling and software engineering. So far, he has been a program committee member 30 times, and he has written over 70 articles with over 70 different co-authors. He has chaired several education-related committees within the IEEE CIS, is Co-Chair of ACALCI 2017 and General Chair of ACALCI 2018.

Prof. Dr. Xingyi Zhang received the B.Sc. from Fuyang Normal College in 2003, and the M.Sc. in 2006 and Ph.D. in 2009 both from Huazhong University of Science and Technology. Currently, he is a professor in the School of Computer Science and Technology, Anhui University. His main research interests include unconventional models and algorithms of computation, multi-objective evolutionary optimization and membrane computing. He is the chair of 2017 Data Driven Optimization of Complex Systems and Applications and 2015 Asian Conference on Membrane Computing. He also serves as Editorial Board Member of Complex & Intelligent Systems and International Journal of Bio-inspired Computing.

Prof. Dr. Jörg Lässig leads the Enterprise Application Development Group (EAD) of the University of Applied Sciences Zittau/Görlitz in Germany since 2011. He holds degrees in Computer Science, Computational Physics, and received a Ph.D. in Computer Science for his research on efficient algorithms and models for the generation and control of cooperation networks at Chemnitz University of Technology (Germany), which he finished in 2009. Prof. Lässig has PostDocs at the Università della Svizzera italiana, Institute of Computational Sciences (Lugano, Switzerland) and the International Computer Science Institute Berkeley (California, USA). His EAD research group at HSZG and his IT security group with the Fraunhofer Society are focusing on topics concerned with intelligent data driven technologies for state-of-the-art IT infrastructures and services. His research directions include sustainable IT services, energy efficiency benchmarking, regional carbon footprints and energy informatics.

Hosting Event

The Tenth International Conference on Advanced Computational Intelligence (ICACI 2018)
Xiamen [厦门], Fujian [福建省], China, March 29–31, 2018

ICACI 2018 aims to provide a high-level international forum for scientists, engineers, and educators to present the state-of-the-art research and applications in computational intelligence. The conference will feature plenary speeches given by world renowned scholars, regular sessions with broad coverage, and special sessions focusing on popular topics. In addition, best paper awards will be given during the conference. The proceedings of ICACI 2018 will be submitted to the IEEE Xplore and EI Compendex. Moreover, selected papers will be published in special issues of related journals. The conference will favor papers representing advanced theories and innovative applications in computational intelligence.

Topics areas include, but are not limited to: computational neuroscience, connectionist theory and cognitive science, mathematical modeling of neural systems, neurodynamic analysis, neurodynamic optimization and adaptive dynamic programming, embedded neural systems, probabilistic and information-theoretic methods, principal and independent component analysis, hybrid intelligent systems, supervised, unsupervised and reinforcement learning, deep learning, brain imaging and neural information processing, neuroinformatics and bioinformatics, support vector machines and kernel methods, autonomous mental development, data mining, pattern recognition, time series analysis, image and signal processing, robotic and control applications, telecommunications, transportation systems, intrusion detection and fault diagnosis, hardware implementation, real-world applications, big data processing, fuzzy systems, fuzzy logic, fuzzy set theory, fuzzy decision making, fuzzy information processing, fuzzy logic control, evolutionary computation, ant colony optimization, genetic algorithms, parallel and distributed algorithms, particle swarm optimization, evolving neural networks, evolutionary fuzzy systems, evolving neuro-fuzzy systems, evolutionary games and multi-agent systems, intelligent systems applications.

Web Links

1. Special Session on Benchmarking of Computational Intelligence Algorithms (BOCIA'21)
2. Special Issue on Benchmarking of Computational Intelligence Algorithms in the Applied Soft Computing Journal Completed
3. Good Benchmarking Practices for Evolutionary Computation (BENCHMARK@PPSN) Workshop
4. Good Benchmarking Practices for Evolutionary Computation (BENCHMARK@GECCO) Workshop
5. Black Box Discrete Optimization Benchmarking (BB-DOB) Workshop
6. Short Workshop Report
7. Special Issue on Benchmarking of Computational Intelligence Algorithms approved for the Applied Soft Computing Journal
8. Special Issue on Benchmarking of Computational Intelligence Algorithms in the Applied Soft Computing Journal
9. Program for Workshop on Benchmarking of Computational Intelligence Algorithms at ICACI 2018 Released
10. Workshop Call for Papers (CfP) in PDF format
11. Workshop Call for Papers (CfP) as plain text file
12. Workshop WikiCfP Entry
13. Workshop CfP on LinkedIn
14. Submission Deadline Extended to December 1, 2017: International Workshop on Benchmarking of Computational Intelligence Algorithms (BOCIA)
15. Special Issue Call for Papers (CfP) in PDF format
16. Special Issue Call for Papers (CfP) as plain text file
17. Special Issue WikiCfP Entry
18. Workshop on Benchmarking of Computational Intelligence Algorithms approved for ICACI 2018
19. Related Event: Black-Box Discrete Optimization Benchmarking (BB-DOB@PPSN) Workshop
20. Related Event: Black-Box Discrete Optimization Benchmarking (BB-DOB@GECCO) Workshop