Particle Swarm Optimization And Quantum Particle Swarm Optimization To Multidimensional Function Approximation

This work compares the results of multidimensional function approximation using two algorithms: the classical Particle Swarm Optimization (PSO) and the Quantum Particle Swarm Optimization (QPSO). These algorithms were both tested on three functions - The Rosenbrock, the Rastrigin, and the sphere fun...

Full description

Bibliographic Details
Main Authors: Silva, Diogo, Fadul Rodor, Moraes, Carlos
Format: Text
Language:English
Published: Zenodo 2018
Subjects:
PSO
AI
Online Access:https://dx.doi.org/10.5281/zenodo.1316689
https://zenodo.org/record/1316689
Description
Summary:This work compares the results of multidimensional function approximation using two algorithms: the classical Particle Swarm Optimization (PSO) and the Quantum Particle Swarm Optimization (QPSO). These algorithms were both tested on three functions - The Rosenbrock, the Rastrigin, and the sphere functions - with different characteristics by increasing their number of dimensions. As a result, this study shows that the higher the function space, i.e. the larger the function dimension, the more evident the advantages of using the QPSO method compared to the PSO method in terms of performance and number of necessary iterations to reach the stop criterion. : {"references": ["H. Robbins and S. Monro, \"A stochastic approximation method,\"\nAnn. Math. Statist., vol. 22, no. 3, pp. 400\u2013407, 09 1951. (Online).\nAvailable: http://dx.doi.org/10.1214/aoms/1177729586.", "N. Barricelli, \"Esempi numerici di processi di evoluzione,\" Methodos,\nno. 21-22, pp. 45\u201368, 1954, cited By 55.", "I. Rechenberg, \"Cybernetic solution path of an experimental problem,\"\nEvolutionary Computation: The Fossil Record, pp. 301\u2013310, 1968, cited\nBy 2.", "L. J. Fogel, Intelligence Through Simulated Evolution: Forty Years of\nEvolutionary Programming. New York, NY, USA: John Wiley & Sons,\nInc., 1999.", "S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi,\n\"Optimization by simulated annealing,\" Science, vol. 220,\nno. 4598, pp. 671\u2013680, 1983. (Online). Available:\nhttp://science.sciencemag.org/content/220/4598/671.", "F. Glover, \"Future paths for integer programming and\nlinks to artificial intelligence,\" Computers and Operations\nResearch, vol. 13, no. 5, pp. 533 \u2013 549, 1986,\napplications of Integer Programming. (Online). Available:\nhttp://www.sciencedirect.com/science/article/pii/0305054886900481.", "X.-S. Yang, Nature-Inspired Metaheuristic Algorithms. Luniver Press,\n2008.", "J. H. Holland, Adaptation in Natural and Artificial Systems: An\nIntroductory Analysis with Applications to Biology, Control and\nArtificial Intelligence. Cambridge, MA, USA: MIT Press, 1992.", "M. Dorigo and T. St\u00a8utzle, Ant Colony Optimization. Scituate, MA,\nUSA: Bradford Company, 2004.\n[10] J. Kennedy and R. Eberhart, \"Particle swarm optimization,\" 1995.\n[11] L. M., \"Improving particle swarm optimization by hybridization of\nstochastic search heuristics and self-organized criticality,\" 2002.\n[12] P. S. Arrhenius, \"Xxxi. on the influence of carbonic acid in\nthe air upon the temperature of the ground,\" Philosophical\nMagazine, vol. 41, no. 251, pp. 237\u2013276, 1896. (Online). Available:\nhttp://dx.doi.org/10.1080/14786449608620846.\n[13] A. Taghvaei, P. G. Mehta, and S. P. Meyn, \"Error estimates for the\nkernel gain function approximation in the feedback particle filter,\" in\n2017 American Control Conference (ACC), May 2017, pp. 4576\u20134582.\n[14] A. Taghvaei and P. G. Mehta, \"Gain function approximation in the\nfeedback particle filter,\" in 2016 IEEE 55th Conference on Decision\nand Control (CDC), Dec 2016, pp. 5446\u20135452.\n[15] G. A. Hoffmann, \"Function approximation with learning networks in\nthe financial field and its application to the interest rate sector,\" in\nProceedings of 1995 Conference on Computational Intelligence for\nFinancial Engineering (CIFEr), Apr 1995, pp. 178\u2013182.\n[16] I. Schalk-Schupp, F. Faubel, M. Buck, and A. Wendemuth,\n\"Approximation of a nonlinear distortion function for combined linear\nand nonlinear residual echo suppression,\" in 2016 IEEE International\nWorkshop on Acoustic Signal Enhancement (IWAENC), Sept 2016, pp.\n1\u20135.\n[17] J. E. A., T. P. I. Ahamed, and R. T., \"A function approximation approach\nto reinforcement learning for solving unit commitment problem with\nphoto voltaic sources,\" in 2016 IEEE International Conference on Power\nElectronics, Drives and Energy Systems (PEDES), Dec 2016, pp. 1\u20136.\n[18] A. B. de Souza, \"Fundamentos de otimizacao por inteligencia de\nenxames: uma visao geral,\" Sba: Controle e Automacao Sociedade\nBrasileira de Automatica, vol. 20, pp. 271 \u2013 304, 09 2009.\n[19] Z. Meng, P. Feng, P. Chao, L. Weixing, and G. Qi, \"Trajectory\noptimization using time-separating strategy with improved pso on\nmechanical arms,\" in 2017 36th Chinese Control Conference (CCC),\nJuly 2017, pp. 2669\u20132674.\n[20] C. H. R. Jethmalani, S. P. Simon, K. Sundareswaran, P. S. R. Nayak, and\nN. P. Padhy, \"Auxiliary hybrid pso-bpnn-based transmission system loss\nestimation in generation scheduling,\" IEEE Transactions on Industrial\nInformatics, vol. 13, no. 4, pp. 1692\u20131703, Aug 2017.\n[21] L. Gong, W. Cao, and J. Zhao, \"An improved pso algorithm for\nhigh accurate parameter identification of pv model,\" in 2017 IEEE\nInternational Conference on Environment and Electrical Engineering\nand 2017 IEEE Industrial and Commercial Power Systems Europe\n(EEEIC / I CPS Europe), June 2017, pp. 1\u20135.\n[22] T. Guan and F. Zhuo, \"An improved sa-pso global maximum power\npoint tracking method of photovoltaic system under partial shading\nconditions,\" in 2017 IEEE International Conference on Environment\nand Electrical Engineering and 2017 IEEE Industrial and Commercial\nPower Systems Europe (EEEIC / I CPS Europe), June 2017, pp. 1\u20135.\n[23] L. Benchikhi, M. Sadgal, and A. El-Fazziki, \"An optimization approach\nof parameters in image processing based on pso: Case of quality\ncontrol,\" in Proceedings of 2013 International Conference on Industrial\nEngineering and Systems Management (IESM), Oct 2013, pp. 1\u20136.\n[24] K. Wang, X. Yan, Y. Yuan, X. Jiang, G. Lodewijks, and R. R.\nNegenborn, \"Pso-based method for safe sailing route and efficient\nspeeds decision-support for sea-going ships encountering accidents,\" in\n2017 IEEE 14th International Conference on Networking, Sensing and\nControl (ICNSC), May 2017, pp. 413\u2013418.\n[25] M. K. Pamba R.V., Sherly E., \"Evaluation of frequent pattern growth\nbased fuzzy particle swarm optimization approach for web document\nclustering.\" in Computational Science and Its Applications ICCSA 2017.\nICCSA 2017. Lecture Notes in Computer Science, vol 10404., 2017.\n[26] M. S. K. P. Jatana N., Suri B. and C. A. R., \"Particle swarm\nbased evolution and generation of test data using mutation testing.\" in\nComputational Science and Its Applications ICCSA 2016. ICCSA 2016.\nLecture Notes in Computer Science, vol 9790, 2016.\n[27] J. Sun, B. Feng, and W. Xu, \"Particle swarm optimization with particles\nhaving quantum behavior,\" in Proceedings of the 2004 Congress on\nEvolutionary Computation (IEEE Cat. No.04TH8753), vol. 1, June 2004,\npp. 325\u2013331 Vol.1.\n[28] C. Zhang, Y. Xie, D. Liu, and L. Wang, \"Fast threshold image\nsegmentation based on 2d fuzzy fisher and random local optimized\nqpso,\" IEEE Transactions on Image Processing, vol. 26, no. 3, pp.\n1355\u20131362, March 2017.\n[29] R. Faia, T. Pinto, and Z. Vale, \"Optimization of electricity markets\nparticipation with qpso,\" in 2016 13th International Conference on the\nEuropean Energy Market (EEM), June 2016, pp. 1\u20135.\n[30] X. Xie, H. Wang, S. Tian, and Y. Liu, \"Optimal capacity configuration\nof hybrid energy storage for an isolated microgrid based on qpso\nalgorithm,\" in 2015 5th International Conference on Electric Utility\nDeregulation and Restructuring and Power Technologies (DRPT), Nov\n2015, pp. 2094\u20132099.\n[31] L. A. Rastrigin, \"Systems of extremal control,\" 1974.\n[32] H. M\u00a8uhlenbein, M. Schomisch, and J. Born, \"Paper: The\nparallel genetic algorithm as function optimizer,\" Parallel Comput.,\nvol. 17, no. 6-7, pp. 619\u2013632, Sep. 1991. (Online). Available:\nhttp://dx.doi.org/10.1016/S0167-8191(05)80052-3."]}