Document Type: Original Research Paper


1 Department of Electrical and Computer Engineering University of Birjand Birjand, Iran

2 Department of Electrical and Computer Engineering University of Birjand, Birjand, Iran


This paper presents the application of reinforcement learning in automatic analog IC design. In this work, the Multi-Objective approach by Learning Automata is evaluated for accommodating required functionalities and performance specifications considering optimal minimizing of MOSFETs area and power consumption for two famous CMOS op-amps. The results show the ability of the proposed method to optimize aforementioned objectives, compared with three MO well-known algorithms (including Particle Swarm Optimization, Inclined Planes system Optimization, and Genetic Algorithm). So that for a two-stage CMOS op-amp, it is obtained 560.42 μW power and 72.825 〖μm〗^2 area, and power 214.15 μW and area 13.76 〖μm〗^2 for a single-ended folded-cascode op-amp. In addition to evaluating the Pareto-fronts obtained based on Overall Non-dominated Vector Generation and Spacing criteria, in terms of Total Optimality Index, MOLA for both cases has been able to have the best performance between the applied methods, and other researches with values of -25.683 and -34.16 dB, respectively.


Main Subjects

[1] M. Shakibmehr and M. Lotfizad, “Design of an S-band ultra-low-noise amplifier with frequency band switching capability,” Journal of Electrical and Computer Engineering Innovations, vol.5, no. 1, pp. 13–18, 2017.
[2] P. Amiri, M. Kohestani, and M. Seifouri, “THD analysis in closed-loop analog PWM class-D amplifiers,” Journal of Electrical and Computer Engineering Innovations, vol. 2, no. 1,pp. 1–5, 2014.
[3] B. Shojaei Tabatabaei and P. Amiri, “UWB mixer improvement with regulated voltage source,” Journal of Electrical and Engineering Innovations (JECEI), vol. 2, no. 2, pp. 93–99, 2014.
[4] M. Basravi, Z. H. Firouzeh, and M. Maddahali, “Design of a single-layer circuit analog absorber using double-circular-loop array via the equivalent circuit model,” Journal of Electrical
and Computer Engineering Innovations, vol. 5, no. 2, pp. 171–178, 2017.
[5] B. Liu, G. Gielen, and F. V. Fernández, Automated Design of Analog and High-frequency Circuits, A Computational Intelligence Approach, Springer, Berlin, Heidelberg, 2014.
[6] S. Roostaee1 and H. R. Ghaffary, “Diagnosis of heart disease based on meta heuristic algorithms and clustering methods,” Journal of Electrical and Computer Engineering Innovations, vol.2, no. 2, pp. 93–99, 2014.
[7] M. Ranjkesh, E. FallahChoolabi, and M. Pourjafari, “Optimum design of a SRM using FEM and PSO,” Journal of Electrical and Computer Engineering Innovations, vol. 2, no. 1, pp. 29–35,2014.
[8] R. Omidvar1, H. Parvin, and A. Eskandari, “A clustering approach by SSPCO optimization algorithm based on chaotic initial population,” Journal of Electrical and Computer Engineering Innovations, vol. 4, no. 1, pp. 31–38, 2016.
[9] N. S. Shahraki, and S. H. Zahiri, “Inclined planes optimization algorithm in optimal architecture of MLP neural networks,” in proc. 3rd IEEE International Conference on Pattern Recognition and Image Analysis (IPRIA), pp. 189-194, 2017.
[10] O. Bozorg-Haddad, M. Solgi, and H. A. Loáiciga, Meta-heuristic and evolutionary algorithms for engineering optimization. John Wiley & Sons, 2017.
[11] B. Liu, Y. Wang, Z. Yu, L. Liu, M. Li, Z. Wang, J. Lu, and F. V. Fernández, “Analog circuit optimization system based on hybrid evolutionary algorithms,” Integration VLSI Journal, vol. 42, no. 2, pp. 137–148, 2009.

[12] M. Fakhfakh, Y. Cooren, A. Sallem, M. Loulou, and P. Siarry,“Analog circuit design optimization through the particle swarm optimization technique,” Analog Integrated Circuits and Signal Processing, vol. 63, no. 1, pp. 71–82, 2010.
[13] M. Barros, J. Guilherme, and N. Horta, “Analog circuits optimization based on evolutionary computation techniques,” Integration, the VLSI Journal, vol. 43, no. 1, pp. 136-155, 2010.
[14] R. A. Vural and T. Yildirim, “Analog circuit sizing via swarm intelligence,” AEU - International Journal of Electronics and Communications, vol. 66, no. 9, pp. 732–740, 2012.
[15] B. Bachir, A. Ali, and M. Abdellah, “Multi-objective optimization of an operational amplifier by the ant colony optimization algorithm,” Electrical and Electronic Engineering, vol. 2, no. 4,pp. 230–235, 2012.
[16] S. Mallick, R. Kar, D. Mandal, and S. P. Ghoshal, “Optimal sizing of CMOS analog circuits using gravitational search algorithm with particle swarm optimization,” International Journal of Machine Learning and Cybernetics, vol. 8, no. 1, pp. 309–331,2017.
[17] M. Dehbashian and M. Maymandi-Nejad, "A new hybrid algorithm for analog ICs optimization based on the shrinking circles technique," Integration, the VLSI Journal, vol. 56, pp.148-166, 2017.
[18] M. Dehbashian and M. Maymandi-Nejad, "Co-AGSA: An efficient self-adaptive approach for constrained optimization of analog IC based on the shrinking circles technique," Integration, the VLSI Journal, vol. 59, pp. 218-232, 2017.
[19] W. Lyu, P. Xue, F. Yang, C. Yan, Z. Hong, X. Zeng, D. Zhou, “An efficient Bayesian optimization approach for automated optimization of analog circuits,” IEEE Transactions on Circuits and Systems I, vol. 65, no. 6, pp. 1954-1967, 2018.
[20] S. Dash, D. Joshi, A. Sharma, and G. Trivedi, "A hierarchy in mutation of genetic algorithm and its application to multi-objective analog/RF circuit optimization," Analog Integrated Circuits and Signal Processing, vol. 94, no. 1, pp. 27-47, 2018.
[21] S. Dash, D. Joshi, and G. Trivedi, "Multi-Objective analog/RF circuit sizing using an improved brain storm optimization algorithm," Memetic Computing, pp. 1-18, 2018.
[22] A. C. Sanabria-Borbón and E. Tlelo-Cuautle, “Sizing analogue integrated circuits by integer encoding and NSGA-II,” IETE Technical Review, vol. 4602, no. March, pp. 1–7, 2017.
[23] A. C. Sanabria-Borbón, E. Tlelo-Cuautle, and L. G. de la Fraga,“Optimal sizing of amplifiers by evolutionary algorithms with integer encoding and GM/ID design method,” in proc. NEO 2016, Springer, Cham. vol. 731, pp. 263-279, 2018.
[24] N. S. Shahraki, A. Mohammadi, S. Mohammadi-Esfahrood, and S. H. Zahiri, “Improving the performance of analog integrated circuits using multi-objective metaheuristic algorithms,” in proc. 5th IEEE Conference on Knowledge Based Engineering and Innovation (KBEI), pp. 822-826, 2019.
[25] E. Afacan, "Inversion coefficient optimization based analog/RF circuit design automation," Microelectronics Journal, vol. 83, pp. 86-93, 2019.
[26] M. Hasanzadeh-Mofrad and A. Rezvanian, "Learning automata clustering," Journal of Computational Science, vol. 24, pp. 379–388, 2018.
[27] M. Ahangaran, N. Taghizadeh, and H. Beigy, "Associative cellular learning automata and its applications," Applied Soft Computing, vol. 53, pp. 1-18, 2017.
[28] B. Damerchilu, M. S. Norouzzadeh, and M. R. Meybodi, "Motion estimation using learning automata," Machine Vision and Applications, vol. 27, no. 7, pp. 1047-1061, 2016.
[29] N. Kumar, J. H. Lee, and J. J. Rodrigues, "Intelligent mobile video surveillance system as a Bayesian coalition game in vehicular sensor networks: Learning automata approach,"
IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 3, pp. 1148-1161, 2015.

[30] A. L. Bazzan, "Aligning individual and collective welfare in complex socio-technical systems by combining metaheuristics and reinforcement learning engineering," Applications of Artificial Intelligence, vol. 79, pp. 23-33, 2019.
[31] M. Rezapoor Mirsaleh, M. R. Meybodi, "Balancing exploration and exploitation in memetic algorithms: A learning automata approach," Computational Intelligence, vol. 34, no. 1, pp. 282-309, 2018.
[32] W. Li, E. Özcan, and R. John, "A learning automata based multiobjective hyper-heuristic," IEEE Transactions on Evolutionary Computation, vol. 21, no. 1, pp. 59–73, 2017.
[33] M. L. Tsetlin, Automaton Theory and Modeling of Biological Systems, vol. 102 of Mathematics in Science and Engineering. Academic Press, New York, 1973.
[34] F. Hourfar, H. J. Bidgoly, B. Moshiri, K. Salahshoor, and A. Elkamel, "A reinforcement learning approach for
waterflooding optimization in petroleum reservoirs," Engineering Applications of Artificial Intelligence. vol. 77, pp. 98-116, 2019.
[35] H. L. Liao and Q. H. Wu, “Multi-objective optimization by learning automata,” Journal of Global Optimization, vol. 55, no.2, pp. 459–487, 2013.
[36] K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multi-objective genetic algorithm: NSGA-II,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182–197, 2002.
[37] C. A. Coello Coello, G. T. Pulido, and M. S. Lechuga, “Handling multiple objectives with particle swarm optimization,” IEEE Transactions on Evolutionary computation, vol. 8, no. 3, pp.
256–279, 2004.
[38] A. Mohammadi, M. Mohammadi, S. H. Zahiri, "Design of optimal CMOS ring oscillator using an intelligent optimization tool," Soft Computing, vol. 22, no. 4, pp. 8151-8166, 2018.
[39] J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proc. IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948, 1995.
[40] M. H. Mozaffari, H. Abdy, and S. H. Zahiri, "IPO: An inclined planes system optimization algorithm," Computing and Informatics, vol. 35, no. 1, pp. 222-240, 2016.