Abstract: This study adopted A3C algorithm to simulate the evacuation process under different situations (multi agents and difference environment conditions), and results were compared with Deep Q-Networks (DQN) to demonstrate the efficiency and effectiveness of A3C algorithm using in evacuation models. Results indicated that under static environments, A3C demonstrated superior adaptability and quicker response times. Furthermore, with an increasing number of agents, A3C showed better scalability and robustness in managing complex interactions and providing quick evacuations. These outcomes highlight A3C's advantage over traditional RL models under varying and challenging conditions. The study concludes with a discussion of the practical 6 implications and benefits of these models. It emphasized their potential in enhancing real- world evacuation planning and safety protocols.

Dr. Dahai Liu is a currently a professor with the School of Graduate Studies in the College of Aviation at Embry-Riddle Aeronautical University. Dr. Liu has extensive experience in the areas of Systems Engineering, Modeling and Simulation, Machine Learning and Human Factors Engineering. He has been serving as Aviation Research Coordinator for the DOT Tier 1 UTC – the Center for Advanced Transportations Mobility, and currently serves as the editor in chief for the Journal of Aviation/Aviation Education and Research, and editorial board member for the International Journal of Industrial Ergonomics and Journal of Human Factors and Ergonomics for Manufacturing and Service Industries. Dr. Liu has more than 120 publications, including peer review journal articles, conference proceedings, book chapters, and technical reports.  He is the author of one textbook and co-author of an edited book. His research has been funded by FAA, NASA, ONR and DOT. Dr. Dahai Liu earned his Bachelor of Engineering degree in Management Information Systems in 1993, Master of Engineering in 1996, both from Tsinghua University, Beijing China. He earned a Ph.D. in Industrial and Management Systems Engineering from the University of Nebraska at Lincoln, in 2002. He is a senior member of the Institute of Industrial Engineer and senior member of the IEEE.