Adaptive Load Balancing Dashboard in Dynamic Distributed Systems

  • Seyedeh Leili Mirtaheri Assistant Professor atElectrical and Computer Engineering Department, Kharazmi University
  • Seyed Arman Fatemi Kharazmi University
  • Lucio Grandinetti University of Calabria
DOI: https://doi.org/10.14529/jsfi170403

Abstract

Considering the dynamic nature of new generation scientific problems, load balancing is a necessity to manage the load in an efficient manner. Load balancing systems are use to optimize the resource consumption, maximize the throughput, minimize response time, and to prevent overload in resources. In current research, we consider operational distributed systems with dynamic variables caused by different nature of the applications and heterogeneity of the various levels in the system. Conducted studies indicate that many different factors should be considered to select the load balancing algorithm, including the processing power, load transfer and communication delay of nodes. In this work, We aim to design a dashboard that is capable to merge the load balancing algorithms in different environments. We design an adaptive system infrastructure with the ability to adjust various factors in the run time of a load balancing algorithm. We propose a task and a resource allocation mechanism and further introduce a mathematical model of load balancing process in the system. We calculate a normalized hardware score that determines the maturity of system according to the environmental conditions of the load balancing process. Evaluation results confirm that the proposed method performs well and reduces the probability of system failure.

Author Biographies

Seyedeh Leili Mirtaheri, Assistant Professor atElectrical and Computer Engineering Department, Kharazmi University
Seyedeh Leili Mietaheri is faculty member of Electrical and Computer Engineering Department in Kharazmi University. She is researching on next generation high performance computing systems. She worked as a researcher in Excellent  Center of High Performance Computing for Parallel and Distributed Processing in Italy. Her research interests are in the areas of distributed and parallel systems, peer to peer computing, cluster computing, mathematics and scientific computing. She has worked on Distributed Systems and done a number of successful industrial experiments in these areas. She received First award of Inventions at National Science Foundation Invention Festival,2011,IUST(Iran university of Science and Technology)’s Award for Excellence in Researching in 2009, Second Level Reward of National Science Foundation in PhD duration,2009, First Award for presenting “CSharifi :Kernel Level Cluster Management System Software “at the Khwarizmi Young Awards ,2008 and Grant of  Excellent Researcher of National Science Foundation ,2008 and Iranian Organization of Scientific and Industrial Research appreciation to cooperating and presenting “A Cluster Management System Software” at the Khwarizmi International Awards,2007.
Lucio Grandinetti, University of Calabria
Since 1986, I am full professor at the Faculty of Engineering, University of Calabria (UNICAL), Italy. At the same University, I currently hold the position of Vice Rector (since 1999) and coordinator of the Ph.D. Degree Program in the area of Managament Science and Engineering.At the abovementioned University, I was Director of the Department of Electronics, Informatics, and Systems for ten years, as well as member of the University Administration Council and President of the Faculty’s Management Engineering Degree Course.My scientific background is in Electronic Engineering and Systems Science.I am a graduate of the University of Pisa, Italy and the University of California at Berkeley. I have also been a post-doc fellow at University of Southern California, Los Angeles and Research Fellow at the University of Dundee, Scotland.I have been a member of the IEEE Committee on Parallel Processing, and European Editor of a book series of MIT Press on Advanced Computational Methods and Engineering.Currently I am member of the Editorial Board of four international journals.I am author of many research papers in well-established international journals and Editor or co-Editor of several books on algorithms, software, applications of Parallel Computing, HPC, Grids.Since 1994, I have been part of several Evaluation Panels of European Projects within various ICT and Infosociety Programs; I have also been reviewer of many EU Projects in the above Programs.I have been recipient and scientific leader of many European-Commission-Funded projects since 1993 (e.g. Molecular Dynamics Simulations by MPP Systems, EUROMED, HPC Finance, WADI).I have been recipient and scientific leader of several national projects (CNR progetti finalizzati, Grid.it, PRIN).I am one of the founders of the Consortium SPACI (Southern Partnership for Advanced Computational Infrastructures), a pioneering Grid infrastructure experiment in Italy.Currently I am:Director of the Centre of Excellence on HPC established at the University of Calabria by the Italian government;Co-managing director of a Supercomputing Centre jointly established by the University of Calabria and NEC Corporation;Recipient and scientific leader of some European-Commission-Funded projects (among others, BEINGRID);Project leader of a node of the most important European Grid Infrastructure for e-science named EGEE.

References

Arab, M., Mirtaheri, S., Khaneghah, E., Sharifi, M., Mohammadkhani, M.: Improving learning-based request forwarding in resource discovery through load-awareness. Data Management in Grid and Peer-to-Peer Systems pp. 73–82 (2011), DOI: 10.1007/978-3-642-22947-3_7

Balasangameshwara, J., Raju, N.: Performance-driven load balancing with a primary backup approach for computational grids with low communication cost and replication cost. IEEE Transactions on Computers 62(5), 990–1003 (2013), DOI: 10.1109/TC.2012.44

Brodowicz, M., Sterling, T.: Simultac fonton: A fine-grain architecture for extreme performance beyond Moore’s law. Supercomputing Frontiers and Innovations 4(2), 27–37 (2017), DOI: 10.1109/HPCSim.2016.7568352

Casanova, H.: Simgrid: A toolkit for the simulation of application scheduling. In: Cluster computing and the grid, 2001. Proceedings. First IEEE/ACM international symposium on. IEEE (2001), DOI: 10.1109/CCGRID.2001.923223

Dinitz, M., Fineman, J., Gilbert, S., Newport, C.: Load balancing with bounded convergence in dynamic networks. In: IEEE INFOCOM 2017 - IEEE Conference on Computer Communications. pp. 1–9 (2017), DOI: 10.1109/INFOCOM.2017.8057000

Domanal, S.G., Reddy, G.R.M.: Load balancing in cloud environment using a novel hybrid scheduling algorithm. In: Cloud Computing in Emerging Markets (CCEM), 2015 IEEE International Conference on. pp. 37–42. IEEE (2015), DOI: 10.1109/CCEM.2015.31

Heene, M., Kowitz, C., Pfl¨uger, D.: Load balancing for massively parallel computations with the sparse grid combination technique. In: PARCO. pp. 574–583 (2013), DOI: 10.3233/978-1-61499-381-0-574

LD, D.B., Krishna, P.V.: Honey bee behavior inspired load balancing of tasks in cloud computing environments. Applied Soft Computing 13(5), 2292–2303 (2013), DOI: 10.1016/j.asoc.2013.01.025

Mahafzah, B.A., Jaradat, B.A.: The hybrid dynamic parallel scheduling algorithm for load balancing on chained-cubic tree interconnection networks. The Journal of Supercomputing 52(3), 224–252 (2010), DOI: 10.1007/s11227-009-0288-3

Mirtaheri, S.L., Grandinetti, L.: Dynamic load balancing in distributed exascale computing systems. Cluster Computing (May 2017), DOI: 10.1007/s10586-017-0902-8

Mohamed, N., Al-Jaroodi, J.: Delay-tolerant dynamic load balancing. In: 2011 IEEE International Conference on High Performance Computing and Communications. pp. 237–245 (2011), DOI: 10.1109/HPCC.2011.39

Mousavi Khaneghah, E., Mirtaheri, S.L., Sharifi, M., Minaei Bidgoli, B.: Modeling and analysis of access transparency and scalability in p2p distributed systems. International Journal of Communication Systems 27(10), 2190–2214 (2014), DOI: 10.1002/dac.2467

Patel, P., Bansal, D., Yuan, L., Murthy, A., Greenberg, A., Maltz, D.A., Kern, R., Kumar, H., Zikos, M., Wu, H., et al.: Ananta: Cloud scale load balancing. In: ACM SIGCOMM Computer Communication Review. vol. 43, pp. 207–218. ACM (2013), DOI: 10.1145/2486001.2486026

Pickartz, S., Lankes, S., Monti, A., Clauss, C., Breitbart, J.: Application migration in HPC driver of the exascale era? In: High Performance Computing & Simulation (HPCS), 2016 International Conference on. pp. 318–325. IEEE (2016), DOI: 10.1109/HPCSim.2016.7568352

Sharma, M., Yadav, A., Sharma, P.: An optimistic approach for load balancing in cloud computing pp. 27–30 (2014), international Journal of Computer Science and Engineering 2(3)

Soltani, N., Khaneghah, E.M., Sharifi, M., Mirtaheri, S.L.: A dynamic popularity-aware load balancing algorithm for structured p2p systems. Springer (2012), DOI: 10.1007/978-3-642-35606-3 9

Wang, K., Zhou, X., Qiao, K., Lang, M., McClelland, B., Raicu, I.: Towards scalable distributed workload manager with monitoring-based weakly consistent resource stealing. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing. pp. 219–222. ACM (2015), DOI: 10.1145/2749246.2749249

Wang, K., Zhou, X., Li, T., Zhao, D., Lang, M., Raicu, I.: Optimizing load balancing and data-locality with data-aware scheduling. In: Big Data (Big Data), 2014 IEEE International Conference on. pp. 119–128. IEEE (2014), DOI: 10.1109/BigData.2014.7004220

Xu, G., Pang, J., Fu, X.: A load balancing model based on cloud partitioning for the public cloud. Tsinghua Science and Technology 18(1), 34–39 (2013), DOI: 10.1109/TST.2013.6449405
Published
2017-11-27
Issue
Vol 4 No 4 (2017)
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.