Performance Benchmarking of Serverless Computing Platforms
  IJCTT-book-cover
 		          
 
© 2024 by IJCTT Journal
Volume-72 Issue-6
Year of Publication : 2024
Authors : Dhruv Seth, Pradeep Chintale
DOI :  10.14445/22312803/IJCTT-V72I6P121

How to Cite?

Dhruv Seth, Pradeep Chintale, "Performance Benchmarking of Serverless Computing Platforms ," International Journal of Computer Trends and Technology, vol. 72, no. 6, pp. 160-167, 2024. Crossref, https://doi.org/10.14445/22312803/IJCTT-V72I6P121

Abstract
Performance benchmarking of serverless computing platforms helps to determine the most appropriate serverless platforms for running backend services for web applications. Performance benchmarking focuses on attributes such as the Central Processing Unit (CPU) performance, network speed or performance, and the memory capacity of the server. The performance benchmarking tools include micro-benchmarking and application benchmarking tools. The micro-benchmarking tools are the focus of this paper, with Amazon Web Service (AWS) as the epitome of a cloud serverless computing platform. The performance benchmarking tools indicate that the AWS is not perfect, but it is a reliable starting point for the development and advancement of serverless computing platforms. Among the performance benchmarks reviewed, the ServerlessBench stood out due to its results that showed decreased tail latency, enhanced bursty behavior, improved image fetch speed, and improved capacity for function transfer.

Keywords
Serverless computing, Micro-benching tools, ServerlessBench, Amazon Web Service, Benchmarking.

Reference

[1] Jithin Jude Paul, “Serverless Data Platforms,” Distributed Serverless Architectures on AWS, pp. 75–93, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Maddie Stigler, “Understanding Serverless Computing,” Beginning Serverless Computing, pp. 1–14, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[3] N. Saravana Kumar, and Samy S. Selvakumara, “Serverless Computing Platforms Performance and Scalability Implementation Analysis,” 2022 International Conference on Computer, Power and Communications (ICCPC), Chennai, India, pp. 598 – 602, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Victor Juan Exposito Jimenez, and Herwig Zeiner, “Serverless Cloud Computing: A Comparison Between ‘Function as a Service’ Platforms,” 7th International Conference on Information Technology Convergence and Services, Vol. 5, 2018.
[CrossRef] [Google Scholar]
[5] Francisco Carpio, Marc Michalke, and Admela Jukan, “Engineering and Experimentally Benchmarking a Serverless Edge Computing System,” 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, 2021, pp. 1-6.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Karim Djemame, Daniel Datsev and Vasilios Kelefouras, “Evaluation of Language Runtimes in Open-source Serverless Platforms,” Proceedings of the 12th International Conference on Cloud Computing and Services Science, vol. 1, pp. 123-132, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Jorn Kuhlenkamp et al., “Benchmarking Elasticity of FaaS Platforms as a Foundation for the Objective-Driven Design of Serverless Applications,” SAC ’20: Proceedings of the 35th Annual ACM Symposium on Applied Computing, New York, USA, pp. 1576-1585, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Pérez González, Alfonso María, “Advanced Elastic Platforms for High Throughput Computing on Container-Based and Serverless Infrastructures,” PhD Thesis, Polytechnic University of Valencia, pp. 1-161, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Sumanth Tatineni, “Performance Evaluation of Serverless Computing Platforms in Cloud Environments,” International Journal of Science and Research (IJSR), vol. 12, no. 11, pp. 1013–1020, 2023.
[CrossRef]
[10] Nima Mahmoudi, and Hamzeh Khazaei, “Temporal Performance Modelling of Serverless Computing Platforms,” Proceedings of the 2020 Sixth International Workshop on Serverless Computing, pp. 1-6, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Junfeng Li et al., “Understanding Open Source Serverless Platforms,” Proceedings of the 5th International Workshop on Serverless Computing, pp. 37-42, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[12] D.M. Naranjo Delgado, “Serverless Computing Strategies on Cloud Platforms,” Thesis, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Horacio Martins, Filipe Araujo, and Paulo Rupino da Cunha, “Benchmarking Serverless Computing Platforms,” Journal of Grid Computing, vol. 18, pp. 691–709, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Junfeng Li et al., “Understanding Open Source Serverless Platforms: Design Consideration and Performace,” Proceedings of the 5th International Workshop on Serverless Computing, pp. 37-42, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Bernd Strehl, The Largest Benchmark of Serverless Providers, Medium, 2018. [Online]. Available: https://medium.com/elbstack/the-largest-benchmark-of-serverless-providers-ac19b55750f4
[16] SPCL/Serverless-Benchmarks, SeBS: Serverless Benchmarking Suite. [Online]. Available: https://github.com/spcl/serverless-benchmarks
[17] Hima Govind, and Horacio GonzaleznVelez, “Benchmarking Serverless Workloads on Kubernetes,” 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2021. doi:10.1109/ccgrid51090.2021.00085
[CrossRef] [Google Scholar] [Publisher Link]
[18] Devesh Tiwari, “Bringing Serverless Computing to the HPC Community,” Proceedings of the 2nd Workshop on High Performance Serverless Computing, pp. 1-2, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Mubashra Sadaqat, Mary Sánchez-Gordón, and Ricardo Colomo-Palacios, “Benchmarking Serverless Computing: Performance and Usability,” Journal of Information Technology Research, vol. 15, no. 1, 2022.
[CrossRef] [Publisher Link]
[20] Samuel Ginzburg, and Michael J. Freedman, “Serverless Isn’t Server-less,” Proceedings of the 2020 Sixth International Workshop on Serverless Computing, pp. 43-48, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Surya Chaitanya Palepu et al., “Benchmarking the Data Layer Across Serverless Platforms,” Proceedings of the 2nd Workshop on High Performance Serverless Computing, pp. 3-7, 2022.
[CrossRef] [Google Scholar] [Publisher Link]