Academic Journal

On the performance of SQL scalable systems on Kubernetes: a comparative study

التفاصيل البيبلوغرافية
العنوان: On the performance of SQL scalable systems on Kubernetes: a comparative study
المؤلفون: Cardas Ezeiza, Cristian, Aldana Martín, José Francisco, Burgueño Romero, Antonio Manuel, Nebro-Urbaneja, Antonio Jesús, Mateos, Jose M., Sánchez-Martínez, Juan José
سنة النشر: 2022
المجموعة: RIUMA - Repositorio Institucional de la Universidad de Málaga
مصطلحات موضوعية: SQL (Lenguaje de programación), Scalable SQL systems, Hadoop, Kubernetes, Apache Spark, Trino, Apache Drill, Hive MR3
الوصف: The popularization of Hadoop as the the-facto standard platform for data analytics in the context of Big Data applications has led to the upsurge of SQL-on-Hadoop systems, which provide scalable query execution engines allowing the use of SQL queries on data stored in HDFS. In this context, Kubernetes appears as the leading choice to simplify the deployment and scaling of containerized applications; however, there is a lack of studies about the performance of SQL-on-Hadoop systems deployed on Kubernetes, and this is the gap we intend to fill in this paper. We present an experimental study involving four representative SQL scalable platforms: Apache Drill, Apache Hive, Apache Spark SQL and Trino. Concretely, we analyze the performance of these systems when they are deployed on a Hadoop cluster with Kubernetes by using the TPC-H benchmark. The results of our study can help practitioners and users about what they can expect in terms of performance if they plan to use the advantages of Kubernetes to deploy applications using the analyzed SQL scalable platforms. ; Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidad de Málaga / CBUA. This work has been partially funded by the Spanish Ministry of Science and Innovation via Grant PID2020-112540RB-C41 (AEI/FEDER, UE), Andalusian PAIDI program with grant P18-RT-2799, and by project ”Evolución y desarrollo de la plataforma DOP de Big Data” (702C2000044) under Andalusian “Programa de Apoyo a la I+D+i Empresarial”.
نوع الوثيقة: article in journal/newspaper
اللغة: English
Relation: Cardas, C., Aldana-Martín, J.F., Burgueño-Romero, A.M. et al. On the performance of SQL scalable systems on Kubernetes: a comparative study. Cluster Comput (2022). https://doi.org/10.1007/s10586-022-03718-9; https://hdl.handle.net/10630/24957; https://doi.org/10.1007/s10586-022-03718-9
DOI: 10.1007/s10586-022-03718-9
الاتاحة: https://hdl.handle.net/10630/24957
https://doi.org/10.1007/s10586-022-03718-9
Rights: info:eu-repo/semantics/openAccess ; http://creativecommons.org/licenses/by/4.0/ ; Atribución 4.0 Internacional
رقم الانضمام: edsbas.11F9D1B9
قاعدة البيانات: BASE
الوصف
DOI:10.1007/s10586-022-03718-9