Academic Journal
Lightning: Scaling the GPU Programming Model Beyond a Single GPU
| العنوان: | Lightning: Scaling the GPU Programming Model Beyond a Single GPU |
|---|---|
| المؤلفون: | Heldens, S., Hijma, P., van Werkhoven, B., Maassen, J., van Nieuwpoort, R.V. |
| المصدر: | Heldens , S , Hijma , P , van Werkhoven , B , Maassen , J & van Nieuwpoort , R V 2022 , Lightning: Scaling the GPU Programming Model Beyond a Single GPU . in Proceedings, 2022 IEEE 36th International Parallel and Distributed Processing Symposium : 30 May-3 June 2022, virtual event . IPDPS , IEEE Computer Society , Los Alamitos, California , pp. 492-503 , 36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022 , Virtual, Online , France , 30/05/22 . https://doi.org/10.1109/IPDPS53621.2022.00054 |
| بيانات النشر: | IEEE Computer Society |
| سنة النشر: | 2022 |
| المجموعة: | Universiteit van Amsterdam: Digital Academic Repository (UvA DARE) |
| الوصف: | The GPU programming model is primarily aimed at the development of applications that run one GPU. However, this limits the scalability of GPU code to the capabilities of a single GPU in terms of compute power and memory capacity. To scale GPU applications further, a great engineering effort is typically required: work and data must be divided over multiple GPUs by hand, possibly in multiple nodes, and data must be manually spilled from GPU memory to higher-level memories. We present Lightning: a framework that follows the common GPU programming paradigm but enables scaling to large problems with ease. Lightning supports multi-GPU execution of GPU kernels, even across multiple nodes, and seamlessly spills data to higher-level memories (main memory and disk). Existing CUDA kernels can easily be adapted for use in Lightning, with data access annotations on these kernels allowing Lightning to infer their data requirements and the dependencies between subsequent kernel launches. Lightning efficiently distributes the work/data across GPUs and maximizes efficiency by overlapping scheduling, data movement, and kernel execution when possible. We present the design and implementation of Lightning, as well as experimental results on up to 32 GPUs for eight benchmarks and one real-world application. Evaluation shows excellent performance and scalability, such as a speedup of 57.2 x over the CPU using Lighting with 16 GPUs over 4 nodes and 80 GB of data, far beyond the memory capacity of one GPU. |
| نوع الوثيقة: | article in journal/newspaper |
| وصف الملف: | application/pdf |
| اللغة: | English |
| ردمك: | 978-1-66548-107-6 1-66548-107-2 |
| Relation: | https://dare.uva.nl/personal/pure/en/publications/lightning-scaling-the-gpu-programming-model-beyond-a-single-gpu(525e786d-21fb-4512-a1e9-e736b354178e).html; urn:ISBN:9781665481076 |
| DOI: | 10.1109/IPDPS53621.2022.00054 |
| الاتاحة: | https://dare.uva.nl/personal/pure/en/publications/lightning-scaling-the-gpu-programming-model-beyond-a-single-gpu(525e786d-21fb-4512-a1e9-e736b354178e).html https://doi.org/10.1109/IPDPS53621.2022.00054 https://hdl.handle.net/11245.1/525e786d-21fb-4512-a1e9-e736b354178e https://pure.uva.nl/ws/files/137547727/Lightning_Scaling_the_GPU_Programming_Model_Beyond_a_Single_GPU.pdf https://www.proceedings.com/64710.html http://www.scopus.com/inward/record.url?scp=85136334662&partnerID=8YFLogxK |
| Rights: | info:eu-repo/semantics/openAccess |
| رقم الانضمام: | edsbas.9A707DAF |
| قاعدة البيانات: | BASE |
| ردمك: | 9781665481076 1665481072 |
|---|---|
| DOI: | 10.1109/IPDPS53621.2022.00054 |