Scalable Design and Implementations for MPI Parallel Overlapping I/O

التفاصيل البيبلوغرافية
العنوان: Scalable Design and Implementations for MPI Parallel Overlapping I/O
المؤلفون: E. Russell, Lee Ward, N. Pundit, Alok Choudhary, Wei-keng Liao, Kenin Coloma
المصدر: IEEE Transactions on Parallel and Distributed Systems. 17:1264-1276
بيانات النشر: Institute of Electrical and Electronics Engineers (IEEE), 2006.
سنة النشر: 2006
مصطلحات موضوعية: Computer science, Serialization, Message Passing Interface, Parallel computing, computer.software_genre, File locking, File server, Server, Versioning file system, File system fragmentation, Input/output, File system, Atomicity, File descriptor, Message passing, Device file, Unix file types, Memory-mapped file, File Control Block, Self-certifying File System, Computational Theory and Mathematics, Hardware and Architecture, POSIX, Signal Processing, Asynchronous I/O, Cache, computer, Cache coherence
الوصف: We investigate the message passing interface input/output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the portable operating system interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called persistent file domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks
تدمد: 1045-9219
DOI: 10.1109/tpds.2006.163
URL الوصول: https://explore.openaire.eu/search/publication?articleId=doi_________::4c7362c1fc3cb3bc3f9044682683733b
https://doi.org/10.1109/tpds.2006.163
Rights: CLOSED
رقم الانضمام: edsair.doi...........4c7362c1fc3cb3bc3f9044682683733b
قاعدة البيانات: OpenAIRE
الوصف
تدمد:10459219
DOI:10.1109/tpds.2006.163