TopoFormer: Integrating Transformers and ConvLSTMs for Coastal Topography Prediction

التفاصيل البيبلوغرافية
العنوان: TopoFormer: Integrating Transformers and ConvLSTMs for Coastal Topography Prediction
المؤلفون: Munian, Santosh, Karakuş, Oktay, Russell, William, Nelson, Gwyn
سنة النشر: 2025
المجموعة: Computer Science
مصطلحات موضوعية: Electrical Engineering and Systems Science - Signal Processing, Computer Science - Artificial Intelligence
الوصف: This paper presents \textit{TopoFormer}, a novel hybrid deep learning architecture that integrates transformer-based encoders with convolutional long short-term memory (ConvLSTM) layers for the precise prediction of topographic beach profiles referenced to elevation datums, with a particular focus on Mean Low Water Springs (MLWS) and Mean Low Water Neaps (MLWN). Accurate topographic estimation down to MLWS is critical for coastal management, navigation safety, and environmental monitoring. Leveraging a comprehensive dataset from the Wales Coastal Monitoring Centre (WCMC), consisting of over 2000 surveys across 36 coastal survey units, TopoFormer addresses key challenges in topographic prediction, including temporal variability and data gaps in survey measurements. The architecture uniquely combines multi-head attention mechanisms and ConvLSTM layers to capture both long-range dependencies and localized temporal patterns inherent in beach profiles data. TopoFormer's predictive performance was rigorously evaluated against state-of-the-art models, including DenseNet, 1D/2D CNNs, and LSTMs. While all models demonstrated strong performance, \textit{TopoFormer} achieved the lowest mean absolute error (MAE), as low as 2 cm, and provided superior accuracy in both in-distribution (ID) and out-of-distribution (OOD) evaluations.
Comment: 11 pages, 5 figures, 1 table
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2501.06494
رقم الانضمام: edsarx.2501.06494
قاعدة البيانات: arXiv