التفاصيل البيبلوغرافية
| العنوان: |
Simultaneous and Spatiotemporal Detection of Different Levels of Activity in Multidimensional Data |
| المؤلفون: |
Natalie M. Sommer, Senem Velipasalar, Leanne Hirshfield, Yantao Lu, Burak Kakillioglu |
| المصدر: |
IEEE Access, Vol 8, Pp 118205-118218 (2020) |
| بيانات النشر: |
IEEE, 2020. |
| سنة النشر: |
2020 |
| المجموعة: |
LCC:Electrical engineering. Electronics. Nuclear engineering |
| مصطلحات موضوعية: |
LSTM, convolutional LSTM, machine learning, multilabeling, activity detection, spatiotemporal, Electrical engineering. Electronics. Nuclear engineering, TK1-9971 |
| الوصف: |
In this work, we present a novel and promising approach to autonomously detect different levels of simultaneous and spatiotemporal activity in multidimensional data. We introduce a new multilabeling technique, which assigns different labels to different regions of interest in the data, and thus, incorporates the spatial aspect. Each label is built to describe the level of activity/motion to be monitored in the spatial location that it represents, in contrast to existing approaches providing only a binary result as the presence or absence of activity. This novel Spatially and Motion-Level Descriptive (SMLD) labeling schema is combined with a Convolutional Long Short Term Memory-based network for classification to capture different levels of activity both spatially and temporally without the use of any foreground or object detection. The proposed approach can be applied to various types of spatiotemporal data captured for completely different application domains. In this paper, it was evaluated on video data as well as respiratory sound data. Metrics commonly associated with multilabeling, namely Hamming Loss and Subset Accuracy, as well as confusion matrix-based measurements are used to evaluate performance. Promising testing results are achieved with an overall Hamming Loss for video datasets close to 0.05, Subset Accuracy close to 80% and confusion matrix-based metrics above 0.9. In addition, our proposed approach's ability in detecting frequent motion patterns based on predicted spatiotemporal activity levels is discussed. Encouraging results have been obtained on the respiratory sound dataset as well, while detecting abnormalities in different parts of the lungs. The experimental results demonstrate that the proposed approach can be applied to various types of spatiotemporal data captured for different application domains. |
| نوع الوثيقة: |
article |
| وصف الملف: |
electronic resource |
| اللغة: |
English |
| تدمد: |
2169-3536 |
| Relation: |
https://ieeexplore.ieee.org/document/9127934/; https://doaj.org/toc/2169-3536 |
| DOI: |
10.1109/ACCESS.2020.3005633 |
| URL الوصول: |
https://doaj.org/article/63530e988c444d2793d8d0390761b964 |
| رقم الانضمام: |
edsdoj.63530e988c444d2793d8d0390761b964 |
| قاعدة البيانات: |
Directory of Open Access Journals |
Full Text Finder