SBERT-based Chord Progression Estimation from Lyrics Trained with Imbalanced Data

التفاصيل البيبلوغرافية
العنوان: SBERT-based Chord Progression Estimation from Lyrics Trained with Imbalanced Data
المؤلفون: Puspitasari, Mastuti, Takahashi, Takuya, Hori, Gen, Sagayama, Shigeki, Nakashika, Toru
المصدر: CMMR 2023, The 16th International Symposium on Computer Music Multidisciplinary Research, Tokyo, Japan, 13th-17th November 2023
بيانات النشر: Zenodo
سنة النشر: 2023
المجموعة: Zenodo
الوصف: In this research, we developed a model that can estimate appropriate chord progression based on lyrics input. It outputs a sequence of chord that can be used to compose the corresponding lyrics input. By training the model with different datasets, it is also possible to estimate other musical components that are correlated with lyrics, for example rhythm pattern, instrument, tempo, and drum pattern. Using this set of musical components as a setup recommendation for composition can potentially automate the configuration process on AI-based composition tools. We sourced our training data from "Orpheus", a web-based automatic composition system, resulting in more than 6,000 paired data of lyrics and musical components chosen by users who published their songs in the platform. Lyrics are pre-processed into semantics embedding using Sentence-BERT before being fed as training data into the multi-layer perceptron model as a classifier to estimate chord progression. Evaluation of this model is done objectively with ROC and F1 score, and subjectively through a survey.
نوع الوثيقة: conference object
اللغة: unknown
Relation: https://zenodo.org/communities/cmmr2023; https://doi.org/10.5281/zenodo.10113127; https://doi.org/10.5281/zenodo.10113128; oai:zenodo.org:10113128
DOI: 10.5281/zenodo.10113128
الاتاحة: https://doi.org/10.5281/zenodo.10113128
Rights: info:eu-repo/semantics/openAccess ; Creative Commons Attribution 4.0 International ; https://creativecommons.org/licenses/by/4.0/legalcode
رقم الانضمام: edsbas.8C7A5A28
قاعدة البيانات: BASE