TY - GEN
T1 - Lyric-Based Image Generation for Individual Songs with Text2Image Model
AU - Sasaki, Shoichi
AU - Nishida, Hiroko
AU - Sawai, Ken Ichi
AU - Ushiama, Taketoshi
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - This paper proposes a method for generating images to represent impressions of a song automatically. Thumbnail images associated with songs in music distribution services contribute greatly to the selection of songs because they allow users to visually grasp the characteristics of songs in a short period of time. On the other hand, when the same image is assigned to all of the songs in the same album, they may not adequately represent the contents of each song. In order to solve this problem, we propose a method for automatically generating images that represent the impression of a song using song lyrics information and the Text2Image model. Specifically, by analyzing the meaning of the lyrics, prompts suitable for image generation are created, and these prompts are input to the Text2Image model to obtain images. We then evaluate the validity of the generated images through user studies.
AB - This paper proposes a method for generating images to represent impressions of a song automatically. Thumbnail images associated with songs in music distribution services contribute greatly to the selection of songs because they allow users to visually grasp the characteristics of songs in a short period of time. On the other hand, when the same image is assigned to all of the songs in the same album, they may not adequately represent the contents of each song. In order to solve this problem, we propose a method for automatically generating images that represent the impression of a song using song lyrics information and the Text2Image model. Specifically, by analyzing the meaning of the lyrics, prompts suitable for image generation are created, and these prompts are input to the Text2Image model to obtain images. We then evaluate the validity of the generated images through user studies.
UR - https://www.scopus.com/pages/publications/85186144184
UR - https://www.scopus.com/pages/publications/85186144184#tab=citedBy
U2 - 10.1109/IMCOM60618.2024.10418410
DO - 10.1109/IMCOM60618.2024.10418410
M3 - Conference contribution
AN - SCOPUS:85186144184
T3 - Proceedings of the 2024 18th International Conference on Ubiquitous Information Management and Communication, IMCOM 2024
BT - Proceedings of the 2024 18th International Conference on Ubiquitous Information Management and Communication, IMCOM 2024
A2 - Lee, Sukhan
A2 - Choo, Hyunseung
A2 - Ismail, Roslan
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 18th International Conference on Ubiquitous Information Management and Communication, IMCOM 2024
Y2 - 3 January 2024 through 5 January 2024
ER -