Formal congruency between Telop patterns and sound effects

The effects of formal congruency between Telops (animated text on a display) and sound effects on the affect of audio-visual content were investigated. Rating experiments were performed using systematic combinations of various Telops and sound patterns. As a result, formal congruency contributed to enhancing subjective congruency between Telop and sound patterns. Formal congruency also contributed to enhancing the evaluation of audio-visual productions. Two types of formal congruency were effective in creating subjective congruency: the synchronization of temporal structures and the matching of changing patterns between auditory and visual events. To create formal congruency based on synchronization between auditory and visual structures, correspondence of the onsets of sound and Telop was important. The combinations of the gradually rising loudness or pitch of sounds and the expanding (or approaching) of Telop pattern were found to create the matching of changing patterns.