Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Unveiling the Multimedia Unconscious: Implicit Cognitive Processes and Multimedia Content Analysis

Marco Cristani, Alessandro Vinciarelli, Cristina Segalin, and Alessandro Perina

Abstract

One of the main findings of cognitive sciences is that automatic processes of which we are unaware shape, to a significant extent, our perception of the environment. The phenomenon applies not only to the real world, but also to multimedia data we consume every day. Whenever we watch a video, listen to audio recordings or look at pictures, our conscious attention efforts focus on the observable content, but our cognition spontaneously perceives intentions, beliefs, values, attitudes and other constructs that, while being outside of our conscious awareness, still shape our reactions and behavior. So far, multimedia analysis approaches have neglected such a phenomenon to a large extent. This paper argues that taking into account cognitive effects is not only possible, but it can also improve multimedia technologies. As a supporting proof-of-concept, the paper shows that the personality traits (both self-assessed and attributed by others) of 300 Flickr users can be inferred from the images these latter post as "favourite".

Details

Publication typeProceedings
PublisherACM Conference on Multimedia
> Publications > Unveiling the Multimedia Unconscious: Implicit Cognitive Processes and Multimedia Content Analysis