The role of visual and audio code in the cognitive elaboration of multimedia emotional stimuli

Barbara Colombo, Chiara Di Nuzzo, N. Mazzucchelli

Research output: Chapter in Book/Report/Conference proceedingChapter


The present study was aimed at exploring the link among multimedia, individual difference, cognitive load and emotional content, by the way of exploring the cognitive elaboration of emotional multimedia stimuli (audio+video) using eye-tracking technology and biofeedback. More in details, we were interested in exploring the effect of expertise, cognitive style, different format of multimedia emotional presentation on cognitive elaboration and emotional responses. Interesting data emerged from first data analyses. Different kind of multimedia presentation appeared to promote different levels of activation and different exploration behaviors. Individual differences seem to play an important role, as well as level of expertise. This last variable appears to be more linked to response to different type of cognitive load. Quite surprisingly coherence between audio and video emotional content didn’t seem to promote more adequate activation (audio resulted more important than images in influencing participants responses)– while the opposite was true with neutral music background.
Original languageEnglish
Title of host publicationProceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2010
Number of pages6
Publication statusPublished - 2010
Externally publishedYes


  • Bio feedbcak
  • Emotion
  • Eye tracker
  • Multimedia
  • Music


Dive into the research topics of 'The role of visual and audio code in the cognitive elaboration of multimedia emotional stimuli'. Together they form a unique fingerprint.

Cite this